00000400:00080000:2.0F:1777497352.132604:0:80395:0:(debug.c:451:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1777497352.80013 00010000:02000000:3.0F:1777497352.132717:0:80013:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:07, of 2 clients 1 recovered and 1 was evicted. 00000004:00000080:2.0:1777497352.172334:0:80013:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef0726be10 00100000:10000000:2.0:1777497352.172349:0:80013:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:1.0F:1777497352.173526:0:80001:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1777497352.173579:0:80001:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:80001:1863837564796288:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777497352.173644:0:80001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497352.173680:0:80001:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d44d80 going to sleep for 20 seconds 00000004:00080000:2.0:1777497352.173909:0:79999:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:2.0:1777497352.173931:0:79999:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2fdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79999:1863837564796416:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777497352.173976:0:79999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497352.173998:0:79999:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86030a80 going to sleep for 20 seconds 00000100:00100000:0.0F:1777497352.174393:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796288 00000100:00100000:0.0:1777497352.174409:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796288 00000100:00100000:0.0:1777497352.174454:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796416 00000100:00100000:0.0:1777497352.174457:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796416 00000100:00100000:0.0:1777497352.174489:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5818 00000100:00100000:0.0:1777497352.174498:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:80001:x1863837564796288:12345-0@lo:5:osp-pre-1-0.0 00000020:02000000:0.0:1777497352.174504:0:25485:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1777497352.174531:0:25485:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -529 00002000:02000040:0.0:1777497352.174536:0:25485:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:673) 00000100:00100000:1.0:1777497352.175236:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5819 00000100:00100000:1.0:1777497352.175249:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:79999:x1863837564796416:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:1.0:1777497352.175255:0:8398:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:1.0:1777497352.175270:0:8398:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 673 -> diff = -31 00002000:02000040:1.0:1777497352.175274:0:8398:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:673) 00002000:00010000:0.0:1777497352.187928:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.187941:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.187969:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.187971:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.187977:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.187993:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188004:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188011:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188039:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188141:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188148:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188156:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188160:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188167:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188176:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.188183:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188189:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df840eb1/0x3e357265691b9ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188197:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188204:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188205:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188208:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188209:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188211:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188213:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188217:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188224:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188231:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188252:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188266:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188277:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188284:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188287:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188295:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188295:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188299:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188305:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188306:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188307:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188310:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188313:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058326e7e/0x3e357265691b9c1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188319:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188325:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188326:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188328:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188332:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188339:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188360:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188377:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188382:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188389:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188391:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188400:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188405:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188410:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188412:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188413:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188416:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188420:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188425:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188427:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef1e5361/0x3e357265691b9c8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188433:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188439:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188440:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188441:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188442:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188456:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188463:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188467:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188474:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188477:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188484:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188493:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188495:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188500:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188507:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188508:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497352.188510:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000764682ee/0x3e357265691b9cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188511:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188520:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188523:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188525:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188527:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188527:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188534:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188551:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188564:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188568:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188575:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188578:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188584:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.188585:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188588:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188595:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188595:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188597:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188599:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188602:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0f711b4/0x3e357265691b9d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188608:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188613:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188615:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188616:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188621:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188628:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188646:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188662:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188666:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188684:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188687:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188695:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188696:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188701:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188705:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188708:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188710:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497352.188712:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe2b6cb0/0x3e357265691b9dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188713:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188722:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188725:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188726:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.188728:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.188729:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188736:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188754:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.188801:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188806:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188813:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188814:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188817:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188824:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188830:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188837:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188848:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497352.188864:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.188868:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188875:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.188877:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188880:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188884:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188891:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188893:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497352.188895:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188895:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188904:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188906:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188913:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691b9e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188916:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188923:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188927:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.188930:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188936:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.188936:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.188938:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188945:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188967:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.188975:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691b9eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.188981:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.188986:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.188993:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188995:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.188998:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189006:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189009:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.189012:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189014:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189019:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.189022:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189022:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189029:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189035:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.189038:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189045:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691b9f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189055:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.189058:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189064:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.189067:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.189074:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.189078:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189083:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189085:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.189086:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.189089:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189113:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189117:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189121:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691b9f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189125:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189132:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.189134:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.189136:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.189137:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.189145:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.189179:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.189183:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189191:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.189192:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.189194:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189202:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189215:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.189221:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192701:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.192713:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192727:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.192732:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192743:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192764:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192798:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691ba00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192834:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.192838:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192845:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.192847:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192855:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192867:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.192873:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.192874:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.192876:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.192888:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.192915:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.195372:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777497352.195386:0:25485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691ba07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.195655:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.195662:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195675:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.195677:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.195683:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195698:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195707:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195715:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195751:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.195796:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.195801:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.195810:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.195812:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.195815:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196006:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196016:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196024:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196037:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777497352.196077:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.196197:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196207:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196208:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196219:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196228:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196235:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196241:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196250:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1777497352.196289:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.196294:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196301:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196302:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196305:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196314:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196321:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196339:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196348:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1777497352.196387:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.196392:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196401:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196402:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196405:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196413:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196421:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196428:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196437:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1777497352.196468:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.196474:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196492:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196493:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.196496:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196504:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196510:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196517:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.196524:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:2.0:1777497352.196606:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1777497352.196614:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196634:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196638:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196647:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196664:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196671:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691ba0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196690:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777497352.196694:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196700:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196702:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196709:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196719:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196732:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691ba15 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196744:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777497352.196747:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196752:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196755:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196761:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196769:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196775:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691ba1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196785:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497352.196788:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196793:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196801:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196808:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196817:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196823:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691ba23 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196834:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.196837:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196842:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196845:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196851:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196859:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196865:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691ba2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196883:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.196885:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196892:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.196895:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196903:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196913:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196919:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691ba31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.196930:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.196932:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.196933:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.196940:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.196946:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497352.197805:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.197813:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.197837:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.197839:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.197844:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.197856:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.197880:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.197888:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.197901:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.198360:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.198367:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.198389:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.198393:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.198402:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.198417:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.198424:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691ba38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.198445:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.198447:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.198449:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.199141:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497352.199299:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199307:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199319:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199321:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199325:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199337:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199345:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199351:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199371:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.199431:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199436:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199443:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199444:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199447:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199456:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199463:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199469:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199493:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497352.199522:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497352.199528:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.199528:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199533:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199537:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.199540:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.199541:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199542:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.199549:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199557:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199562:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199565:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199570:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691ba3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199579:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199586:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199588:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.199591:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199596:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.199597:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.199600:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199607:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199623:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199630:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691ba46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.199630:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199634:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199641:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.199642:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497352.199642:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.199645:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199645:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199652:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.199654:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199656:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199664:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199664:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199671:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199672:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199679:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691ba4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199683:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.199690:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.199693:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199704:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.199707:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199714:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.199722:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497352.199723:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199727:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199730:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691ba54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199734:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199736:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199738:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199742:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.199744:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.199746:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.199747:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199751:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.199754:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199760:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199783:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.199829:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199834:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199842:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199843:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199846:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199851:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.199855:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199855:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199861:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.199864:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199868:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199875:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199881:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199886:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.199893:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199901:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691ba5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.199922:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.199927:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199929:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.199932:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199934:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.199936:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.199939:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.199939:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199942:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199948:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199950:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199966:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199972:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199973:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.199980:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691ba62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.199982:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.200010:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.200013:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200019:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.200022:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.200024:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.200028:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200029:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.200036:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.200037:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.200040:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.200041:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200049:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691ba69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.200049:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.200057:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200060:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.200062:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.200063:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.200065:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200068:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.200080:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.200086:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.200090:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200117:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.200127:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200133:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200143:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.200151:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.200153:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.200154:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.200244:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.200251:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.201899:0:25485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691ba70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.202042:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.202049:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202061:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202063:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202108:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202123:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202133:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202141:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202155:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.202172:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.202178:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202186:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.202191:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.202193:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.202197:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202200:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202205:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202206:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202209:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202214:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202216:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202222:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065ffeebd/0x3e357265691ba77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202224:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202239:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202244:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.202245:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.202247:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.202261:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.202301:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.202306:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202314:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202316:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202319:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202326:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202333:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202339:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202359:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497352.202380:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497352.202384:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202392:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.202395:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.202395:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.202399:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202403:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202413:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202415:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202417:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.202420:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084405761/0x3e357265691ba7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202420:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202430:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202433:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.202436:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202437:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202443:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.202445:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202450:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202457:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202457:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.202466:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202473:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035f18b0d/0x3e357265691ba85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.202491:0:25485:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x282:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.202494:0:25485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202499:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497352.202501:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.202502:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202503:0:25485:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.202506:0:25485:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202509:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150bc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.202512:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202515:0:25485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202519:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202528:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202533:0:25485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202534:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ac906dc/0x3e357265691ba8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202540:0:25485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202549:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.202552:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.202552:0:25485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777497352.202558:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.202560:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202567:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202577:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202583:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be0bbf5b/0x3e357265691ba93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.202593:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.202595:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.202597:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.202602:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.204060:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.204070:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.205413:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.205423:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.205441:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.205443:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.205449:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.205468:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206487:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206499:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206527:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.206662:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.206670:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206677:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.206681:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206696:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206714:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.206717:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.206722:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000808fe36/0x3e357265691ba9a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206722:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206733:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.206734:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.206739:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206745:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.206747:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.206749:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.206749:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206756:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206762:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206783:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.206798:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.206802:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206809:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.206812:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.206819:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.206824:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206829:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206831:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.206833:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.206835:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206840:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206844:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206858:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d44a7e30/0x3e357265691baa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206858:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206866:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.206871:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.206873:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.206874:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.206881:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497352.206889:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.206892:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206898:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.206901:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206920:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206930:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206936:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691baa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.206949:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.206969:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.206971:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.207033:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207038:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207044:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207046:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207048:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207056:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207062:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207068:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207087:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.207149:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207155:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207161:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207163:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207165:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207183:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207189:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207195:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207207:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497352.207243:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207247:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207255:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207256:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207259:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207267:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207274:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207281:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207286:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.207291:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207298:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.207299:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497352.207301:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207308:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207318:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207324:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244bdc0d/0x3e357265691baaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.207333:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207337:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207338:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.207341:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207345:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207346:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207349:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207352:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.207355:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207358:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207363:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207365:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207372:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207373:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207380:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691bab6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207384:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497352.207390:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497352.207393:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207399:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.207402:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207414:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207420:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.207423:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207425:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207430:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.207432:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691babd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207433:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207440:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207445:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207447:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207448:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207448:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207460:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691bac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207473:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207475:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207477:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207482:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.207484:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x29a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.207487:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207488:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207494:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207496:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207499:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207507:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207515:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207531:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207554:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.207592:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x299:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207597:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207604:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207606:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207608:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207617:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207625:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207632:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207642:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497352.207654:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.207659:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207666:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.207670:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.207674:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x298:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.207677:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207678:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207689:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207697:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691bacb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207697:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207698:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207702:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207710:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207712:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.207717:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207718:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207725:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.207725:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207729:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207735:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207738:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.207744:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207745:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.207748:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207752:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691bad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x299:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207755:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.207758:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207764:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207765:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207766:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207767:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.207772:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207785:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207792:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691bad9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x298:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207806:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207807:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.207809:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.207847:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x297:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.207851:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207858:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207859:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207861:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207869:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207877:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207884:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207915:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.207965:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777497352.207967:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x296:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497352.207969:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207972:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.207977:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.207980:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207980:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207981:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.207984:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207992:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.207999:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208005:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208017:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.208020:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208023:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.208026:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208031:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208032:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.208036:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208038:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691bae0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x297:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208048:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208053:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208055:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208057:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208057:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208064:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691bae7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x296:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208077:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208078:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208080:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.208154:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x295:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208160:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208167:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208168:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208171:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208179:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208185:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208202:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208216:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.208254:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x294:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208258:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208267:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208268:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208271:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208280:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208287:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208293:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208307:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497352.208313:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497352.208316:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208333:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.208336:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208343:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208344:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.208348:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208354:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.208354:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208358:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208362:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691baee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x295:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208365:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208374:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208376:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208377:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208379:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208390:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691baf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x294:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208404:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208406:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208407:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.208414:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x293:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208418:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208425:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208426:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208429:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208437:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208452:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208458:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208477:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.208498:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.208502:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208509:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.208512:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.208514:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x292:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208518:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208519:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208526:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208527:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497352.208530:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208530:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208537:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691bafc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x293:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208539:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208546:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208553:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208565:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497352.208570:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.208573:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208577:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208583:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.208586:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208593:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208603:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208610:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691bb03 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x292:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497352.208610:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x291:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208614:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208621:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208623:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497352.208625:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208625:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208626:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.208628:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208634:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208641:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208648:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208668:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.208702:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x290:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208707:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208714:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208715:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208717:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208734:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208741:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208748:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208758:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497352.208799:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.208804:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208812:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208813:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.208816:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208824:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208831:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208838:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208858:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777497352.208865:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497352.208869:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208875:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.208877:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208884:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208893:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208900:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691bb0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x291:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208915:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497352.208917:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208924:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.208927:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208944:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208964:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.208964:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208968:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208972:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691bb11 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x290:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208976:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.208979:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.208986:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.208987:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208988:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.208989:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209002:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209008:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691bb18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209023:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209025:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209027:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.209027:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209031:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209032:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.209039:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209041:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209044:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209053:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209060:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209079:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209115:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.209155:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209160:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209168:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209169:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209171:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209180:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209187:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209194:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209207:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497352.209214:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497352.209217:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209220:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497352.209224:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209231:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.209234:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209234:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.209237:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209242:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209245:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209252:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209253:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209260:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691bb26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209261:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691bb1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209276:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.209277:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.209279:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209281:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209282:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209284:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.209317:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209322:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209329:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209331:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209333:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209341:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209353:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209360:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209379:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.209415:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209420:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209427:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209428:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209431:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209439:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209446:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209453:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209462:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497352.209500:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x28a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209505:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209513:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209514:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209517:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209525:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209533:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209540:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209552:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777497352.209559:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497352.209562:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209568:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.209571:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209578:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209595:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209602:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691bb2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209617:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497352.209620:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209627:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.209630:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209636:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209645:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209650:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691bb34 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209662:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.209666:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209680:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.209683:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209690:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209700:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209708:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bb3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209721:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.209723:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.209724:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209738:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209743:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497352.209764:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x289:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209770:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209776:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209778:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209781:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209788:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209801:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209808:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209828:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497352.209866:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x288:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497352.209871:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209878:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209880:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497352.209883:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209891:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209899:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209906:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209920:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497352.209925:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497352.209929:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209931:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497352.209934:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209937:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497352.209941:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.209941:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497352.209943:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209949:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209968:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209974:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bb42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x289:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497352.209991:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209992:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497352.209994:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1777497352.212475:0:25485:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:0.0:1777497352.213284:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:80001:x1863837564796288:12345-0@lo:5:osp-pre-1-0.0 Request processed in 38780us (39632us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497352.213296:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5818 00002000:00010000:0.0:1777497352.213451:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x287:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.213459:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213474:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213476:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213481:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213494:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213503:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213525:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213560:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.213602:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x286:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.213606:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213610:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497352.213613:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213614:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.213617:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213617:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213625:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497352.213626:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213634:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213636:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213641:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213645:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213653:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497352.213660:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213668:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5c7e500/0x3e357265691bb50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x287:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.213684:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x285:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.213688:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213689:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.213693:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213699:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.213702:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213705:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213706:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.213709:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213710:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213719:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213720:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213728:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a8f51ed/0x3e357265691bb57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x286:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213728:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213735:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213743:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.213746:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213747:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777497352.213752:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ae00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.213755:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213762:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213771:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213778:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b62e906a/0x3e357265691bb5e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x285:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497352.213779:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x284:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.213783:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213790:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.213790:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.213792:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.213792:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497352.213794:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.213795:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213804:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.213808:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.213817:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497352.213835:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213841:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213859:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497352.213903:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x283:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497352.213908:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213916:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213918:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497352.213921:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213929:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213936:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213943:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497352.213969:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1777497352.214003:0:8398:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:0.0:1777497352.214063:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:79999:x1863837564796416:12345-0@lo:5:osp-pre-0-0.0 Request processed in 38818us (40086us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497352.214072:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5819 00000100:00100000:0.0:1777497352.214175:0:79999:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2fdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79999:1863837564796416:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1777497352.214191:0:79999:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2a1:0x0] from OST, last_created [0x280000401:0x2a1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:0.0:1777497352.214263:0:79999:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e19500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79999:1863837564796672:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497352.214298:0:79999:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497352.214321:0:79999:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f851023c0 going to sleep for 20 seconds 00000100:00100000:0.0:1777497352.214338:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796672 00000100:00100000:0.0:1777497352.214344:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796672 00000100:00100000:0.0:1777497352.214377:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5820 00000100:00100000:0.0:1777497352.214385:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:79999:x1863837564796672:12345-0@lo:5:osp-pre-0-0.0 00000020:02000000:0.0:1777497352.214390:0:25495:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:0.0:1777497352.214422:0:25495:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 674 00010000:00010000:3.0:1777497352.215131:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497352.215139:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215161:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.215165:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215174:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215187:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215194:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007615e36f/0x3e357265691bb65 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x284:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215213:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497352.215216:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215222:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497352.215226:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215233:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215242:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215254:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004728fb5d/0x3e357265691bb6c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x283:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497352.215266:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.215267:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.215269:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.215277:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497352.219328:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:79999:x1863837564796672:12345-0@lo:5:osp-pre-0-0.0 Request processed in 4936us (5022us total) trans 4294969449 rc 0/0 00000100:00100000:0.0:1777497352.219338:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5820 00000100:00100000:3.0:1777497352.219379:0:79999:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e19500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:79999:1863837564796672:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497352.219390:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000004:00080000:3.0:1777497352.219395:0:79999:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2a1:0x0]-[0x280000401:0x2c1:0x0] 00000100:00100000:0.0:1777497352.219404:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564796544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497352.219439:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497352.219464:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796544 00000100:00100000:3.0:1777497352.219470:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796544 00000100:00100000:3.0:1777497352.219515:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1777497352.219526:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564796544:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1777497352.219532:0:25316:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497352.219551:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497352.219587:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564796544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497352.219592:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:3.0:1777497352.219619:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564796544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497352.219626:0:80001:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:80001:1863837564796288:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497352.219656:0:80001:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2a1:0x0] from OST, last_created [0x2c0000401:0x2a1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:2.0:1777497352.219708:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497352.219717:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564796800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497352.219745:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497352.219785:0:80001:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:80001:1863837564796928:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777497352.219808:0:80001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497352.219840:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796928 00000100:00100000:2.0:1777497352.219844:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796928 00000100:00100000:3.0:1777497352.220407:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5821 00000100:00100000:3.0:1777497352.220419:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:80001:x1863837564796928:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777497352.220423:0:80001:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86030480 going to sleep for 20 seconds 00000020:02000000:3.0:1777497352.220426:0:25496:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00080000:2.0:1777497352.220495:0:25496:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 674 00000100:00100000:0.0:1777497352.221042:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564796800 00000100:00100000:0.0:1777497352.221049:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564796800 00000100:00100000:0.0:1777497352.221718:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:0.0:1777497352.221730:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564796800:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:0.0:1777497352.221737:0:10306:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:0.0:1777497352.221763:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 216384 pending 896 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497352.221849:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564796800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497352.221857:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1777497352.222851:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:80001:x1863837564796928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2434us (3040us total) trans 4294969446 rc 0/0 00000100:00100000:2.0:1777497352.222861:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5821 00000100:00100000:2.0:1777497352.222921:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564796800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497352.222968:0:80001:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:80001:1863837564796928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497352.222978:0:80001:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2a1:0x0]-[0x2c0000401:0x2c1:0x0] 00010000:00010000:1.0:1777497352.224592:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.224632:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.224640:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bb49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x288:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497352.240520:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.240526:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497352.240528:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497352.354393:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1777497352.738327:0:8407:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240bc2fd180 x1863837564795008/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 224/0 e 0 to 0 dl 1777497361 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497352.738450:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564795008:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 1007355us (1007491us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497352.738462:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3786 00000100:00080000:1.0:1777497352.738621:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:1.0:1777497352.738631:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff9240bc2fe680 x1863837564795008/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497381 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497352.738639:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9240bc2fe680 x1863837564795008/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497381 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497352.738645:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497352.738668:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497352.739153:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497352.739198:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497352.739207:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564797056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497352.739231:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497352.739271:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564710528 00000100:00100000:2.0:1777497352.739279:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564710528 00000100:00100000:2.0:1777497352.739323:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797056 00000100:00100000:2.0:1777497352.739326:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797056 00000100:00100000:2.0:1777497352.739343:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3792 00000100:00100000:2.0:1777497352.739352:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564710528:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:2.0:1777497352.739361:0:23359:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1777497352.739392:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1777497352.739398:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3793 00000100:00100000:0.0:1777497352.739406:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564797056:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:0.0:1777497352.739411:0:80394:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:0.0:1777497352.739421:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1777497352.739434:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564710528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497352.739444:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564797056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 40us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497352.739449:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3792 00000100:00100000:0.0:1777497352.739452:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3793 00000100:00100000:3.0:1777497352.740291:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564797056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497352.740308:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564710528:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497352.761029:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564795008:0@lo:400:ptlrpcd_rcv.0 00010000:00010000:3.0:1777497353.378936:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497354.402448:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497354.786553:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497354.786577:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564797184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497354.786646:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497354.786757:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797184 00000100:00100000:1.0:1777497354.786765:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797184 00000100:00100000:1.0:1777497354.786818:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3794 00000100:00100000:1.0:1777497354.786827:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564797184:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:1.0:1777497354.786833:0:23359:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1777497354.786870:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497354.786938:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564797184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497354.786945:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3794 00000100:00100000:0.0:1777497354.787561:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564797184:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1777497355.427638:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497356.322654:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564797312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497356.322720:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497356.322772:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497356.322778:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564797440:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497356.322809:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497356.324110:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797312 00000100:00100000:1.0:1777497356.324122:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797312 00000100:00100000:1.0:1777497356.324192:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797440 00000100:00100000:1.0:1777497356.324195:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797440 00000100:00100000:1.0:1777497356.324229:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00080000:2.0:1777497356.324267:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497356.324272:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497356.324327:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564797312:12345-0@lo:13:osp-pre-0-1.0 00000020:02000000:1.0:1777497356.324335:0:8400:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:1.0:1777497356.324367:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497356.324432:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564797312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.324496:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564797312:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497356.333503:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1777497356.333534:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564797440:12345-0@lo:13:osp-pre-1-1.0 00000020:02000000:3.0:1777497356.333544:0:10306:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497356.333577:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497356.333672:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564797440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 155us (10860us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497356.333679:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:3.0:1777497356.333762:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564797440:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497356.335712:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00010000:00010000:3.0:1777497356.453623:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497356.834439:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564797696:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.834459:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564797952:0@lo:400:kworker.0 00000100:00100000:1.0:1777497356.834557:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564797824:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.834614:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564797568:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.849148:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497356.849211:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564798464:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.849263:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497356.849288:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564798976:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.849335:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497356.849389:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797952 00000100:00100000:0.0:1777497356.849398:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797952 00000100:00100000:0.0:1777497356.849480:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1777497356.849488:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564797952:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1777497356.849496:0:63727:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1777497356.849549:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564797952:12345-0@lo:400:kworker.0 Request processed in 62us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497356.849556:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1777497356.849579:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798464 00000100:00100000:0.0:1777497356.849583:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798464 00000100:00100000:0.0:1777497356.849604:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798976 00000100:00100000:0.0:1777497356.849606:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798976 00000100:00100000:0.0:1777497356.849627:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1777497356.849633:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564798464:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1777497356.849637:0:25494:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1777497356.849668:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c97dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564798464:12345-0@lo:400:kworker.0 Request processed in 36us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497356.849674:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1777497356.849892:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:0.0:1777497356.849899:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564798976:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1777497356.849903:0:25494:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1777497356.849941:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564798976:12345-0@lo:400:kworker.0 Request processed in 42us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497356.849947:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:0.0:1777497356.849997:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564797952:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.850008:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564798464:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.850030:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86d85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564798976:0@lo:400:kworker.0 00000100:00080000:0.0:1777497356.850073:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497356.850077:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497356.851323:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497356.851374:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797696 00000100:00100000:3.0:1777497356.851380:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797696 00000100:00100000:3.0:1777497356.851428:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1777497356.851437:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564797696:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1777497356.851444:0:63729:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1777497356.851495:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564797696:12345-0@lo:400:kworker.0 Request processed in 59us (175us total) trans 0 rc 0/0 00000100:00080000:0.0:1777497356.851974:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497356.852984:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:3.0:1777497356.853841:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564797696:0@lo:400:kworker.0 00000100:00100000:3.0:1777497356.853854:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564798208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497356.854400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497356.854449:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564798336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497356.854476:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497356.854500:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564798848:0@lo:400:kworker.0 00000100:00100000:1.0:1777497356.854540:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497356.854583:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798336 00000100:00100000:1.0:1777497356.854590:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798336 00000100:00100000:1.0:1777497356.854626:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798848 00000100:00100000:1.0:1777497356.854629:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798848 00000100:00100000:1.0:1777497356.854660:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1777497356.854668:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564798336:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1777497356.854676:0:25487:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1777497356.854724:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564798336:12345-0@lo:400:kworker.0 Request processed in 57us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497356.854730:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1777497356.854746:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:1.0:1777497356.854751:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564798848:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1777497356.854755:0:25487:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1777497356.854780:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564798848:12345-0@lo:400:kworker.0 Request processed in 29us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497356.854802:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00080000:1.0:1777497356.854828:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497356.854851:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564798336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497356.854861:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564798848:0@lo:400:kworker.0 00000100:00100000:0.0:1777497356.855706:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797824 00000100:00100000:0.0:1777497356.855713:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797824 00000100:00100000:0.0:1777497356.855773:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1777497356.855795:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564797824:12345-0@lo:400:kworker.0 00000020:02000000:0.0:1777497356.855802:0:65418:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1777497356.855856:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564797824:12345-0@lo:400:kworker.0 Request processed in 76us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497356.855862:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00080000:1.0:1777497356.856083:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497356.856149:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564797824:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.856609:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497356.856699:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564798080:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.856734:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497356.856757:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564798592:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.856791:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497356.856808:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564799104:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.856829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497356.856874:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798080 00000100:00100000:2.0:1777497356.856880:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798080 00000100:00100000:2.0:1777497356.856927:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798592 00000100:00100000:2.0:1777497356.856930:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798592 00000100:00100000:2.0:1777497356.856946:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799104 00000100:00100000:2.0:1777497356.856948:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799104 00000100:00100000:2.0:1777497356.856961:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1777497356.856968:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564798080:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1777497356.856992:0:73210:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1777497356.857035:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564798080:12345-0@lo:400:kworker.0 Request processed in 67us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.857054:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1777497356.857083:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1777497356.857090:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564798592:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1777497356.857111:0:73210:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1777497356.857143:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564798592:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.857149:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1777497356.857159:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1777497356.857165:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564799104:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1777497356.857168:0:73210:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1777497356.857195:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564799104:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.857200:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1777497356.857229:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564798080:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.857237:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564798592:0@lo:400:kworker.0 00000100:00100000:2.0:1777497356.857246:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86d86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564799104:0@lo:400:kworker.0 00000100:00100000:3.0:1777497356.857762:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497356.857808:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564798720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497356.857840:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497356.857865:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798208 00000100:00100000:3.0:1777497356.857869:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798208 00000100:00100000:3.0:1777497356.857898:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564798720 00000100:00100000:3.0:1777497356.857900:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564798720 00000100:00100000:3.0:1777497356.857932:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3795 00000100:00100000:3.0:1777497356.857939:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564798208:12345-0@lo:400:kworker.0 00000020:02000000:3.0:1777497356.857944:0:8406:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:2.0:1777497356.857971:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1777497356.857979:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564798208:12345-0@lo:400:kworker.0 Request processed in 42us (4070us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.857979:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564798720:12345-0@lo:400:kworker.0 00000020:02000000:2.0:1777497356.857983:0:8407:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1777497356.857985:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3795 00000100:00100000:2.0:1777497356.858011:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564798720:12345-0@lo:400:kworker.0 Request processed in 34us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497356.858030:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3796 00000100:00100000:3.0:1777497356.858041:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564798208:0@lo:400:kworker.0 00000100:00100000:3.0:1777497356.858050:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564798720:0@lo:400:kworker.0 00000100:00080000:3.0:1777497356.858075:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497356.864523:0:79988:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564797568 00000100:00100000:1.0:1777497356.864542:0:79988:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564797568 00000100:00100000:1.0:1777497356.864622:0:79988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1777497356.864633:0:79988:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564797568:12345-0@lo:400:kworker.0 00000020:02000000:1.0:1777497356.864660:0:79988:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:1.0:1777497356.864771:0:79988:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564797568:12345-0@lo:400:kworker.0 Request processed in 140us (8162us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497356.864780:0:79988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1777497356.865218:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564797568:0@lo:400:kworker.0 00000100:00100000:2.0:1777497357.119225:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497357.119307:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497357.119343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497357.119381:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497357.119410:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546251648 00000100:00100000:2.0:1777497357.119421:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546251648 00000100:00100000:0.0:1777497357.119443:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546251776 00000100:00100000:0.0:1777497357.119447:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546251776 00000100:00100000:2.0:1777497357.119475:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546251520 00000100:00100000:2.0:1777497357.119478:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546251520 00000100:00100000:0.0:1777497357.119493:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2326 00000100:00100000:2.0:1777497357.119494:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 972 00000100:00100000:0.0:1777497357.119504:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546251776:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497357.119510:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546251648:12345-192.168.202.4@tcp:400:kworker.0 00000020:02000000:0.0:1777497357.119512:0:25489:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000020:02000000:2.0:1777497357.119514:0:63729:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:0.0:1777497357.119576:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546251776:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497357.119583:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2326 00000100:00100000:1.0:1777497357.119598:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1014 00000100:00100000:1.0:1777497357.119603:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546251520:12345-192.168.202.4@tcp:38:kworker.0 00000020:02000000:1.0:1777497357.119607:0:73210:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:1.0:1777497357.119629:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t90194313217 exp 0000000000000000 cur 3486 last 0 00000020:00000080:1.0:1777497357.119676:0:73210:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691bb73 00000004:00100000:1.0:1777497357.119707:0:73210:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1777497357.119849:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546251648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 339us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497357.119856:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 972 00000100:00080000:2.0:1777497357.119895:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497357.119899:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497357.120808:0:79991:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546251392 00000100:00100000:3.0:1777497357.120816:0:79991:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546251392 00000100:00100000:3.0:1777497357.120860:0:79991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00100000:3.0:1777497357.120868:0:79991:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546251392:12345-192.168.202.4@tcp:400:kworker.0 00000020:02000000:3.0:1777497357.120874:0:79991:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00100000:3.0:1777497357.121185:0:79991:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546251392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 317us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.121192:0:79991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 153 00000100:00080000:1.0:1777497357.122370:0:73210:0:(import.c:65:import_set_state_nolock()) ffff924090d1c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497357.122488:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546251520:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 2881us (3104us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497357.122507:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1014 00000100:00100000:0.0:1777497357.197049:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497357.197290:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546251904 00000100:00100000:2.0:1777497357.197300:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546251904 00000100:00100000:2.0:1777497357.197361:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1015 00000100:00100000:2.0:1777497357.197371:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546251904:12345-192.168.202.4@tcp:41:lfs.0 00000020:02000000:2.0:1777497357.197378:0:65418:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1777497357.197421:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497357.197485:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546251904:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 116us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497357.197523:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1015 00000100:00100000:2.0:1777497357.206684:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497357.219480:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252032 00000100:00100000:3.0:1777497357.219501:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252032 00000100:00100000:3.0:1777497357.219575:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1902 00000100:00100000:3.0:1777497357.219586:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546252032:12345-192.168.202.4@tcp:13:lfs.0 00000020:02000000:3.0:1777497357.219593:0:10306:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497357.219617:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497357.219683:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546252032:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 100us (13009us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.219691:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1902 00000100:00100000:1.0:1777497357.227214:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497357.227279:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252160 00000100:00100000:3.0:1777497357.227293:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252160 00000100:00100000:3.0:1777497357.227345:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5822 00000100:00100000:3.0:1777497357.227353:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:0+-99:2411:x1863837546252160:12345-192.168.202.4@tcp:8:lfs.0 00000020:02000000:3.0:1777497357.227360:0:25499:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00080000:3.0:1777497357.227394:0:25499:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3486 last 0 00000020:00000080:3.0:1777497357.227425:0:25499:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691bb7a 00002000:00100000:3.0:1777497357.227643:0:25499:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff92409c46e000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1777497357.227655:0:25499:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1777497357.227761:0:25499:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1777497357.227792:0:25499:0:(import.c:65:import_set_state_nolock()) ffff92409c468000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497357.227880:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546252160:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 525us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.227888:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5822 00000100:00100000:0.0:1777497357.247595:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497357.247697:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252288 00000100:00100000:3.0:1777497357.247876:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252288 00000100:00100000:3.0:1777497357.247943:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1903 00000100:00100000:3.0:1777497357.247954:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546252288:12345-192.168.202.4@tcp:13:lfs.0 00000020:02000000:3.0:1777497357.247977:0:25316:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497357.248003:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497357.248079:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63420:x1863837546252288:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.248087:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1903 00000001:00100000:1.0:1777497357.255454:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497357.255473:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969446 is committed 00000100:00100000:3.0:1777497357.346512:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564799232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497357.346588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497357.346644:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799232 00000100:00100000:3.0:1777497357.346652:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799232 00000100:00100000:3.0:1777497357.346719:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1777497357.346729:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564799232:12345-0@lo:13:osp-pre-0-0.0 00000020:02000000:3.0:1777497357.346736:0:8400:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497357.346754:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497357.346796:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564799232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.346803:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:3.0:1777497357.346853:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564799232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497357.347641:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497357.347655:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564799360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497357.348425:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497357.350228:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799360 00000100:00100000:3.0:1777497357.350242:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799360 00000100:00100000:3.0:1777497357.350295:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1777497357.350305:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564799360:12345-0@lo:13:osp-pre-1-0.0 00000020:02000000:3.0:1777497357.350313:0:25316:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497357.350336:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497357.350415:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564799360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497357.350422:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:3.0:1777497357.350484:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969446 gen 2 00000100:00100000:3.0:1777497357.352281:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564799360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1777497357.474477:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497357.858524:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564799488:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497357.858596:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497357.858933:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799488 00000100:00100000:1.0:1777497357.858941:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799488 00000100:00100000:1.0:1777497357.858986:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3797 00000100:00100000:1.0:1777497357.858996:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564799488:12345-0@lo:41:osp-pre-0-1.0 00000020:02000000:1.0:1777497357.859003:0:8406:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:1.0:1777497357.859033:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:1.0:1777497357.859081:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564799488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497357.859087:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3797 00000100:00100000:3.0:1777497357.859218:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564799488:0@lo:41:osp-pre-0-1.0 00000001:00080000:2.0:1777497357.862818:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969449 is committed 00000001:00100000:0.0:1777497358.372719:0:79981:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00010000:00010000:3.0:1777497358.498503:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497359.263380:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497359.263940:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252416 00000100:00100000:0.0:1777497359.263969:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252416 00000100:00100000:0.0:1777497359.264187:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1016 00000100:00100000:0.0:1777497359.264211:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+5:63510:x1863837546252416:12345-192.168.202.4@tcp:101:lfs.0 00000020:02000000:0.0:1777497359.264219:0:63729:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:0.0:1777497359.264234:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497359.264256:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bb81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c042 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777497359.266791:0:63729:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2479us 00010000:00010000:2.0:1777497359.297646:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.297669:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.297685:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497359.297743:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497359.297748:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1777497359.297784:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.298168:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bb81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c042 expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.298189:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c042 expref: 6 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.298198:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408ae86900) 00010000:00010000:2.0:1777497359.298200:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497359.298204:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5be00, rc 0) 00000100:00100000:2.0:1777497359.298279:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252416:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 34081us (34907us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497359.298308:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1016 00000100:00100000:0.0:1777497359.306237:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497359.306336:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252544 00000100:00100000:2.0:1777497359.306347:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252544 00000100:00100000:2.0:1777497359.306416:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1017 00000100:00100000:2.0:1777497359.306427:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252544:12345-192.168.202.4@tcp:41:lfs.0 00000020:02000000:2.0:1777497359.306444:0:64885:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1777497359.306483:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1777497359.306557:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252544:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 131us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497359.306564:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1017 00000100:00100000:3.0:1777497359.313480:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497359.315524:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252672 00000100:00100000:2.0:1777497359.315539:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252672 00000100:00100000:2.0:1777497359.315626:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1018 00000100:00100000:2.0:1777497359.315636:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252672:12345-192.168.202.4@tcp:41:lfs.0 00000020:02000000:2.0:1777497359.315644:0:65418:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1777497359.315687:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497359.315769:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252672:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 134us (2310us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497359.315777:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1018 00000100:00080000:3.0:1777497359.316070:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497359.322406:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497359.325986:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252800 00000100:00100000:1.0:1777497359.326002:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252800 00000100:00100000:1.0:1777497359.326120:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1906 00000100:00100000:1.0:1777497359.326135:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252800:12345-192.168.202.4@tcp:13:lfs.0 00000020:02000000:1.0:1777497359.326143:0:8400:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000100:00080000:3.0:1777497359.326148:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1777497359.326179:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497359.326255:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63510:x1863837546252800:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 125us (3862us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497359.326262:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1906 00000100:00100000:2.0:1777497359.329786:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497359.330076:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546252928 00000100:00100000:3.0:1777497359.330089:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546252928 00000100:00100000:3.0:1777497359.330463:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1907 00000100:00100000:3.0:1777497359.330476:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:63510:x1863837546252928:12345-192.168.202.4@tcp:13:lfs.0 00000020:02000000:3.0:1777497359.330486:0:25316:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00002000:00000024:3.0:1777497359.330525:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497359.330614:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:63510:x1863837546252928:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 140us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497359.330623:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1907 00000100:00100000:3.0:1777497359.359126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497359.359410:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253056 00000100:00100000:2.0:1777497359.359424:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253056 00000100:00100000:2.0:1777497359.359561:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1019 00000100:00100000:2.0:1777497359.359575:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:63035:x1863837546253056:12345-192.168.202.4@tcp:101:multiop.0 00000020:02000000:2.0:1777497359.359585:0:63728:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00010000:00010000:2.0:1777497359.359626:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497359.359655:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bb8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c049 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360009:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360027:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360039:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360055:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360062:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.360068:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.361037:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/1,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.361054:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.361066:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497359.361152:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a041:0x1:0x0]: returning size 0 00000004:00200000:2.0:1777497359.361157:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1777497359.361225:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.361240:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/1,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362390:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362401:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362408:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362416:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362422:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497359.362427:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362436:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362454:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408ae86900) 00010000:00010000:2.0:1777497359.362457:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497359.362463:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362469:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bb96 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362490:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362512:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362519:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362524:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ba00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497359.362527:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362532:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362540:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff924084d21400) 00010000:00010000:2.0:1777497359.362543:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497359.362545:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362551:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bb9d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362610:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bb8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c049 expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362628:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 3/0,0 mode: PR/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c049 expref: 7 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497359.362635:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff924084d21f00) 00010000:00010000:2.0:1777497359.362638:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497359.362647:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b200, rc 0) 00000100:00100000:2.0:1777497359.366175:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:63035:x1863837546253056:12345-192.168.202.4@tcp:101:multiop.0 Request processed in 6582us (7043us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497359.366192:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1019 00010000:00010000:1.0:1777497359.526037:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497359.908273:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564799616:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497359.908348:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497359.908597:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799616 00000100:00100000:2.0:1777497359.908606:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799616 00000100:00100000:2.0:1777497359.908661:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3798 00000100:00100000:2.0:1777497359.908670:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564799616:12345-0@lo:41:osp-pre-1-0.0 00000020:02000000:2.0:1777497359.908678:0:8407:0:(tgt_handler.c:754:tgt_request_handle()) *** cfs_fail_loc=721, val=0*** 00000004:00000024:2.0:1777497359.908708:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497359.908752:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564799616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497359.908759:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3798 00000100:00100000:0.0:1777497359.909632:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564799616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497360.554202:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497361.442594:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497361.442612:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564799744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497361.442669:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497361.442714:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799744 00000100:00100000:0.0:1777497361.442722:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799744 00000100:00100000:0.0:1777497361.442766:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1777497361.442774:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564799744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497361.442801:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497361.442844:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564799744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497361.442851:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:0.0:1777497361.442907:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86d85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564799744:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1777497361.443018:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497361.443393:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497361.443402:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564799872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497361.443430:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.443502:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564799872 00000100:00100000:2.0:1777497361.443507:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564799872 00000100:00100000:2.0:1777497361.443563:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1777497361.443571:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564799872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497361.443589:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497361.443626:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564799872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.443632:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1777497361.443663:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564799872:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1777497361.443954:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497361.570683:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497361.954497:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564800000:0@lo:400:kworker.0 00000100:00100000:3.0:1777497361.954568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497361.954791:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564800384:0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.954838:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497361.954900:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564800128:0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.954922:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497361.954942:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497361.954948:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564800256:0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.954968:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497361.954998:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800384 00000100:00100000:1.0:1777497361.955004:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800384 00000100:00100000:1.0:1777497361.955051:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800128 00000100:00100000:1.0:1777497361.955054:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800128 00000100:00100000:1.0:1777497361.955069:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800256 00000100:00100000:1.0:1777497361.955071:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800256 00000100:00100000:1.0:1777497361.955091:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1777497361.955122:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564800384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.955169:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564800384:12345-0@lo:400:kworker.0 Request processed in 49us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497361.955191:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1777497361.955208:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1777497361.955214:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564800128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.955246:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564800128:12345-0@lo:400:kworker.0 Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497361.955253:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1777497361.955264:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:1.0:1777497361.955270:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564800256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.955315:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564800256:12345-0@lo:400:kworker.0 Request processed in 45us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497361.955322:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00080000:1.0:1777497361.955351:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497361.955355:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497361.955383:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564800256:0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.955394:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564800128:0@lo:400:kworker.0 00000100:00100000:1.0:1777497361.955419:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5435c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564800384:0@lo:400:kworker.0 00000100:00100000:0.0:1777497361.955535:0:79987:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800000 00000100:00100000:0.0:1777497361.955540:0:79987:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800000 00000100:00100000:0.0:1777497361.955692:0:79987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1777497361.955700:0:79987:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564800000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.962886:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497361.962909:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564800512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.962974:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963013:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800512 00000100:00100000:2.0:1777497361.963020:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800512 00000100:00100000:2.0:1777497361.963079:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1777497361.963088:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564800512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963159:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5435c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564800512:12345-0@lo:400:kworker.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.963166:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00080000:2.0:1777497361.963187:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497361.963218:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564800512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963259:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564800640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963288:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963319:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800640 00000100:00100000:2.0:1777497361.963323:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800640 00000100:00100000:2.0:1777497361.963354:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1777497361.963360:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564800640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963396:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564800640:12345-0@lo:400:kworker.0 Request processed in 36us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.963402:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3799 00000100:00100000:2.0:1777497361.963425:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564800640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963455:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564800768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963480:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963523:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564800896:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963542:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963588:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497361.963593:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564801024:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963614:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963637:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801024 00000100:00100000:2.0:1777497361.963647:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801024 00000100:00100000:2.0:1777497361.963670:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1777497361.963675:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564801024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963709:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564801024:12345-0@lo:400:kworker.0 Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.963715:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1777497361.963741:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564801024:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963772:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963794:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.963821:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801152 00000100:00100000:2.0:1777497361.963825:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801152 00000100:00100000:2.0:1777497361.963847:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1777497361.963853:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963902:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801152:12345-0@lo:400:kworker.0 Request processed in 49us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.963909:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3800 00000100:00100000:2.0:1777497361.963930:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963959:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564801280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.963980:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.964019:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b6419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564801408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964038:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.964071:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497361.964076:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564801536:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964120:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497361.964142:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801536 00000100:00100000:2.0:1777497361.964151:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801536 00000100:00100000:2.0:1777497361.964175:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1777497361.964181:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564801536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964214:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564801536:12345-0@lo:400:kworker.0 Request processed in 34us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.964220:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1777497361.964246:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564801536:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964294:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800768 00000100:00100000:2.0:1777497361.964298:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800768 00000100:00100000:2.0:1777497361.964319:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564800896 00000100:00100000:2.0:1777497361.964322:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564800896 00000100:00100000:2.0:1777497361.964336:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801280 00000100:00100000:2.0:1777497361.964339:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801280 00000100:00100000:2.0:1777497361.964361:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801408 00000100:00100000:2.0:1777497361.964364:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801408 00000100:00100000:2.0:1777497361.964384:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1777497361.964390:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564800768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964424:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564800768:12345-0@lo:400:kworker.0 Request processed in 34us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.964430:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1777497361.964441:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1777497361.964447:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564800896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964476:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564800896:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.964481:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:2.0:1777497361.964491:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1777497361.964496:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b641b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564801280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964533:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b641b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564801280:12345-0@lo:400:kworker.0 Request processed in 36us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.964538:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:2.0:1777497361.964549:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:2.0:1777497361.964554:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b6418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564801408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964578:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b6418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564801408:12345-0@lo:400:kworker.0 Request processed in 24us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497361.964584:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00080000:2.0:1777497361.964600:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497361.964603:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497361.964619:0:3658:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1777497361.964633:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564801280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964643:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564800768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964666:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b6419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564801408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497361.964675:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564800896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497361.964923:0:79987:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564800000:12345-0@lo:400:kworker.0 Request processed in 9223us (10353us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497361.964931:0:79987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1777497361.965142:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564800000:0@lo:400:kworker.0 00000100:00100000:0.0:1777497362.238069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497362.238140:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497362.238208:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497362.238245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497362.238272:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497362.238298:0:79991:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253184 00000100:00100000:0.0:1777497362.238307:0:79991:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253184 00000100:00100000:0.0:1777497362.238352:0:79991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:0.0:1777497362.238361:0:79991:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546253184:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497362.238443:0:79991:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546253184:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497362.238450:0:79991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 155 00000100:00100000:0.0:1777497362.238495:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253568 00000100:00100000:0.0:1777497362.238499:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253568 00000100:00100000:0.0:1777497362.238533:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253696 00000100:00100000:0.0:1777497362.238551:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253696 00000100:00100000:0.0:1777497362.238575:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2331 00000100:00100000:0.0:1777497362.238582:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546253568:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497362.238610:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546253568:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497362.238617:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2331 00000100:00100000:0.0:1777497362.238628:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2332 00000100:00100000:0.0:1777497362.238644:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546253696:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497362.238670:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546253696:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497362.238676:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2332 00000100:00080000:0.0:1777497362.239089:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497362.239152:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253312 00000100:00100000:0.0:1777497362.239157:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253312 00000100:00100000:0.0:1777497362.239186:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253440 00000100:00100000:0.0:1777497362.239188:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253440 00000100:00100000:0.0:1777497362.239215:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 979 00000100:00100000:0.0:1777497362.239222:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546253312:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497362.239257:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546253312:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (1198us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497362.239264:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 979 00000100:00100000:0.0:1777497362.239276:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 980 00000100:00100000:0.0:1777497362.239282:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546253440:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497362.239306:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546253440:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497362.239312:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 980 00000100:00080000:0.0:1777497362.239350:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497362.468256:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497362.468329:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497362.468367:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497362.468374:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497362.468397:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497362.468437:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801664 00000100:00100000:3.0:1777497362.468445:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801664 00000100:00100000:3.0:1777497362.468792:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801792 00000100:00100000:3.0:1777497362.468797:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801792 00000100:00100000:3.0:1777497362.468931:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1777497362.468941:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497362.468967:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497362.469026:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497362.469033:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:3.0:1777497362.469048:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:3.0:1777497362.469054:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497362.469064:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497362.469090:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564801792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497362.469748:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:3.0:1777497362.469824:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497362.469864:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564801664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1777497362.596710:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497362.981568:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497362.981591:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564801920:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497362.981654:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497362.981716:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564801920 00000100:00100000:3.0:1777497362.981723:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564801920 00000100:00100000:3.0:1777497362.981770:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1777497362.981780:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564801920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497362.981818:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1777497362.981877:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564801920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497362.981884:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3801 00000100:00100000:3.0:1777497362.982075:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564801920:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497363.003007:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497363.004443:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546253952 00000100:00100000:3.0:1777497363.004454:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546253952 00000100:00100000:3.0:1777497363.004526:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1020 00000100:00100000:3.0:1777497363.004536:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:63638:x1863837546253952:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1777497363.004590:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777497363.004621:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691bba4 lrc: 0/0,0 mode: --/PR res: [0x20000a041:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c049 expref: 7 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.004640:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff924084d21f00) 00010000:00010000:3.0:1777497363.004669:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691bb88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c042 expref: 6 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497363.006381:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777497363.007435:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408ae86900) 00010000:00010000:3.0:1777497363.007448:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497363.007594:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007609:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007621:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007634:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007663:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007669:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007750:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,1 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007758:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.007764:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1777497363.012193:0:64885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x58:0x0].2, 64 off8320 00000004:00080000:2.0:1777497363.012209:0:64885:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3492353113627ns, next at 3493353111314ns, rc = 0 00010000:00010000:2.0:1777497363.012282:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 3/0,1 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012300:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012311:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 3/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012320:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012325:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 4/0,1 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012341:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012373:0:64885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497363.012418:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,1 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012423:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 2/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012429:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012435:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5aa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497363.012439:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 3/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012445:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 4/0,0 mode: EX/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012458:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff923f83b83200) 00010000:00010000:2.0:1777497363.012461:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1777497363.012466:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 2/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012471:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5aa00/0x3e357265691bbb9 lrc: 0/0,0 mode: --/EX res: [0x20000a041:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012491:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012497:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012509:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012514:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012518:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ac00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497363.012521:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012526:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012534:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f83b83d00) 00010000:00010000:2.0:1777497363.012536:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497363.012539:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012544:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691bbab lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497363.012560:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a835d0fa reply state 0000000019e4c0f7 transno 94489280513 ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012571:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497363.012578:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff923f83b83000) 00010000:00010000:2.0:1777497363.012581:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497363.012585:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497363.012679:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:63638:x1863837546253952:12345-192.168.202.4@tcp:36:rm.0 Request processed in 8140us (9678us total) trans 94489280513 rc 0/0 00000100:00100000:2.0:1777497363.012694:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1020 00010000:00010000:3.0:1777497363.015186:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497363.015200:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.015225:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497363.015229:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 2/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.015237:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 3/0,0 mode: PW/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.015253:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a041:0x1:0x0].0x0 (ffff923f83b83200) 00010000:00010000:3.0:1777497363.015255:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777497363.015259:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 1/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.015264:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a000/0x3e357265691bbc0 lrc: 0/0,0 mode: --/PW res: [0x20000a041:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497363.015290:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497363.015292:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497363.015294:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497363.620382:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497364.642438:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497365.026828:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564802048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497365.026950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497365.027392:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802048 00000100:00100000:2.0:1777497365.027401:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802048 00000100:00100000:2.0:1777497365.027483:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3802 00000100:00100000:2.0:1777497365.027492:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564802048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497365.027552:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497365.027666:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564802048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 166us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497365.027674:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3802 00000100:00100000:3.0:1777497365.030749:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564802048:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497365.674599:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497366.562451:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564802176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497366.562511:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497366.563929:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802176 00000100:00100000:0.0:1777497366.563939:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802176 00000100:00100000:0.0:1777497366.563997:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1777497366.564007:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564802176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497366.564050:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497366.564130:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564802176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497366.564135:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1777497366.564177:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564802176:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1777497366.564283:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497366.564380:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564802304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497366.564407:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497366.564465:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802304 00000100:00100000:1.0:1777497366.564468:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802304 00000100:00100000:1.0:1777497366.564500:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1777497366.564505:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564802304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497366.564518:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497366.564544:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564802304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497366.564548:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:1.0:1777497366.564576:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564802304:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1777497366.564620:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777497366.690481:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497367.076763:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564802816:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.076844:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.076888:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564803328:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.076926:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.076947:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564803840:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.076967:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.076991:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497367.076997:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564802688:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077019:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.077034:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564803200:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077058:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.077073:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564803712:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077119:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.077152:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803328 00000100:00100000:1.0:1777497367.077159:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803328 00000100:00100000:1.0:1777497367.077200:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803840 00000100:00100000:1.0:1777497367.077202:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803840 00000100:00100000:1.0:1777497367.077225:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803200 00000100:00100000:1.0:1777497367.077227:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803200 00000100:00100000:1.0:1777497367.077241:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803712 00000100:00100000:1.0:1777497367.077244:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803712 00000100:00100000:1.0:1777497367.077264:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1777497367.077273:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077326:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564803328:12345-0@lo:400:kworker.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.077332:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:1.0:1777497367.077362:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:1.0:1777497367.077368:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564803840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077395:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564803840:12345-0@lo:400:kworker.0 Request processed in 28us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.077400:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:1.0:1777497367.077411:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:1.0:1777497367.077431:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564803200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077457:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564803200:12345-0@lo:400:kworker.0 Request processed in 40us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.077463:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:1.0:1777497367.077474:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:1.0:1777497367.077480:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564803712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077503:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564803712:12345-0@lo:400:kworker.0 Request processed in 24us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.077509:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:1.0:1777497367.077558:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564803200:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077568:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564803712:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077577:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564803328:0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.077585:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564803840:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078174:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564802432:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078214:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078250:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564802944:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078271:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078290:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564803456:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078310:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078325:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564803968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078343:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078360:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777497367.078366:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564802560:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078384:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078399:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b6419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564803072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078435:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078450:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564803584:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078468:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497367.078495:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802816 00000100:00100000:0.0:1777497367.078501:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802816 00000100:00100000:0.0:1777497367.078526:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802688 00000100:00100000:0.0:1777497367.078529:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802688 00000100:00100000:0.0:1777497367.078539:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802944 00000100:00100000:0.0:1777497367.078550:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802944 00000100:00100000:0.0:1777497367.078563:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803456 00000100:00100000:0.0:1777497367.078565:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803456 00000100:00100000:0.0:1777497367.078574:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803968 00000100:00100000:0.0:1777497367.078576:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803968 00000100:00100000:0.0:1777497367.078586:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802560 00000100:00100000:0.0:1777497367.078587:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802560 00000100:00100000:0.0:1777497367.078600:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1777497367.078606:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564802816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078645:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564802816:12345-0@lo:400:kworker.0 Request processed in 39us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.078651:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1777497367.078664:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1777497367.078669:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564802688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078692:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564802688:12345-0@lo:400:kworker.0 Request processed in 24us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.078697:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1777497367.078706:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1777497367.078711:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564802944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.078739:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564802944:12345-0@lo:400:kworker.0 Request processed in 28us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.078745:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1777497367.078870:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1777497367.078876:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564803456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.079037:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1777497367.079047:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564803968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497367.079144:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803072 00000100:00100000:3.0:1777497367.079149:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803072 00000100:00100000:3.0:1777497367.079178:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564803584 00000100:00100000:3.0:1777497367.079181:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564803584 00000100:00100000:3.0:1777497367.079202:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3803 00000100:00100000:3.0:1777497367.079208:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564803072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497367.079311:0:79988:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564802432 00000100:00100000:1.0:1777497367.079315:0:79988:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564802432 00000100:00100000:1.0:1777497367.079344:0:79988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1777497367.079351:0:79988:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564802432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094136:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564803968:12345-0@lo:400:kworker.0 Request processed in 15081us (15780us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497367.094150:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1777497367.094191:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1777497367.094204:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564802560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094254:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564802560:12345-0@lo:400:kworker.0 Request processed in 56us (15868us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497367.094260:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1777497367.094313:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3804 00000100:00100000:2.0:1777497367.094322:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564803584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094356:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564803584:12345-0@lo:400:kworker.0 Request processed in 36us (15887us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497367.094363:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3804 00000100:00080000:2.0:1777497367.094429:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497367.094435:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497367.094439:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497367.094442:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497367.094602:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564802560:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094615:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c789880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564803584:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094626:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564802944:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094637:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564803456:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094646:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564803968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094698:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5437800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564802688:0@lo:400:kworker.0 00000100:00100000:2.0:1777497367.094709:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564802816:0@lo:400:kworker.0 00000100:00100000:3.0:1777497367.095776:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564803072:12345-0@lo:400:kworker.0 Request processed in 16563us (17335us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497367.095786:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3803 00000100:00100000:2.0:1777497367.095938:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b6419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564803072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.098852:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564803456:12345-0@lo:400:kworker.0 Request processed in 19950us (20515us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.098867:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1777497367.100349:0:79988:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564802432:12345-0@lo:400:kworker.0 Request processed in 20992us (22127us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.100374:0:79988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1777497367.105867:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564802432:0@lo:400:kworker.0 00000100:00100000:0.0:1777497367.373252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497367.373300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497367.373352:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497367.373385:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497367.373411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497367.373447:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254592 00000100:00100000:0.0:1777497367.373457:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254592 00000100:00100000:0.0:1777497367.373516:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254464 00000100:00100000:0.0:1777497367.373520:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254464 00000100:00100000:0.0:1777497367.373544:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2337 00000100:00100000:0.0:1777497367.373565:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546254592:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497367.373636:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546254592:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.373643:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2337 00000100:00100000:0.0:1777497367.373659:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2338 00000100:00100000:0.0:1777497367.373665:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546254464:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497367.373688:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546254464:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497367.373694:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2338 00000100:00100000:3.0:1777497367.374245:0:79991:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254080 00000100:00100000:3.0:1777497367.374251:0:79991:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254080 00000100:00100000:3.0:1777497367.374292:0:79991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:3.0:1777497367.374298:0:79991:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546254080:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497367.374340:0:79991:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546254080:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497367.374346:0:79991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 157 00000100:00100000:2.0:1777497367.374496:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254336 00000100:00100000:2.0:1777497367.374501:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254336 00000100:00100000:2.0:1777497367.374581:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254208 00000100:00100000:2.0:1777497367.374585:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254208 00000100:00100000:2.0:1777497367.374633:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 987 00000100:00100000:2.0:1777497367.374641:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546254336:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497367.374679:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546254336:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497367.374686:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 987 00000100:00100000:2.0:1777497367.374704:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 988 00000100:00100000:2.0:1777497367.374726:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546254208:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497367.374770:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546254208:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 46us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497367.374777:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 988 00000100:00080000:2.0:1777497367.374803:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497367.374807:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497367.374822:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497367.374825:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497367.589907:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497367.589929:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497367.589987:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497367.590046:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804096 00000100:00100000:3.0:1777497367.590053:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804096 00000100:00100000:3.0:1777497367.590117:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1777497367.590127:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564804096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497367.590150:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497367.590194:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564804096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497367.590200:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1777497367.590329:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804096:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1777497367.590607:0:79999:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3496931511051ns, next at 3497931508492ns, rc = 0 00000100:00100000:0.0:1777497367.590626:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497367.590634:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564804224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497367.590663:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497367.590890:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804224 00000100:00100000:1.0:1777497367.590905:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804224 00000100:00100000:1.0:1777497367.590940:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:1.0:1777497367.590947:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564804224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497367.590960:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497367.591003:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564804224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497367.591009:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1777497367.591371:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564804224:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777497367.714333:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497368.098318:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564804352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497368.098429:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497368.098527:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804352 00000100:00100000:3.0:1777497368.098535:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804352 00000100:00100000:3.0:1777497368.098589:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3805 00000100:00100000:3.0:1777497368.098598:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564804352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497368.098630:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1777497368.098671:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564804352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497368.098677:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3805 00000100:00100000:0.0:1777497368.098759:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564804352:0@lo:41:osp-pre-0-1.0 00000004:00080000:1.0:1777497368.614393:0:79981:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1777497368.614997:0:79981:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280513 is committed 00000004:00080000:1.0:1777497368.615004:0:79981:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1777497368.615145:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615180:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615194:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615200:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497368.615205:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615212:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615228:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8d5cb397 (ffff923f83b83000) 00010000:00010000:2.0:1777497368.615231:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497368.615235:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.615241:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b400/0x3e357265691bbb2 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x8d5cb397 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497368.620132:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804480:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1777497368.620218:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497368.620602:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804480 00000100:00100000:0.0:1777497368.620609:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804480 00000100:00100000:0.0:1777497368.620703:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5823 00000100:00100000:0.0:1777497368.620713:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564804480:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777497368.620744:0:25488:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:642 count 1 00010000:00010000:0.0:1777497368.620779:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.620810:0:25488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 5 pid: 25491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.620819:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497368.620821:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497368.620824:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.620853:0:25488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 5 pid: 25491 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.620865:0:25488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 5 pid: 25491 timeout: 3597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497368.620876:0:25488:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25488:1863837564804608:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497368.620944:0:25488:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d44cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497368.638208:0:25488:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:25488:1863837564804608:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497368.638241:0:25488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497368.638496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497368.640026:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254720 00000100:00100000:0.0:1777497368.640039:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254720 00010000:00010000:0.0:1777497368.640079:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 6 pid: 25491 timeout: 3597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497368.640149:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2531 00000100:00100000:0.0:1777497368.640159:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546254720:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497368.640174:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497368.640180:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 6 pid: 25491 timeout: 3597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.640193:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 6 pid: 25491 timeout: 3597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.640217:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b801a35/0x3e357265691b767 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x282:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c01f expref: 6 pid: 25491 timeout: 3597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.640234:0:25500:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497368.640236:0:25500:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497368.640241:0:25500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.640270:0:25500:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.640309:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497368.640371:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546254720:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 213us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497368.640379:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2531 00010000:00010000:2.0:1777497368.640948:0:25488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.640960:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.640969:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.640976:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497368.641005:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777497368.641241:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564804480:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20529us (21021us total) trans 4294969450 rc 0/0 00000100:00100000:2.0:1777497368.641250:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5823 00000004:00080000:2.0:1777497368.641303:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff923f861df100/2, rc 0, transno 4294969450 00000100:00100000:2.0:1777497368.641309:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804480:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1777497368.641540:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497368.641548:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.641557:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497368.641562:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.641570:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.641585:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.641592:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691bbc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x282:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497368.641610:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497368.641623:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497368.641625:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497368.738364:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497369.762458:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497370.148310:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497370.148337:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497370.148560:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497370.148671:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804736 00000100:00100000:3.0:1777497370.148867:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804736 00000100:00100000:3.0:1777497370.148938:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1777497370.148946:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564804736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497370.148980:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497370.149040:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564804736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497370.149047:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3806 00000100:00100000:3.0:1777497370.149141:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564804736:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497370.789802:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497370.810606:0:80694:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130a: DoM file create (setstripe) replay ========================================================== 17:16:08 (1777497368) 00000001:00080000:2.0:1777497371.613079:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969450 is committed 00000100:00100000:3.0:1777497371.682369:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564804864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497371.682441:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497371.682549:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804864 00000100:00100000:2.0:1777497371.682557:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804864 00000100:00100000:2.0:1777497371.682617:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1777497371.682627:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564804864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497371.682654:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497371.684293:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564804864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1660us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497371.684304:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00080000:2.0:1777497371.684339:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497371.687425:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564804992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497371.687505:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497371.689584:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564804864:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497371.690982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497371.691323:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254848 00000100:00100000:3.0:1777497371.691332:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254848 00000100:00100000:3.0:1777497371.691394:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1021 00000100:00100000:3.0:1777497371.691404:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64225:x1863837546254848:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497371.691425:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497371.691449:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bbce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c050 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691520:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691535:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691550:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497371.691615:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497371.691619:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1777497371.691642:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691668:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bbce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c050 expref: 7 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691684:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c050 expref: 6 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.691693:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2900) 00010000:00010000:3.0:1777497371.691696:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497371.691700:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee600, rc 0) 00000100:00100000:3.0:1777497371.691778:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64225:x1863837546254848:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 367us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497371.691785:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1021 00000100:00080000:3.0:1777497371.691813:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497371.695252:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564804992 00000100:00100000:2.0:1777497371.695268:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564804992 00000100:00100000:2.0:1777497371.695383:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1777497371.695393:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564804992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497371.695427:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497371.695511:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564804992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497371.695517:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:2.0:1777497371.695576:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564804992:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1777497371.699820:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497371.706831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497371.707001:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546254976 00000100:00100000:2.0:1777497371.707012:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546254976 00000100:00100000:2.0:1777497371.707074:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1022 00000100:00100000:2.0:1777497371.707083:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64225:x1863837546254976:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497371.707163:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1777497371.707228:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64225:x1863837546254976:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 146us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497371.707235:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1022 00000100:00100000:3.0:1777497371.711814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497371.714875:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255104 00000100:00100000:1.0:1777497371.714890:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255104 00000100:00100000:1.0:1777497371.715388:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1023 00000100:00100000:1.0:1777497371.715395:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64225:x1863837546255104:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:1.0:1777497371.715429:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497371.715495:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64225:x1863837546255104:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 100us (3778us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497371.715503:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1023 00000100:00080000:3.0:1777497371.719430:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497371.721879:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497371.721978:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255232 00000100:00100000:3.0:1777497371.721987:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255232 00000100:00100000:3.0:1777497371.722086:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1918 00000100:00100000:3.0:1777497371.722117:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64225:x1863837546255232:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497371.722279:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497371.722358:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64225:x1863837546255232:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 262us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497371.722366:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1918 00000100:00080000:2.0:1777497371.723702:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497371.724689:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497371.724938:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255360 00000100:00100000:3.0:1777497371.724947:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255360 00000100:00100000:3.0:1777497371.725009:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1919 00000100:00100000:3.0:1777497371.725019:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64225:x1863837546255360:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497371.725041:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497371.725122:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64225:x1863837546255360:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 104us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497371.725137:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1919 00000100:00080000:2.0:1777497371.725354:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497371.782470:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497371.782529:0:63737:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255488 00000100:00100000:2.0:1777497371.782538:0:63737:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255488 00000100:00100000:2.0:1777497371.782591:0:63737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1777497371.782598:0:63737:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64232:x1863837546255488:12345-192.168.202.4@tcp:700:mcreate.0 00000100:00100000:2.0:1777497371.782682:0:63737:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64232:x1863837546255488:12345-192.168.202.4@tcp:700:mcreate.0 Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497371.782690:0:63737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:3.0:1777497371.785572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497371.785679:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255744 00000100:00100000:2.0:1777497371.785689:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255744 00000100:00100000:2.0:1777497371.785754:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1024 00000100:00100000:2.0:1777497371.785765:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64232:x1863837546255744:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:2.0:1777497371.785832:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497371.785860:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691bbd5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c050 expref: 6 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.785879:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2900) 00010000:00010000:2.0:1777497371.785889:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497371.785953:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.785967:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.785977:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.785989:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.785995:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786015:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786598:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786607:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786614:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786619:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497371.786623:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786629:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786637:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f83b83a00) 00010000:00010000:2.0:1777497371.786640:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497371.786643:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786648:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbdc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497371.786663:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000406613dc reply state 000000004db718c4 transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786672:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.786686:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f83b83300) 00010000:00010000:2.0:1777497371.786688:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497371.786691:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497371.786838:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:64232:x1863837546255744:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 1075us (1273us total) trans 94489280514 rc 0/0 00000100:00100000:2.0:1777497371.786845:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1024 00010000:00010000:0.0:1777497371.810897:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497371.829576:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497371.829956:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255872 00000100:00100000:2.0:1777497371.829967:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255872 00000100:00100000:2.0:1777497371.830029:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1025 00000100:00100000:2.0:1777497371.830036:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:64235:x1863837546255872:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497371.830057:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497371.830075:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c057 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830156:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830170:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830181:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497371.830223:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497371.830226:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:2.0:1777497371.830242:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830260:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a200/0x3e357265691bbea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c057 expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830281:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c057 expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497371.830287:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f83b83a00) 00010000:00010000:2.0:1777497371.830289:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497371.830291:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a400, rc 0) 00000100:00100000:2.0:1777497371.830339:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64235:x1863837546255872:12345-192.168.202.4@tcp:101:rm.0 Request processed in 305us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497371.830343:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1025 00000100:00100000:1.0:1777497371.833305:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497371.833355:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256000 00000100:00100000:0.0:1777497371.833363:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256000 00000100:00100000:0.0:1777497371.833406:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1026 00000100:00100000:0.0:1777497371.833412:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64235:x1863837546256000:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1777497371.833430:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497371.833445:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bbf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c05e expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833495:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833504:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833511:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833520:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833524:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833537:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833600:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833605:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833609:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497371.833639:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x1:0x0]: returning size 0 00000004:00200000:0.0:1777497371.833641:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:0.0:1777497371.833660:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833671:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833679:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833684:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833690:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833697:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833712:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497371.833717:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833723:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833817:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f83b83a00) 00010000:00010000:0.0:1777497371.833821:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497371.833827:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833833:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691bbff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833845:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833851:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833857:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833860:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497371.833862:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833866:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833878:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f83b83300) 00010000:00010000:0.0:1777497371.833880:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497371.833882:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833886:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc06 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833903:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bbf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c05e expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833910:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c05e expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.833914:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff924083c2b700) 00010000:00010000:0.0:1777497371.833916:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497371.833917:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8800, rc 0) 00000100:00100000:0.0:1777497371.833967:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:64235:x1863837546256000:12345-192.168.202.4@tcp:101:rm.0 Request processed in 555us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497371.833973:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1026 00000100:00100000:2.0:1777497371.836845:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497371.836943:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256256 00000100:00100000:0.0:1777497371.836952:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256256 00000100:00100000:0.0:1777497371.837065:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1027 00000100:00100000:0.0:1777497371.837073:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:64235:x1863837546256256:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:0.0:1777497371.837155:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777497371.837180:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691bc0d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c05e expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837211:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff924083c2b700) 00010000:00010000:0.0:1777497371.837226:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691bbf1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c057 expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837232:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f83b83a00) 00010000:00010000:0.0:1777497371.837236:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497371.837255:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837264:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837270:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837276:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837281:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837284:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837343:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837348:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837359:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837513:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837520:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837524:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837529:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837533:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837537:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837550:0:63729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497371.837562:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837565:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837569:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837572:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497371.837580:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837584:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837590:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:0.0:1777497371.837592:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777497371.837594:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837598:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691bc22 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837609:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837612:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837615:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837619:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837621:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497371.837623:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837626:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837635:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b400) 00010000:00010000:0.0:1777497371.837637:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497371.837638:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837642:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691bc14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497371.837651:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b976092a reply state 0000000012c6f813 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837660:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497371.837666:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f83b83300) 00010000:00010000:0.0:1777497371.837668:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497371.837670:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497371.837884:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5437800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:64235:x1863837546256256:12345-192.168.202.4@tcp:36:rm.0 Request processed in 810us (1047us total) trans 94489280515 rc 0/0 00000100:00100000:0.0:1777497371.837889:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1027 00010000:00010000:3.0:1777497371.837938:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497371.837943:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.837947:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497371.837949:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.837953:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.837959:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:3.0:1777497371.837960:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777497371.837962:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.837965:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691bc29 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497371.837980:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497371.837981:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497371.837982:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497372.194441:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564805248:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.194489:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564805504:0@lo:400:kworker.0 00000100:00100000:1.0:1777497372.194512:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497372.194573:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564805376:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.195187:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564805120:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.195946:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497372.195960:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564805760:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.195979:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564806016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196022:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497372.196039:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805248 00000100:00100000:1.0:1777497372.196047:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805248 00000100:00100000:0.0:1777497372.196237:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805504 00000100:00100000:0.0:1777497372.196242:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805504 00000100:00100000:1.0:1777497372.196248:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1777497372.196261:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564805248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196277:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1777497372.196285:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564805504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497372.196314:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564805248:12345-0@lo:400:kworker.0 Request processed in 57us (1802us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.196321:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1777497372.196342:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564805504:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497372.196350:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1777497372.196375:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806016 00000100:00100000:0.0:1777497372.196379:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806016 00000100:00100000:0.0:1777497372.196410:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1777497372.196417:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564806016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196450:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564806016:12345-0@lo:400:kworker.0 Request processed in 34us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497372.196456:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3807 00000100:00100000:0.0:1777497372.196498:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564805504:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196508:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564806016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196538:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497372.196573:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564806272:0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.196596:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497372.196621:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564805248:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.196889:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497372.196928:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806272 00000100:00100000:0.0:1777497372.196932:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806272 00000100:00100000:1.0:1777497372.196987:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805760 00000100:00100000:1.0:1777497372.196991:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805760 00000100:00100000:1.0:1777497372.197019:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3808 00000100:00100000:1.0:1777497372.197025:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564805760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497372.197079:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564805760:12345-0@lo:400:kworker.0 Request processed in 54us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.197086:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3808 00000100:00100000:2.0:1777497372.197267:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497372.197329:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805376 00000100:00100000:1.0:1777497372.197334:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805376 00000100:00100000:1.0:1777497372.197361:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1777497372.197367:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564805376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497372.197398:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564805376:12345-0@lo:400:kworker.0 Request processed in 31us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.197404:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1777497372.197590:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564805632:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.197620:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497372.197636:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564806144:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.197666:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497372.197711:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497372.197715:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497372.197717:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497372.197744:0:79987:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805120 00000100:00100000:3.0:1777497372.197747:0:79987:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805120 00000100:00100000:3.0:1777497372.197781:0:79987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1777497372.197788:0:79987:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c01a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564805120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.197821:0:79987:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c01a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564805120:12345-0@lo:400:kworker.0 Request processed in 34us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.197826:0:79987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1777497372.197862:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564805120:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.197896:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805632 00000100:00100000:3.0:1777497372.197899:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805632 00000100:00100000:3.0:1777497372.197925:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:3.0:1777497372.197930:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564805632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.197962:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564805632:12345-0@lo:400:kworker.0 Request processed in 31us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.197977:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:3.0:1777497372.197992:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497372.198009:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564805632:0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.198036:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806144 00000100:00100000:3.0:1777497372.198039:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806144 00000100:00100000:0.0:1777497372.198505:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:0.0:1777497372.198516:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564806272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497372.198554:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564806272:12345-0@lo:400:kworker.0 Request processed in 42us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497372.198559:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1777497372.198670:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:3.0:1777497372.198678:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564806144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.198890:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564806144:12345-0@lo:400:kworker.0 Request processed in 39us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.198899:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00080000:3.0:1777497372.198919:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497372.198939:0:3659:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 2 00000004:00080000:3.0:1777497372.198945:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff923f861df100, transno 4294969450 00000100:00100000:3.0:1777497372.198965:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564806144:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.199539:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564805376:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.199549:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564805888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.199587:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497372.199609:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564806400:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.199629:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497372.199898:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564805888 00000100:00100000:3.0:1777497372.199903:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564805888 00000100:00100000:3.0:1777497372.199940:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806400 00000100:00100000:3.0:1777497372.199943:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806400 00000100:00100000:3.0:1777497372.199963:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1777497372.199970:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564805888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.200009:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564805888:12345-0@lo:400:kworker.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.200016:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:3.0:1777497372.200031:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:3.0:1777497372.200036:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564806400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497372.200077:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564806400:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.200112:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1777497372.200352:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564805888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.200362:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564806400:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.200559:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564805760:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.200572:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564806272:0@lo:400:kworker.0 00000100:00100000:2.0:1777497372.478519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497372.478569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497372.478602:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497372.478621:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497372.478644:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497372.478737:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256640 00000100:00100000:1.0:1777497372.478747:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256640 00000100:00100000:1.0:1777497372.479016:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256512 00000100:00100000:1.0:1777497372.479020:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256512 00000100:00100000:1.0:1777497372.479045:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 995 00000100:00100000:1.0:1777497372.479054:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546256640:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497372.479433:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546256640:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 380us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.479441:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 995 00000100:00100000:1.0:1777497372.479458:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 996 00000100:00100000:1.0:1777497372.479464:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2414:x1863837546256512:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497372.479492:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2414:x1863837546256512:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.479498:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 996 00000100:00100000:1.0:1777497372.479532:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256896 00000100:00100000:1.0:1777497372.479536:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256896 00000100:00100000:1.0:1777497372.479559:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256768 00000100:00100000:1.0:1777497372.479562:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256768 00000100:00100000:1.0:1777497372.479579:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2341 00000100:00100000:1.0:1777497372.479585:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546256896:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497372.479610:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546256896:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.479616:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2341 00000100:00100000:1.0:1777497372.479629:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2342 00000100:00100000:1.0:1777497372.479634:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546256768:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497372.479659:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546256768:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497372.479665:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2342 00000100:00100000:3.0:1777497372.479966:0:79991:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256384 00000100:00100000:3.0:1777497372.479971:0:79991:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256384 00000100:00100000:3.0:1777497372.480011:0:79991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:3.0:1777497372.480018:0:79991:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546256384:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497372.480049:0:79991:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c01b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546256384:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497372.480055:0:79991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:2.0:1777497372.707513:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497372.707536:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564806528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497372.707603:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497372.707658:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806528 00000100:00100000:2.0:1777497372.707666:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806528 00000100:00100000:2.0:1777497372.707727:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1777497372.707736:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564806528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497372.707768:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497372.707811:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564806528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497372.707818:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1777497372.707868:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564806528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497372.710800:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564806656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497372.710871:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497372.711341:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806656 00000100:00100000:0.0:1777497372.711348:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806656 00000100:00100000:0.0:1777497372.711404:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1777497372.711412:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564806656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497372.711436:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497372.711481:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564806656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497372.711488:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1777497372.711564:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564806656:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777497372.834440:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497373.218466:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497373.218492:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564806784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497373.218565:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497373.220041:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806784 00000100:00100000:1.0:1777497373.220055:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806784 00000100:00100000:1.0:1777497373.220466:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3809 00000100:00100000:1.0:1777497373.220479:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564806784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497373.220522:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:1.0:1777497373.220538:0:8407:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a2e1c380 x1863837564806784/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:129/0 lens 224/368 e 0 to 0 dl 1777497384 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497373.220618:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564806784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 143us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497373.220624:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3809 00000100:00100000:2.0:1777497373.220739:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564806784:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1777497373.858476:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497374.885876:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497375.270361:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497375.270384:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564806912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497375.270467:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497375.270517:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564806912 00000100:00100000:0.0:1777497375.270527:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564806912 00000100:00100000:0.0:1777497375.270579:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1777497375.270588:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564806912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497375.270621:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497375.270676:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564806912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497375.270683:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3810 00000100:00100000:0.0:1777497375.270733:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564806912:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497375.910999:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497376.802375:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564807040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497376.802450:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497376.802516:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807040 00000100:00100000:2.0:1777497376.802524:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807040 00000100:00100000:2.0:1777497376.802574:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1777497376.802583:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564807040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497376.802611:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497376.802993:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564807040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 410us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497376.803009:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00080000:2.0:1777497376.803034:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497376.803243:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564807040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497376.803523:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564807168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497376.803572:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497376.804494:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807168 00000100:00100000:3.0:1777497376.804502:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807168 00000100:00080000:2.0:1777497376.804531:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497376.804574:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:2.0:1777497376.804584:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564807168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497376.804609:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497376.804674:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564807168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1101us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497376.804687:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000100:00100000:3.0:1777497376.804713:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564807168:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497376.930576:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497377.322653:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497377.322676:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564807296:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.322752:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.322804:0:79987:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807296 00000100:00100000:1.0:1777497377.322812:0:79987:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807296 00000100:00100000:1.0:1777497377.322853:0:79987:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1777497377.322861:0:79987:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564807296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.322911:0:79987:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564807296:12345-0@lo:400:kworker.0 Request processed in 50us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.322917:0:79987:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1777497377.323165:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564807296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497377.323239:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564807424:0@lo:400:kworker.0 00000100:00100000:3.0:1777497377.323273:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497377.324115:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807424 00000100:00100000:2.0:1777497377.324122:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807424 00000100:00100000:2.0:1777497377.324168:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1777497377.324177:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564807424:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497377.324195:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086ea1180 x1863837564807424/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.330036:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564807552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330124:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.330196:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807552 00000100:00100000:1.0:1777497377.330204:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807552 00000100:00100000:1.0:1777497377.330251:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1777497377.330260:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564807552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330317:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564807552:12345-0@lo:400:kworker.0 Request processed in 59us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.330324:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:1.0:1777497377.330372:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564807552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330434:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564807680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330455:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.330482:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807680 00000100:00100000:1.0:1777497377.330486:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807680 00000100:00100000:1.0:1777497377.330508:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1777497377.330514:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564807680:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497377.330526:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c789880 x1863837564807680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.330554:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c789880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564807680:12345-0@lo:400:kworker.0 Request processed in 41us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.330560:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1777497377.330585:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564807680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330610:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497377.330616:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564807808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.330657:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807808 00000100:00100000:1.0:1777497377.330661:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807808 00000100:00100000:1.0:1777497377.330683:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1777497377.330696:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564807808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330744:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564807808:12345-0@lo:400:kworker.0 Request processed in 48us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.330750:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:1.0:1777497377.330777:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564807808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330806:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497377.330812:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564807936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330836:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.330866:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564807936 00000100:00100000:1.0:1777497377.330869:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564807936 00000100:00100000:1.0:1777497377.330895:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1777497377.330900:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b6419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564807936:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497377.330913:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b6419c00 x1863837564807936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.330941:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b6419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564807936:12345-0@lo:400:kworker.0 Request processed in 41us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.330946:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3811 00000100:00100000:1.0:1777497377.330970:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c78bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564807936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.330998:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564808064:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331020:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.331044:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808064 00000100:00100000:1.0:1777497377.331047:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808064 00000100:00100000:1.0:1777497377.331069:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1777497377.331074:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564808064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497377.331085:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c78bb80 x1863837564808064/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.331145:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c78bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564808064:12345-0@lo:400:kworker.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.331151:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1777497377.331179:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564808064:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331207:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808192:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331229:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.331254:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808192 00000100:00100000:1.0:1777497377.331258:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808192 00000100:00100000:1.0:1777497377.331282:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1777497377.331287:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331320:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84df3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808192:12345-0@lo:400:kworker.0 Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.331325:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3812 00000100:00100000:1.0:1777497377.331351:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b641a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808192:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331376:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497377.331382:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808320:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331405:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.331430:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808320 00000100:00100000:1.0:1777497377.331434:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808320 00000100:00100000:1.0:1777497377.331482:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1777497377.331489:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331521:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84df2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808320:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.331526:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1777497377.331564:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808320:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331590:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497377.331596:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564808448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331619:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.331642:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808448 00000100:00100000:1.0:1777497377.331646:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808448 00000100:00100000:1.0:1777497377.331679:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:1.0:1777497377.331684:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b641a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564808448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331711:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b641a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564808448:12345-0@lo:400:kworker.0 Request processed in 27us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.331731:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:1.0:1777497377.331752:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564808448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331777:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564808576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.331809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497377.331832:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808576 00000100:00100000:1.0:1777497377.331835:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808576 00000100:00100000:1.0:1777497377.331853:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1777497377.331859:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564808576:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497377.331869:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf3100 x1863837564808576/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.331898:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564808576:12345-0@lo:400:kworker.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.331903:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:1.0:1777497377.331929:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84df0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564808576:0@lo:400:kworker.0 00000100:00100000:2.0:1777497377.332325:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564807424:12345-0@lo:400:kworker.0 Request processed in 8147us (9049us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497377.332333:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00080000:2.0:1777497377.332358:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497377.332362:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497377.332366:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497377.332368:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497377.333706:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564807424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497377.599885:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497377.599933:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497377.599968:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497377.599986:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497377.600013:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497377.600039:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257280 00000100:00100000:1.0:1777497377.600049:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257280 00000100:00100000:1.0:1777497377.600138:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257152 00000100:00100000:1.0:1777497377.600142:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257152 00000100:00100000:1.0:1777497377.600166:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1003 00000100:00100000:1.0:1777497377.600176:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546257280:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497377.600250:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546257280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.600257:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1003 00000100:00100000:1.0:1777497377.600275:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1004 00000100:00100000:1.0:1777497377.600284:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2415:x1863837546257152:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:1.0:1777497377.600498:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf0380 x1863837546257152/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:133/0 lens 224/224 e 0 to 0 dl 1777497388 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497377.600529:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2415:x1863837546257152:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 248us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.600534:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1004 00000100:00100000:1.0:1777497377.600556:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257536 00000100:00100000:1.0:1777497377.600560:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257536 00000100:00100000:1.0:1777497377.600587:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257408 00000100:00100000:1.0:1777497377.600590:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257408 00000100:00100000:1.0:1777497377.600611:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2345 00000100:00100000:1.0:1777497377.600618:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546257536:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497377.600656:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546257536:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.600663:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2345 00000100:00100000:1.0:1777497377.600676:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2346 00000100:00100000:1.0:1777497377.600682:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546257408:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497377.600703:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546257408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497377.600709:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2346 00000100:00100000:3.0:1777497377.600912:0:79991:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257024 00000100:00100000:3.0:1777497377.600917:0:79991:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257024 00000100:00100000:3.0:1777497377.600955:0:79991:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00100000:3.0:1777497377.600962:0:79991:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546257024:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497377.600998:0:79991:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546257024:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497377.601004:0:79991:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 161 00000100:00080000:2.0:1777497377.601212:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497377.601223:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497377.601226:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497377.601228:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497377.829152:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497377.829222:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497377.829260:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497377.829265:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497377.829297:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497377.829359:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808704 00000100:00100000:0.0:1777497377.829366:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808704 00000100:00100000:0.0:1777497377.829401:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808832 00000100:00100000:0.0:1777497377.829404:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808832 00000100:00100000:0.0:1777497377.829424:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1777497377.829433:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497377.829453:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497377.829497:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497377.829504:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:0.0:1777497377.829519:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1777497377.829526:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497377.829535:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497377.829558:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564808832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497377.829563:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1777497377.829608:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497377.829622:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564808704:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1777497377.849477:0:79981:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280515 is committed 00010000:00010000:0.0:1777497377.853788:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853805:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853813:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853834:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ba00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497377.853839:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853847:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853865:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f83b83300) 00010000:00010000:0.0:1777497377.853869:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497377.853875:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853881:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691bbe3 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853904:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853910:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853916:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853921:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497377.853924:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853929:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853948:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f83b83300) 00010000:00010000:0.0:1777497377.853951:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497377.853953:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497377.853959:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691bc1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497377.954499:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497378.338638:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564808960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497378.338855:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497378.339252:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564808960 00000100:00100000:2.0:1777497378.339261:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564808960 00000100:00100000:2.0:1777497378.339350:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3813 00000100:00100000:2.0:1777497378.339360:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564808960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497378.339394:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00010000:00000080:2.0:1777497378.339408:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a2e1ca80 x1863837564808960/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:134/0 lens 224/368 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497378.339469:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564808960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497378.339477:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3813 00000100:00100000:0.0:1777497378.339548:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564808960:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1777497378.482059:0:81090:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1777497378.582424:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497378.582521:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257664 00000100:00100000:3.0:1777497378.582532:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257664 00000100:00100000:3.0:1777497378.582618:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1028 00000100:00100000:3.0:1777497378.582629:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:64302:x1863837546257664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497378.582651:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497378.582851:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bc30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c065 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.582920:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.582935:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.582948:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497378.582994:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497378.582998:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 8 00000004:00010000:3.0:1777497378.583017:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.583040:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bc30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c065 expref: 7 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.583055:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c065 expref: 6 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.583288:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2c00) 00010000:00010000:3.0:1777497378.583292:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497378.583301:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeee00, rc 0) 00010000:00000080:3.0:1777497378.583309:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf2d80 x1863837546257664/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 576/688 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497378.583424:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64302:x1863837546257664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 797us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497378.586479:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1028 00000100:00100000:0.0:1777497378.586613:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497378.586795:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546257792 00000100:00100000:1.0:1777497378.586806:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546257792 00000100:00100000:1.0:1777497378.586865:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1029 00000100:00100000:1.0:1777497378.586875:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64302:x1863837546257792:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497378.586897:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497378.586918:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352600/0x3e357265691bc3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c06c expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.586980:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.586995:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587010:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587034:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587040:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587046:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587368:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587376:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587382:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587388:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587394:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497378.587398:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587405:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587417:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2c00) 00010000:00010000:1.0:1777497378.587420:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497378.587423:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587435:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84353800/0x3e357265691bc45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587446:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587451:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587456:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587460:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497378.587463:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587468:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587475:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240a6e49000) 00010000:00010000:1.0:1777497378.587477:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497378.587479:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587484:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352c00/0x3e357265691bc4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587515:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352600/0x3e357265691bc3e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c06c expref: 7 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587535:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2c00) 00010000:00010000:1.0:1777497378.587538:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497378.587542:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84352600/0x3e357265691bc3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c06c expref: 7 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.587552:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84352600, rc 0) 00010000:00000080:1.0:1777497378.587560:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a2e1c000 x1863837546257792/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 592/584 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497378.587671:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64302:x1863837546257792:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 798us (1059us total) trans 0 rc 301/301 00000100:00100000:1.0:1777497378.587678:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1029 00000100:00100000:1.0:1777497378.593128:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497378.593210:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258048 00000100:00100000:3.0:1777497378.593221:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258048 00000100:00100000:3.0:1777497378.593277:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1030 00000100:00100000:3.0:1777497378.593288:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64302:x1863837546258048:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497378.593309:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497378.593313:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1777497378.593339:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691bc37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c065 expref: 6 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593354:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2c00) 00010000:00010000:3.0:1777497378.593363:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497378.593375:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bc53 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c073 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593470:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593484:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593493:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593514:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593521:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593528:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593900:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593909:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593916:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497378.593926:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:3.0:1777497378.593948:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593955:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593960:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593966:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593972:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497378.593980:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593988:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.593996:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240939c2700) 00010000:00010000:3.0:1777497378.593999:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497378.594002:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.594007:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691bc5a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497378.594015:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009fa8168d reply state 00000000b92ccc93 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.594024:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.594030:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240939c2d00) 00010000:00010000:3.0:1777497378.594031:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497378.594033:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777497378.594058:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691bc53 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.594071:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.594077:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9240939c2000) 00010000:00010000:3.0:1777497378.594079:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497378.594086:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef800, rc 0) 00010000:00000080:3.0:1777497378.594130:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf0000 x1863837546258048/t94489280516(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 536/608 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497378.594186:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64302:x1863837546258048:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 901us (1096us total) trans 94489280516 rc 0/0 00000100:00100000:3.0:1777497378.594192:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1030 00000100:00100000:1.0:1777497378.599425:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497378.599472:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258304 00000100:00100000:0.0:1777497378.599482:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258304 00000100:00100000:0.0:1777497378.599544:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1031 00000100:00100000:0.0:1777497378.599554:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64302:x1863837546258304:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497378.599577:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497378.599598:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c07a expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497378.599726:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497378.599742:0:73210:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497378.599750:0:73210:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497378.599789:0:73210:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497378.599802:0:73210:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 9 pid: 63729 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497378.599815:0:73210:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:73210:1863837564809088:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497378.599896:0:73210:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a62e6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497378.604867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497378.604966:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258432 00000100:00100000:3.0:1777497378.604975:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258432 00010000:00010000:3.0:1777497378.605010:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 10 pid: 63729 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497378.605084:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2532 00000100:00100000:3.0:1777497378.605113:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2414:x1863837546258432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497378.605128:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497378.605135:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 5/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 10 pid: 63729 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.605148:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 10 pid: 63729 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.605179:0:19127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9240939c2000) 00010000:00010000:3.0:1777497378.605184:0:19127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.605194:0:19127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.605201:0:19127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497378.605228:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497378.605279:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2414:x1863837546258432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 185us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497378.605286:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2532 00010000:00010000:1.0:1777497378.605514:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691bc68 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 9 pid: 63729 timeout: 3607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497378.605529:0:73210:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:73210:1863837564809088:192.168.202.4@tcp:104: 00010000:00010000:1.0:1777497378.605550:0:73210:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605559:0:73210:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605564:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497378.605594:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00010000:00010000:1.0:1777497378.605806:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605814:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605822:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605828:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497378.605833:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605840:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605850:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9240939c2000) 00010000:00010000:1.0:1777497378.605853:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777497378.605856:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605862:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bc7d lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605918:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c07a expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605928:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b700) 00010000:00010000:1.0:1777497378.605930:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497378.605940:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691bc76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c07a expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497378.605954:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9000, rc 0) 00010000:00000080:1.0:1777497378.605961:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf0700 x1863837546258304/t94489280517(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 712/824 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497378.605996:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64302:x1863837546258304:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6445us (6580us total) trans 94489280517 rc 301/301 00000100:00100000:1.0:1777497378.606004:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1031 00000100:00100000:1.0:1777497378.613159:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497378.618338:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258688 00000100:00100000:2.0:1777497378.618353:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258688 00000100:00100000:2.0:1777497378.618411:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:2.0:1777497378.618421:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:64302:x1863837546258688:12345-192.168.202.4@tcp:35:lfs.0 00010000:00000080:2.0:1777497378.618592:0:63730:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf0a80 x1863837546258688/t94489280518(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 392/456 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497378.618653:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:64302:x1863837546258688:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 234us (5503us total) trans 94489280518 rc 0/0 00000100:00100000:2.0:1777497378.618660:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00100000:1.0:1777497378.634789:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497378.634827:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258944 00000100:00100000:1.0:1777497378.634837:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258944 00000100:00100000:1.0:1777497378.634880:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 217 00000100:00100000:1.0:1777497378.634890:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:64302:x1863837546258944:12345-192.168.202.4@tcp:35:lfs.0 00010000:00000080:1.0:1777497378.635161:0:63731:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c5a6c50 x1863837546258944/t94489280519(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:134/0 lens 392/456 e 0 to 0 dl 1777497389 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497378.635222:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:64302:x1863837546258944:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 334us (442us total) trans 94489280519 rc 0/0 00000100:00100000:1.0:1777497378.635229:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 217 00010000:00010000:0.0:1777497378.978272:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497380.004268:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497380.386299:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497380.386321:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564809216:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497380.386389:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497380.386438:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809216 00000100:00100000:0.0:1777497380.386445:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809216 00000100:00100000:0.0:1777497380.386489:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3814 00000100:00100000:0.0:1777497380.386497:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564809216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497380.386531:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497380.386581:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564809216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497380.386588:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3814 00000100:00100000:1.0:1777497380.386908:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a2e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564809216:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1777497380.558243:0:81187:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1777497380.558299:0:81187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.558315:0:81187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.558336:0:81187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.558343:0:81187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.558364:0:81187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777497380.558370:0:81187:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1777497380.558402:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497380.558406:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1777497380.558413:0:81187:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1777497380.558440:0:81187:0:(import.c:65:import_set_state_nolock()) ffff9240911d7000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1777497380.558521:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497380.558527:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558535:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89c00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497380.558539:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558547:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497380.558553:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497380.558559:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1777497380.558562:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1777497380.558565:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1777497380.558589:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558596:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497380.558626:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558633:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d89c00/0x3e357265691b886 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b88d expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558663:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497380.558665:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497380.558666:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497380.558675:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497380.558704:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564809472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497380.558778:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497380.558836:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809472 00000100:00100000:3.0:1777497380.558841:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809472 00000100:00100000:3.0:1777497380.558882:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1777497380.558890:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564809472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497380.558901:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497380.558915:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086d89e00/0x3e357265691b88d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b886 expref: 23 pid: 79991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.558926:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497380.558955:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3660:x1863837564809472:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497380.558961:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1777497380.558997:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564809472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497380.559840:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564809344:0@lo:39:umount.0 00000100:00100000:1.0:1777497380.559888:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497380.561914:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809344 00000100:00100000:3.0:1777497380.561926:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809344 00000100:00100000:3.0:1777497380.562026:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1777497380.562036:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564809344:12345-0@lo:39:umount.0 00000020:00000080:3.0:1777497380.562067:0:63727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b9a5 00000100:00080000:3.0:1777497380.562075:0:63727:0:(import.c:65:import_set_state_nolock()) ffff923f88a18000 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1777497380.562132:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf0a80 x1863837564809344/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:136/0 lens 224/224 e 0 to 0 dl 1777497391 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497380.562221:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837564809344:12345-0@lo:39:umount.0 Request processed in 186us (2331us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497380.562228:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000020:00000080:3.0:1777497380.562239:0:63727:0:(genops.c:906:class_export_put()) final put ffff923f839d3000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1777497380.562299:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497380.562772:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240911d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777497380.562824:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564809344:0@lo:39:umount.0 00000020:00000080:3.0:1777497380.562940:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1777497380.562990:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497380.562994:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777497380.562999:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1777497380.564065:0:81187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564080:0:81187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564087:0:81187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564187:0:81187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564266:0:81187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497380.564274:0:81187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564280:0:81187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564287:0:81187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.564293:0:81187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1777497380.564393:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a18000 for lustre-MDT0000 00010000:00010000:1.0:1777497380.564467:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497380.564474:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.564481:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497380.564486:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.564495:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497380.564503:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497380.564509:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497380.564511:0:16604:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1777497380.564541:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.564548:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497380.564580:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.564588:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691b7a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b7ad expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497380.564783:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497380.564804:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564809600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497380.564865:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497380.564923:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809600 00000100:00100000:2.0:1777497380.564937:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809600 00000100:00100000:2.0:1777497380.564982:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1777497380.564991:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3659:x1863837564809600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497380.565003:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497380.565016:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95400/0x3e357265691b7ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b7a6 expref: 22 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.565029:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497380.565062:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3659:x1863837564809600:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497380.565069:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1777497380.565132:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564809600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497380.566552:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497380.566563:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.566573:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497380.566591:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.566600:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497380.566606:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497380.566611:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497380.566614:0:16604:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1777497380.566974:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.566982:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777497380.567031:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564809728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497380.567090:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777497380.567189:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.567199:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497380.567201:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497380.567203:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497380.567268:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809728 00000100:00100000:3.0:1777497380.567275:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809728 00000100:00100000:3.0:1777497380.567333:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:3.0:1777497380.567342:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3657:x1863837564809728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497380.567355:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497380.567370:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefc00/0x3e357265691b8b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8b0 expref: 21 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.567382:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497380.567507:0:81187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777497380.567514:0:81187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691b8b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b8b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497380.567524:0:81187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1777497380.567534:0:81187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567542:0:81187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567548:0:81187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567554:0:81187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567583:0:81187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497380.567589:0:81187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567595:0:81187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567600:0:81187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567605:0:81187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567615:0:81187:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1777497380.567618:0:81187:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1777497380.567622:0:81187:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1777497380.567805:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497380.567810:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567817:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497380.567820:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567826:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497380.567833:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497380.567848:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1777497380.567851:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1777497380.567853:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1777497380.567871:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.567877:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1777497380.567917:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564809856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497380.567949:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497380.568032:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809856 00000100:00100000:1.0:1777497380.568036:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809856 00000100:00100000:1.0:1777497380.568066:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1777497380.568072:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409b410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3658:x1863837564809856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497380.568081:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497380.568090:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086d88c00/0x3e357265691b87f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b878 expref: 21 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.568131:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497380.568159:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409b410050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3658:x1863837564809856:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497380.568166:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:1.0:1777497380.568205:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564809856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497380.568316:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3657:x1863837564809728:12345-0@lo:103:ldlm_bl.0 Request processed in 974us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497380.568324:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00010000:00010000:3.0:1777497380.568369:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497380.568373:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568379:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497380.568381:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568387:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497380.568401:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497380.568405:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1777497380.568407:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1777497380.568409:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1777497380.568425:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568431:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497380.568454:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568461:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38400/0x3e357265691b791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b79f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568471:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497380.568472:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497380.568474:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497380.568480:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497380.568488:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564809984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497380.568513:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497380.568539:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564809984 00000100:00100000:3.0:1777497380.568543:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564809984 00000100:00100000:3.0:1777497380.568569:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1777497380.568576:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3660:x1863837564809984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497380.568583:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497380.568592:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95000/0x3e357265691b79f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b791 expref: 19 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497380.568607:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497380.568635:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3660:x1863837564809984:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497380.568762:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564809728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497380.568784:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497380.568807:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:3.0:1777497380.568839:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564809984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497380.568993:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.569001:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d88800/0x3e357265691b878 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691b87f expref: -99 pid: 79980 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497380.569011:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497380.569012:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497380.569014:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1777497380.569029:0:81187:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1777497380.569034:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1777497380.569039:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1777497380.569045:0:81187:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000004:00000080:0.0:1777497380.571916:0:81187:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1777497380.572946:0:79981:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00000020:00000080:0.0:1777497380.573030:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1777497380.573041:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff924090d18800 6d03493e-1218-49f3-bdd0-b10716c402e0 192.168.202.4@tcp 5 (0 0 0) 0 0 0 1: ffff9240865f3000 94489280519 stale:0 00000020:00080000:0.0:1777497380.573049:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92409c469800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.573054:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f839d3800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.573059:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92409c46d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.573064:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f81a07800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.573068:0:81187:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff92409c5a99c0) has exports, disconnecting them 00000020:00080000:0.0:1777497380.573080:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff924090d18800), last request at 1777497378 00000020:00000080:0.0:1777497380.573087:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bb73 00000100:00080000:0.0:1777497380.573128:0:81187:0:(import.c:65:import_set_state_nolock()) ffff924090d1c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497380.573153:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff924090d18800): rc 0 00000020:00080000:0.0:1777497380.573157:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92409c469800), last request at 1777497170 00000020:00000080:0.0:1777497380.573160:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b997 00000100:00080000:0.0:1777497380.573163:0:81187:0:(import.c:65:import_set_state_nolock()) ffff92409c46c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497380.573174:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92409c469800): rc 0 00000020:00000080:0.0:1777497380.573176:0:81187:0:(genops.c:906:class_export_put()) final put ffff92409c469800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1777497380.573185:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f839d3800), last request at 1777497377 00000020:00000080:0.0:1777497380.573188:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b99e 00000100:00080000:0.0:1777497380.573191:0:81187:0:(import.c:65:import_set_state_nolock()) ffff923f839d1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497380.573198:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f839d3800): rc 0 00000020:00000080:0.0:1777497380.573200:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f839d3800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1777497380.573204:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92409c46d800), last request at 1777497377 00000020:00000080:0.0:1777497380.573206:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b990 00000100:00080000:0.0:1777497380.573215:0:81187:0:(import.c:65:import_set_state_nolock()) ffff92409c46c800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777497380.573244:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497380.573252:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92409c46d800): rc 0 00000020:00000080:0.0:1777497380.573254:0:81187:0:(genops.c:906:class_export_put()) final put ffff92409c46d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1777497380.573258:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f81a07800), last request at 1777497165 00000020:00000080:0.0:1777497380.573261:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b7fa 00000100:00080000:0.0:1777497380.573268:0:81187:0:(import.c:65:import_set_state_nolock()) ffff923f839d7800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777497380.573278:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497380.573284:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f81a07800): rc 0 00000020:00000080:0.0:1777497380.573285:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f81a07800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:0.0:1777497380.573291:0:81187:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef01d67ae0 00000100:00080000:0.0:1777497380.573310:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497380.573319:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 3 00010000:00010000:2.0:1777497380.573792:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497380.573802:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c469800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497380.573837:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d3800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497380.573856:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497380.573877:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a07800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497380.573896:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c46c000 for lustre-MDT0000 00000020:00000080:2.0:1777497380.573900:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d1000 for lustre-MDT0000 00000020:00000080:2.0:1777497380.573903:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c46c800 for lustre-MDT0000 00000020:00000080:2.0:1777497380.573906:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d7800 for lustre-MDT0000 00010000:00010000:2.0:1777497380.573924:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497380.574476:0:81187:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1777497380.574502:0:81187:0:(import.c:65:import_set_state_nolock()) ffff9240b53aa000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1777497380.574558:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810112:0@lo:39:umount.0 00000100:00100000:2.0:1777497380.574628:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497380.574737:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497380.575041:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777497380.575045:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 3 00000004:00080000:0.0:1777497380.575064:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:0.0:1777497380.575151:0:81187:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1777497380.575163:0:81187:0:(import.c:65:import_set_state_nolock()) ffff9240bb70e800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1777497380.575276:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575288:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575296:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575302:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497380.575306:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575313:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575330:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240939c2d00) 00010000:00010000:1.0:1777497380.575334:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497380.575339:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497380.575346:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691bc61 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777497380.575381:0:3643:0:(genops.c:906:class_export_put()) final put ffff924090d18800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000100:00100000:1.0:1777497380.575416:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810112 00000100:00100000:1.0:1777497380.575424:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810112 00000100:00100000:1.0:1777497380.575471:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3815 00000100:00100000:1.0:1777497380.575479:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564810112:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777497380.575507:0:8407:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b82b 00000100:00080000:1.0:1777497380.575512:0:8407:0:(import.c:65:import_set_state_nolock()) ffff924083ad0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497380.575531:0:8407:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378730 00000100:00100000:2.0:1777497380.575869:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810240:0@lo:9:umount.0 00000100:00100000:2.0:1777497380.575903:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497380.575963:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810240 00000100:00100000:3.0:1777497380.575967:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810240 00000100:00100000:3.0:1777497380.576007:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5824 00000100:00100000:3.0:1777497380.576014:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564810240:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777497380.576029:0:25485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b855 00000100:00080000:3.0:1777497380.576034:0:25485:0:(import.c:65:import_set_state_nolock()) ffff9240a6370000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777497380.576068:0:25485:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1777497380.576180:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564810240:12345-0@lo:9:umount.0 Request processed in 166us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497380.576187:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5824 00000100:00080000:0.0:1777497380.576259:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777497380.576262:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969446 gen 3 00000004:00080000:0.0:1777497380.576281:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:0.0:1777497380.576337:0:81187:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1777497380.576351:0:81187:0:(import.c:65:import_set_state_nolock()) ffff924086e2e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1777497380.576393:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff92409c5a99c0) has no exports 00000100:00100000:1.0:1777497380.576494:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837564810112:12345-0@lo:39:umount.0 Request processed in 1014us (1865us total) trans 81604378731 rc 0/0 00000100:00100000:1.0:1777497380.576501:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3815 00010000:00010000:1.0:1777497380.576521:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777497380.576592:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924090d18800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0000 00000020:00080000:0.0:1777497380.577027:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff92409c5a99c0) has no exports 00000100:00080000:3.0:1777497380.578834:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497380.578935:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240b53aa000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497380.578945:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810112:0@lo:39:umount.0 00000100:00100000:2.0:1777497380.578967:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810368:0@lo:9:umount.0 00000100:00100000:2.0:1777497380.579025:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497380.579069:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb70e800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497380.579082:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497380.579084:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497380.579087:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810240:0@lo:9:umount.0 00010000:00010000:2.0:1777497380.579136:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497380.579196:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810368 00000100:00100000:3.0:1777497380.579204:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810368 00000100:00100000:3.0:1777497380.579263:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5825 00000100:00100000:3.0:1777497380.579272:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564810368:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777497380.579300:0:25488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b871 00000100:00080000:3.0:1777497380.579308:0:25488:0:(import.c:65:import_set_state_nolock()) ffff9240bb681800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777497380.579346:0:25488:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969446 00000100:00100000:3.0:1777497380.579481:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564810368:12345-0@lo:9:umount.0 Request processed in 211us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497380.579503:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5825 00000100:00080000:2.0:1777497380.579553:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497380.579560:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497380.579579:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e2e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497380.579595:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497380.579597:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497380.579601:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564810368:0@lo:9:umount.0 00000020:00000080:1.0:1777497380.581762:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924090d1c000 for lustre-MDT0000 00000020:00000080:0.0:1777497380.614436:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b80f 00000020:00000080:0.0:1777497380.614451:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240aef68800/lustre-QMT0000_UUID 00000020:01000000:0.0:1777497380.614518:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1777497380.614575:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240aef68800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1777497380.614604:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497380.614614:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1777497380.614618:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9240a6bf3380) has no exports 00000020:00000080:1.0:1777497380.615048:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b808 00000020:00000080:1.0:1777497380.615054:0:81187:0:(genops.c:906:class_export_put()) final put ffff924086e27000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497380.615321:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e27000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497380.615379:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497380.615387:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1777497380.615390:0:81187:0:(genops.c:906:class_export_put()) final put ffff924086e24800/lustre-QMT0000_UUID 00000020:00000080:1.0:1777497380.615392:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e24800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1777497380.615396:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:1.0:1777497380.615529:0:81187:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924098aba0c0 - data ffff9240a33c6000/ffff923f824dfc00 00000020:01000000:1.0:1777497380.615737:0:81187:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f81aaac00 - data ffff9240a3336360/ffff923f824dec00 00000100:00080000:0.0:1777497380.644628:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497380.644636:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 4 00000100:00100000:0.0:1777497380.644651:0:81187:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240b50b0380 x1863837564810112/t81604378731(81604378731) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497390 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497380.644676:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1777497380.646305:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777497380.646312:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 4 00000004:00080000:1.0:1777497380.646365:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497380.646369:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1777497380.646964:0:79998:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1777497380.646969:0:79998:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 2 count 1 00000040:00080000:0.0:1777497380.646979:0:79998:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 22 count 2 00000100:00080000:1.0:1777497380.647564:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777497380.647568:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969446 gen 4 00000004:00080000:1.0:1777497380.647589:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497380.647591:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1777497380.647938:0:80000:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1777497380.647942:0:80000:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5a:0x0] index 1 count 1 00000040:00080000:0.0:1777497380.647954:0:80000:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 22 count 2 00000020:00000080:1.0:1777497380.648763:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b7bb 00000020:00000080:1.0:1777497380.648772:0:81187:0:(genops.c:906:class_export_put()) final put ffff92408a0a1000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497380.649272:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497380.649606:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b7d0 00000020:00000080:1.0:1777497380.649612:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f86084000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497380.649665:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1777497380.649672:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497380.649679:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777497380.649691:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff92409c5acd40) has no exports 00000004:01000000:1.0:1777497380.649842:0:81187:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1777497380.649850:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b85c 00000020:00000080:1.0:1777497380.649854:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f8455c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497380.650288:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f86084000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1777497380.650346:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1777497380.650351:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497380.650357:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497380.650360:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff923f82aacd40) has no exports 00000020:00000080:1.0:1777497380.650367:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b84e 00000020:00000080:1.0:1777497380.650371:0:81187:0:(genops.c:906:class_export_put()) final put ffff924086e2b800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1777497380.650798:0:81187:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1777497380.650803:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777497380.650807:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969446 gen 5 00000004:00080000:1.0:1777497380.650813:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497380.650815:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777497380.650844:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497380.650850:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497380.650867:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b840 00000020:00000080:1.0:1777497380.650871:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240888ef800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497380.650875:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1777497380.650878:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497380.650881:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497380.650884:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9240a695b380) has no exports 00000020:00000080:1.0:1777497380.650888:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b839 00000020:00000080:1.0:1777497380.650890:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240bb70d800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1777497380.651296:0:81187:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1777497380.651300:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777497380.651302:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969450 gen 5 00000004:00080000:1.0:1777497380.651306:0:81187:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497380.651307:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777497380.651330:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497380.651335:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1777497380.651343:0:81187:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1777497380.651348:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b824 00000020:00000080:1.0:1777497380.651351:0:81187:0:(genops.c:906:class_export_put()) final put ffff92408a0a4000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497380.651354:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1777497380.651358:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497380.651361:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497380.651363:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240a6bf19c0) has no exports 00000020:00000080:1.0:1777497380.651366:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b81d 00000020:00000080:1.0:1777497380.651369:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240b53a9000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497380.651762:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8455c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1777497380.651770:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e2b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497380.651776:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e2e000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1777497380.651782:0:8:0:(genops.c:906:class_export_put()) final put ffff923f826cd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497380.651784:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1777497380.651787:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497380.651864:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240888ef800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1777497380.651869:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb70d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497380.651872:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb70e800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1777497380.651876:0:8:0:(genops.c:906:class_export_put()) final put ffff923f88a1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497380.651877:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1777497380.651880:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497380.651908:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1777497380.651912:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b53a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777497380.654173:0:81187:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1777497380.654181:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497380.654185:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 81604378730 gen 5 00000100:00100000:0.0:1777497380.654194:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497380.654253:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497380.654265:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497380.654295:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497380.654299:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497380.654304:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f88a1a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497380.654308:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1777497380.654315:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497380.654418:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b7d7 00000020:00000080:0.0:1777497380.654425:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f86081800/lustre-MDD0000_UUID 00000020:01000000:0.0:1777497380.654430:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1777497380.654434:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497380.654439:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497380.654443:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9240a6bf0000) has no exports 00000020:00000080:0.0:1777497380.654461:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497380.654464:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1777497380.654469:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b7de 00000020:00000080:0.0:1777497380.654473:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f81a04800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497380.654479:0:81187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f88a1e800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1777497380.654482:0:81187:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f88a1e800 3 00000020:01000004:0.0:1777497380.654485:0:81187:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff923f88a1e800 from lustre-MDT0000 00000020:00000080:0.0:1777497380.654503:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497380.654507:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1777497380.654510:0:81187:0:(genops.c:906:class_export_put()) final put ffff92408a0a1800/lustre-MDT0000_UUID 00000020:00000080:0.0:1777497380.654512:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1777497380.654520:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1777497380.654551:0:81187:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1777497380.654554:0:81187:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1777497380.654557:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1777497380.654560:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497380.654563:0:81187:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1777497380.654570:0:81187:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240a3af2000 95f1b493-372d-4153-ad35-48e1115be1b1 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.654576:0:81187:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240ae4b4800 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.654580:0:81187:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff923f82aa8000) has exports, disconnecting them 00000020:00080000:0.0:1777497380.654584:0:81187:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff9240a3af2000), last request at 1777497165 00000020:00000080:0.0:1777497380.654604:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b8a9 00000020:00010000:0.0:1777497380.654608:0:81187:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240a3af2000: total 2 00000100:00080000:0.0:1777497380.654612:0:81187:0:(import.c:65:import_set_state_nolock()) ffff9240a3af7800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497380.654624:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff9240a3af2000): rc 0 00000020:00080000:0.0:1777497380.654634:0:81187:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9240ae4b4800), last request at 1777497165 00000020:00000080:2.0:1777497380.654760:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240b53aa000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1777497380.654768:0:8:0:(genops.c:906:class_export_put()) final put ffff92408a0a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497380.654770:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1777497380.654781:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497380.654837:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f86081800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1777497380.654841:0:8:0:(genops.c:906:class_export_put()) final put ffff923f81a05000/lustre-MDD0000_UUID 00000020:00000080:2.0:1777497380.654842:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a05000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1777497380.654852:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1777497380.654883:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497380.654952:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b78a 00000020:00010000:0.0:1777497380.654956:0:81187:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240ae4b4800: total 0 00000100:00080000:0.0:1777497380.654959:0:81187:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497380.655048:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240ae4b4800): rc 0 00000020:00080000:0.0:1777497380.655053:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff923f82aa8000) has no exports 00000100:00100000:1.0:1777497380.655170:0:79987:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff923f86e57200:79987] 1 exiting: rc = 0 00000100:00100000:1.0:1777497380.655264:0:79988:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff923f86e56a00:79988] 2 exiting: rc = 0 00000100:00100000:1.0:1777497380.655318:0:79986:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff923f82963800:79986] 0 exiting: rc = 1 00000100:00100000:0.0:1777497380.655463:0:79991:0:(service.c:3164:ptlrpc_main()) ll_mgs_0003: service thread [ffff923f825f4a00:79991] 3 exiting: rc = 0 00000020:00010000:2.0:1777497380.655633:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240a3af2000: total 0 00010000:00010000:2.0:1777497380.655674:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240a3af2000, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1777497380.655717:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086d88a00/0x3e357265691b989 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c03b expref: 5 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655732:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef200/0x3e357265691b982 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c034 expref: 4 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655743:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e94e00/0x3e357265691b974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c026 expref: 3 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655754:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95c00/0x3e357265691b97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c02d expref: 2 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655763:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240a3af2000, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1777497380.655780:0:6503:0:(genops.c:906:class_export_put()) final put ffff9240a3af2000/95f1b493-372d-4153-ad35-48e1115be1b1 00000020:00010000:2.0:1777497380.655790:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240ae4b4800: total 1 00010000:00010000:2.0:1777497380.655806:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240ae4b4800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1777497380.655822:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38c00/0x3e357265691b8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8e8 expref: 14 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655836:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95600/0x3e357265691b96d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b966 expref: 13 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655846:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39400/0x3e357265691b8fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8f6 expref: 12 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655856:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e94600/0x3e357265691b95f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b958 expref: 11 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655878:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95a00/0x3e357265691b919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b912 expref: 10 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655889:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee000/0x3e357265691b90b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b904 expref: 9 pid: 79991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655899:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefa00/0x3e357265691b927 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b920 expref: 8 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655908:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086d89600/0x3e357265691b935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b92e expref: 7 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655917:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef000/0x3e357265691b8c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8be expref: 6 pid: 79987 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655926:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691b943 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b93c expref: 5 pid: 79988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655935:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086d88400/0x3e357265691b8d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8cc expref: 4 pid: 79991 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655946:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef600/0x3e357265691b951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b94a expref: 3 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655956:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38a00/0x3e357265691b8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691b8da expref: 2 pid: 79986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497380.655965:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240ae4b4800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1777497380.655978:0:6503:0:(genops.c:906:class_export_put()) final put ffff9240ae4b4800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00010000:00010000:2.0:1777497380.655983:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497380.655990:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497380.655992:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497380.656001:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af2000/95f1b493-372d-4153-ad35-48e1115be1b1 for MGS 00000020:00000080:2.0:1777497380.656029:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b4800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:2.0:1777497380.656042:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a3af7800 for MGS 00000020:00000080:2.0:1777497380.656046:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b0800 for MGS 00010000:00010000:0.0:1777497380.656488:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497380.656521:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656529:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656534:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656539:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656546:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656551:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656558:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656563:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656568:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656584:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656589:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656594:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656599:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656606:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656611:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656617:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656622:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656628:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656634:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656651:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656657:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656662:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656668:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656673:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656679:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656693:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656708:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656713:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656718:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656727:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656732:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656738:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656744:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656751:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656758:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656763:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656769:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656774:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656780:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656785:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656791:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656796:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656803:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656810:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656816:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656823:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656829:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656834:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656840:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656845:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656851:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656857:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656862:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656868:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656873:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656878:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656884:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656890:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656895:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656900:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656906:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656918:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656924:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497380.656929:0:81187:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1777497380.658228:0:81187:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f81aaa3c0 - data ffff9240b6059288/ffff92408938c000 00000020:01000000:0.0:1777497380.658350:0:81187:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f828d14e0 - data ffff9240b60f55e8/ffff924085eea000 00000020:00000080:0.0:1777497380.658910:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b783 00000020:00000080:0.0:1777497380.658919:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240ae4b7000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497380.658936:0:81187:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f88a1e800 from MGS, refs=2 00000020:01000004:0.0:1777497380.658939:0:81187:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f88a1e800 2 00000020:01000004:0.0:1777497380.658943:0:81187:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff923f88a1e800 from MGS 00000020:00000080:0.0:1777497380.658965:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497380.658973:0:81187:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1777497380.658975:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240ae4b3800/MGS 00000020:00000080:0.0:1777497380.658978:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b3800/MGS for MGS 00000020:01000000:0.0:1777497380.658984:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1777497380.659048:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1777497380.659052:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497380.659058:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1777497380.659064:0:81187:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9240911d5800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497380.659069:0:81187:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9240a69599c0) has exports, disconnecting them 00000020:00080000:0.0:1777497380.659074:0:81187:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9240911d5800), last request at 1777497165 00000020:00000080:0.0:1777497380.659078:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b89b 00000020:00080000:0.0:1777497380.659088:0:81187:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240911d5800): rc 0 00000020:00000080:0.0:1777497380.659113:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240911d5800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777497380.659777:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497380.659787:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1777497380.660162:0:81187:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1777497380.660167:0:81187:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497380.660171:0:81187:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777497380.660177:0:81187:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497380.660195:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240911d7000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777497380.660290:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497380.660297:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1777497380.660300:0:81187:0:(genops.c:906:class_export_put()) final put ffff92409c5d9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1777497380.660303:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5d9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1777497380.660307:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1777497380.660372:0:81187:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f88a1e800 1 00000020:00000080:2.0:1777497380.660378:0:81187:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b775 00000020:00000080:2.0:1777497380.660382:0:81187:0:(genops.c:906:class_export_put()) final put ffff9240ae4b2000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1777497380.660390:0:81187:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1777497380.660398:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497380.660406:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497380.660410:0:81187:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1777497380.660412:0:81187:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff924099064d40) has no exports 00000020:00000080:3.0:1777497380.736960:0:81187:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497380.736973:0:81187:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1777497380.736979:0:81187:0:(genops.c:906:class_export_put()) final put ffff923f88a1c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497380.736985:0:81187:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1777497380.736999:0:81187:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1777497380.737221:0:81187:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff923f88a1d800 00000020:02000400:3.0:1777497380.737289:0:81187:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1777497381.026258:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497381.922470:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497381.922493:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564810496:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497381.922559:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497381.922653:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810496 00000100:00100000:1.0:1777497381.922661:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810496 00000100:00100000:1.0:1777497381.922735:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1777497381.922745:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564810496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497381.922785:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497381.922834:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564810496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497381.922842:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:1.0:1777497381.922899:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564810496:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497381.922961:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497381.923354:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497381.923363:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564810624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497381.923392:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497381.923421:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810624 00000100:00100000:1.0:1777497381.923426:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810624 00000100:00100000:1.0:1777497381.923457:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:1.0:1777497381.923463:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564810624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497381.923480:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497381.923514:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564810624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497381.923519:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00080000:1.0:1777497381.923533:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497381.923554:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564810624:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497382.057060:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497382.434542:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564811136:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434611:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434656:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1777497382.434663:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564810752:0@lo:400:kworker.0 00000400:00000100:0.0:1777497382.434698:0:3657:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564810752 offset 0 length 224: 4 00000100:00100000:0.0:1777497382.434721:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564811264:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434753:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434782:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564810880:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434805:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434825:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564811392:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434866:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1777497382.434871:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564811008:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434891:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434907:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564811520:0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.434925:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497382.434956:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811136 00000100:00100000:0.0:1777497382.434963:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811136 00000100:00100000:0.0:1777497382.435001:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811264 00000100:00100000:0.0:1777497382.435004:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811264 00000100:00100000:0.0:1777497382.435033:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564810880 00000100:00100000:0.0:1777497382.435036:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564810880 00000100:00100000:0.0:1777497382.435044:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811008 00000100:00100000:0.0:1777497382.435047:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811008 00000100:00100000:0.0:1777497382.435058:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811520 00000100:00100000:0.0:1777497382.435059:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811520 00000100:00100000:0.0:1777497382.435071:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1777497382.435079:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564811264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.435167:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564811264:12345-0@lo:400:kworker.0 Request processed in 88us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497382.435174:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1777497382.435193:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1777497382.435199:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564811008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497382.435241:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564811008:12345-0@lo:400:kworker.0 Request processed in 42us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497382.435248:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1777497382.435260:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1777497382.435264:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1863837564811136:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497382.435270:0:65418:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497382.435293:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3657:x1863837564811136:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497382.435298:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1777497382.435310:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1777497382.435313:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1863837564810880:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497382.435317:0:65418:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497382.435336:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1863837564810880:12345-0@lo:400:kworker.0 Request processed in 21us (530us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497382.435341:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1777497382.435351:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1777497382.435354:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1863837564811520:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497382.435358:0:65418:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497382.435377:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3659:x1863837564811520:12345-0@lo:400:kworker.0 Request processed in 21us (451us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497382.435383:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1777497382.435405:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811392 00000100:00100000:0.0:1777497382.435409:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811392 00000100:00100000:0.0:1777497382.435433:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3816 00000100:00100000:0.0:1777497382.435437:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564811392:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497382.435443:0:23359:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497382.435465:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564811392:12345-0@lo:400:kworker.0 Request processed in 27us (616us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497382.435477:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3816 00000100:00080000:0.0:1777497382.435506:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497382.435543:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564811008:0@lo:400:kworker.0 00000100:00080000:0.0:1777497382.435556:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777497382.435561:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1777497382.435565:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1777497382.447324:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564811264:0@lo:400:kworker.0 00000100:00080000:1.0:1777497382.447345:0:3657:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497382.447350:0:3657:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497382.447355:0:3657:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497382.447361:0:3657:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497382.447365:0:3657:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3299 00000100:00080000:1.0:1777497382.447381:0:3657:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497382.447413:0:3657:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f83cf2680 x1863837564811648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497382.447442:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564811136:0@lo:400:kworker.0 00000100:00100000:3.0:1777497382.450270:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564811648:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1777497382.450348:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497382.450446:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811648 00000100:00100000:2.0:1777497382.450454:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811648 00000100:00100000:2.0:1777497382.450503:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1777497382.450509:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564811648:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1777497382.450549:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497382.450598:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564811648:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 87us (250us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497382.450604:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:2.0:1777497382.450645:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497382.450650:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497382.450653:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564811648:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1777497382.471402:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497382.471418:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3299 00000100:00080000:0.0:1777497382.471427:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497382.473012:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f83cf3800 x1863837564811776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497382.473049:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564811520:0@lo:400:kworker.0 00000100:00100000:1.0:1777497382.473073:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564811776:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1777497382.473184:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497382.473268:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497382.473274:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497382.473278:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497382.473283:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497382.473286:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3299 00000100:00080000:1.0:1777497382.473294:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497382.473309:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f83cf1f80 x1863837564811904/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497382.473325:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564810880:0@lo:400:kworker.0 00000100:00100000:1.0:1777497382.473337:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564811904:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1777497382.473362:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497382.473397:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811776 00000100:00100000:1.0:1777497382.473404:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811776 00000100:00100000:1.0:1777497382.473437:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564811904 00000100:00100000:1.0:1777497382.473449:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564811904 00000100:00100000:1.0:1777497382.473471:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1777497382.473478:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564811776:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1777497382.473497:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497382.473536:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564811776:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 57us (352us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497382.473543:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1777497382.473560:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1777497382.473563:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564811904:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1777497382.473572:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497382.473595:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564811904:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 30us (233us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497382.473601:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00080000:1.0:1777497382.473631:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497382.473635:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497382.473638:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564811904:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1777497382.473646:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497382.473649:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497382.473651:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564811776:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:1.0:1777497382.473695:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497382.473698:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497382.473701:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497382.473705:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497382.473709:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3481 00000100:00080000:1.0:1777497382.473721:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497382.473735:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f83cf3800 x1863837564812032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497382.473750:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564811392:0@lo:400:kworker.0 00000100:00100000:1.0:1777497382.473776:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564812032:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1777497382.473800:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497382.473827:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812032 00000100:00100000:1.0:1777497382.473831:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812032 00000100:00100000:1.0:1777497382.473850:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3817 00000100:00100000:1.0:1777497382.473854:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564812032:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:1.0:1777497382.473864:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497382.473891:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564812032:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (90us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497382.473896:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3817 00000100:00080000:1.0:1777497382.473920:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497382.473924:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497382.473927:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564812032:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:0.0:1777497382.725363:0:3652:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546259072 offset 0 length 224: 4 00000100:00100000:0.0:1777497382.725405:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497382.725441:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497382.725467:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497382.725498:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497382.725526:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259328 00000100:00100000:0.0:1777497382.725536:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259328 00000100:00100000:0.0:1777497382.725589:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259200 00000100:00100000:0.0:1777497382.725592:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259200 00000100:00100000:0.0:1777497382.725611:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1007 00000100:00100000:0.0:1777497382.725620:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546259328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497382.725778:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259584 00000100:00100000:1.0:1777497382.725783:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259584 00000100:00100000:1.0:1777497382.725810:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259456 00000100:00100000:1.0:1777497382.725812:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259456 00000100:00100000:1.0:1777497382.725830:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2347 00000100:00100000:1.0:1777497382.725836:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546259584:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497382.725937:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1039 00000100:00100000:2.0:1777497382.725943:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2413:x1863837546259200:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:2.0:1777497382.725949:0:65418:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:0.0:1777497382.726987:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546259328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1363us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497382.726998:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1007 00000100:00100000:0.0:1777497382.727041:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2348 00000100:00100000:0.0:1777497382.727051:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546259456:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497382.727175:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546259584:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1338us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497382.727191:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2347 00000100:00100000:2.0:1777497382.727305:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2413:x1863837546259200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1360us (1836us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497382.727314:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1039 00000100:00080000:2.0:1777497382.729086:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497382.729109:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497382.729113:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497382.730871:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546259456:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 3811us (5360us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497382.730886:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2348 00000100:00100000:1.0:1777497382.750997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497382.751077:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259712 00000100:00100000:3.0:1777497382.751090:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259712 00000100:00100000:3.0:1777497382.751169:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1040 00000100:00100000:3.0:1777497382.751177:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546259712:12345-192.168.202.4@tcp:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1777497382.751201:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497382.751267:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546259712:12345-192.168.202.4@tcp:38:ptlrpcd_00_01.0 Request processed in 89us (281us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497382.751275:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1040 00010000:00010000:2.0:1777497383.074331:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497384.098248:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497385.123213:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497386.149450:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1777497386.533237:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497386.533246:0:8391:0:(genops.c:906:class_export_put()) final put ffff9240a6373800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497386.533309:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a6373800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1777497386.533364:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a6370000 for lustre-OST0000 00000001:00100000:1.0:1777497386.533748:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497386.533752:0:9460:0:(genops.c:906:class_export_put()) final put ffff9240bb685000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497386.533813:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb685000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1777497386.533854:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb681800 for lustre-OST0001 00000001:00100000:2.0:1777497386.534473:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1777497386.534485:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378731 is committed 00000020:00000080:2.0:1777497386.534488:0:72699:0:(genops.c:906:class_export_put()) final put ffff9240b5218000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497386.534569:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b5218000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1777497386.534618:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924083ad0000 for lustre-MDT0001 00000100:00100000:0.0:1777497387.042444:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564812160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497387.042520:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497387.042607:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812160 00000100:00100000:1.0:1777497387.042616:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812160 00000100:00100000:1.0:1777497387.042703:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1777497387.042713:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564812160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497387.042742:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497387.042790:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564812160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497387.042797:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00080000:0.0:1777497387.042907:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497387.042943:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564812160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497387.043158:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564812288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497387.043202:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497387.043403:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812288 00000100:00100000:3.0:1777497387.043409:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812288 00000100:00080000:0.0:1777497387.043558:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497387.043592:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1777497387.043601:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564812288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497387.043620:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497387.043691:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564812288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497387.043698:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:1.0:1777497387.043758:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564812288:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497387.170604:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497387.554299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497387.554306:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497387.554311:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497387.554318:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3511 00000100:00080000:0.0:1777497387.554324:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497387.554330:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497387.554353:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882b100 x1863837564812544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497387.554391:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497387.554395:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497387.554396:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497387.554400:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3511 00000100:00100000:1.0:1777497387.554530:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564812416:0@lo:400:kworker.0 00000400:00000100:1.0:1777497387.554582:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564812416 offset 0 length 224: 4 00000100:00100000:1.0:1777497387.554638:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497387.554644:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564812672:0@lo:400:kworker.0 00000100:00100000:1.0:1777497387.554691:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497387.554740:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812672 00000100:00100000:1.0:1777497387.554747:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812672 00000100:00100000:1.0:1777497387.554818:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1777497387.554828:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84f43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564812672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497387.554881:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84f43c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564812672:12345-0@lo:400:kworker.0 Request processed in 55us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497387.554888:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00080000:3.0:1777497387.555547:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497387.555607:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564812672:0@lo:400:kworker.0 00000100:00100000:2.0:1777497387.556364:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564812544:0@lo:38:kworker.0 00000100:00100000:2.0:1777497387.556421:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497387.556468:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812544 00000100:00100000:2.0:1777497387.556473:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812544 00000100:00100000:2.0:1777497387.556506:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1777497387.556511:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564812544:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497387.556530:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497387.556566:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564812544:12345-0@lo:38:kworker.0 Request processed in 54us (145us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497387.556571:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00080000:2.0:1777497387.556599:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497387.556603:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497387.556607:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564812544:0@lo:38:kworker.0 00000100:00080000:0.0:1777497387.556861:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497387.556866:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497387.556902:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882b480 x1863837564812800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497387.556943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497387.556947:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497387.556950:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497387.556953:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3511 00000100:00080000:0.0:1777497387.556956:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497387.556960:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497387.556972:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829880 x1863837564813056/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497387.556981:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497387.556983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497387.556985:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497387.556988:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3511 00000100:00080000:0.0:1777497387.556990:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497387.556993:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497387.557002:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882b100 x1863837564813184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497387.557089:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564812800:0@lo:38:kworker.0 00000100:00100000:2.0:1777497387.557146:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497387.557182:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564813056:0@lo:38:kworker.0 00000100:00100000:2.0:1777497387.557209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497387.557234:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564813184:0@lo:38:kworker.0 00000100:00100000:2.0:1777497387.557255:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497387.557282:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813056 00000100:00100000:2.0:1777497387.557287:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813056 00000100:00100000:2.0:1777497387.557309:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1777497387.557314:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564813056:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497387.557333:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497387.557370:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564813056:12345-0@lo:38:kworker.0 Request processed in 55us (160us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497387.557377:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3818 00000100:00100000:2.0:1777497387.557398:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812800 00000100:00100000:0.0:1777497387.557569:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813184 00000100:00100000:0.0:1777497387.557572:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813184 00000100:00100000:0.0:1777497387.557589:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1777497387.557592:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564813184:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497387.557600:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497387.557639:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564813184:12345-0@lo:38:kworker.0 Request processed in 45us (383us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497387.557663:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1777497387.557748:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812800 00000100:00100000:2.0:1777497387.557781:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1777497387.557786:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564812800:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497387.557797:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497387.557823:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564812800:12345-0@lo:38:kworker.0 Request processed in 36us (676us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497387.557829:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:2.0:1777497387.557856:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497387.557860:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497387.557864:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564812800:0@lo:38:kworker.0 00000100:00080000:2.0:1777497387.557872:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497387.557874:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497387.557877:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564813056:0@lo:38:kworker.0 00000100:00080000:2.0:1777497387.557884:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497387.557886:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497387.557889:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564813184:0@lo:38:kworker.0 00000100:00100000:1.0:1777497387.557984:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497387.557994:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564812928:0@lo:400:kworker.0 00000100:00100000:1.0:1777497387.558023:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497387.558049:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564812928 00000100:00100000:1.0:1777497387.558052:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564812928 00000100:00100000:1.0:1777497387.558088:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1777497387.558115:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564812928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497387.558373:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564812928:12345-0@lo:400:kworker.0 Request processed in 62us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497387.558380:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:1.0:1777497387.558506:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564812928:0@lo:400:kworker.0 00000100:00080000:3.0:1777497387.559115:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497387.838083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497387.838149:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:0.0:1777497387.838180:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546259840 offset 0 length 224: 4 00000100:00100000:0.0:1777497387.838199:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497387.838271:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260096 00000100:00100000:2.0:1777497387.838281:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260096 00000100:00100000:3.0:1777497387.838318:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260352 00000100:00100000:3.0:1777497387.838336:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260352 00000100:00100000:2.0:1777497387.838353:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1010 00000100:00100000:2.0:1777497387.838365:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546260096:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497387.838387:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260224 00000100:00100000:3.0:1777497387.838391:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260224 00000100:00100000:3.0:1777497387.838426:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2349 00000100:00100000:3.0:1777497387.838434:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546260352:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497387.838459:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546260096:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 95us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497387.838466:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1010 00000100:00100000:3.0:1777497387.838473:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546260352:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497387.838480:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2349 00000100:00100000:3.0:1777497387.838498:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2350 00000100:00100000:3.0:1777497387.838507:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546260224:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497387.838531:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546260224:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497387.838536:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2350 00000100:00080000:0.0:1777497387.838633:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497387.838638:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497387.838641:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497387.840331:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497387.840429:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546259968 00000100:00100000:2.0:1777497387.840440:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546259968 00000100:00100000:2.0:1777497387.840486:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1044 00000100:00100000:2.0:1777497387.840493:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546259968:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497387.840520:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497387.840761:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546259968:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 266us (436us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497387.840770:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1044 00010000:00010000:0.0:1777497388.194397:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497389.218716:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497390.243793:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497391.267412:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497392.162289:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564813312:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497392.162367:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497392.162472:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813312 00000100:00100000:1.0:1777497392.162481:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813312 00000100:00100000:1.0:1777497392.162553:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1777497392.162562:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564813312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497392.162600:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497392.162653:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564813312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497392.162660:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1777497392.162724:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564813312:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1777497392.162939:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497392.164162:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497392.164179:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564813440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497392.164232:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497392.164330:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813440 00000100:00100000:3.0:1777497392.164337:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813440 00000100:00100000:3.0:1777497392.164393:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1777497392.164402:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564813440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497392.164428:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8653248 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497392.164478:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564813440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497392.164505:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1777497392.164743:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564813440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497392.165061:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777497392.290413:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497392.674884:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564813568:0@lo:400:kworker.0 00000400:00000100:3.0:1777497392.674941:0:3660:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564813568 offset 0 length 224: 4 00000100:00080000:0.0:1777497392.675009:0:75273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497392.675015:0:75273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497392.675019:0:75273:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497392.675025:0:75273:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3516 00000100:00080000:0.0:1777497392.675029:0:75273:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777497392.675035:0:75273:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497392.675057:0:75273:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098828a80 x1863837564813696/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497392.675124:0:75273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497392.675128:0:75273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497392.675130:0:75273:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497392.675133:0:75273:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3516 00000100:00080000:0.0:1777497392.675136:0:75273:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777497392.675139:0:75273:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497392.675152:0:75273:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829180 x1863837564813952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497392.675191:0:75273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497392.675194:0:75273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497392.675196:0:75273:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497392.675199:0:75273:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3516 00000100:00080000:0.0:1777497392.675202:0:75273:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777497392.675206:0:75273:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497392.675216:0:75273:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882ad80 x1863837564814208/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497392.675271:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564813696:0@lo:38:kworker.0 00000100:00100000:1.0:1777497392.677275:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564814336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497392.680859:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564814080:0@lo:400:kworker.0 00000100:00080000:0.0:1777497392.681025:0:75273:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497392.681030:0:75273:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497392.681034:0:75273:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497392.681041:0:75273:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3516 00000100:00080000:0.0:1777497392.681047:0:75273:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777497392.681052:0:75273:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497392.681061:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564814464:0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.681179:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497392.681227:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814336 00000100:00100000:1.0:1777497392.681234:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814336 00000100:00100000:1.0:1777497392.681279:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:1.0:1777497392.681288:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564814336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.681356:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564814336:12345-0@lo:400:kworker.0 Request processed in 69us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497392.681363:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:1.0:1777497392.681403:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564814336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.681447:0:75273:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f83cf2d80 x1863837564814592/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497392.681483:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564813824:0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.681512:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497392.681547:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813824 00000100:00100000:1.0:1777497392.681550:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813824 00000100:00100000:1.0:1777497392.681604:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1777497392.681611:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564813824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.681646:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564813824:12345-0@lo:400:kworker.0 Request processed in 36us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497392.681652:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1777497392.681675:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564813824:0@lo:400:kworker.0 00000100:00080000:1.0:1777497392.681697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497392.683873:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497392.683934:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564813952:0@lo:38:kworker.0 00000100:00100000:2.0:1777497392.684001:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497392.684037:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813696 00000100:00100000:2.0:1777497392.684057:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813696 00000100:00100000:2.0:1777497392.684118:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564813952 00000100:00100000:2.0:1777497392.684122:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564813952 00000100:00100000:2.0:1777497392.684142:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1777497392.684148:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564813696:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497392.684171:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497392.684210:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564813696:12345-0@lo:38:kworker.0 Request processed in 61us (343us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497392.684216:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1777497392.684232:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1777497392.684236:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564813952:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497392.684245:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497392.684267:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564813952:12345-0@lo:38:kworker.0 Request processed in 29us (265us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497392.684272:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00080000:2.0:1777497392.684319:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497392.684324:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497392.684328:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564813952:0@lo:38:kworker.0 00000100:00100000:2.0:1777497392.684335:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564814208:0@lo:38:kworker.0 00000100:00100000:2.0:1777497392.684360:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497392.684383:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814208 00000100:00100000:2.0:1777497392.684386:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814208 00000100:00100000:2.0:1777497392.684403:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3819 00000100:00100000:2.0:1777497392.684407:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564814208:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497392.684417:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497392.684438:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564814208:12345-0@lo:38:kworker.0 Request processed in 30us (78us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497392.684449:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3819 00000100:00080000:2.0:1777497392.684472:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497392.684476:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497392.684479:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564814208:0@lo:38:kworker.0 00000100:00100000:2.0:1777497392.684500:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564814592:0@lo:38:kworker.0 00000100:00100000:2.0:1777497392.684520:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497392.684538:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814592 00000100:00100000:2.0:1777497392.684541:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814592 00000100:00100000:2.0:1777497392.684556:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1777497392.684560:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564814592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497392.684568:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497392.684602:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564814592:12345-0@lo:38:kworker.0 Request processed in 41us (81us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497392.684607:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00080000:2.0:1777497392.684627:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497392.684630:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497392.684633:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564814592:0@lo:38:kworker.0 00000100:00080000:2.0:1777497392.684641:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497392.684643:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497392.684646:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564813696:0@lo:38:kworker.0 00000100:00100000:3.0:1777497392.687217:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497392.687670:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814080 00000100:00100000:2.0:1777497392.687679:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814080 00000100:00100000:2.0:1777497392.687749:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:2.0:1777497392.687759:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564814080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497392.687843:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564814080:12345-0@lo:400:kworker.0 Request processed in 86us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497392.687850:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00080000:1.0:1777497392.687936:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497392.688502:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497392.688759:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564814080:0@lo:400:kworker.0 00000100:00100000:2.0:1777497392.692230:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814464 00000100:00100000:2.0:1777497392.692243:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814464 00000100:00100000:2.0:1777497392.692316:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1777497392.692326:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564814464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497392.692431:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564814464:12345-0@lo:400:kworker.0 Request processed in 107us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497392.692438:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:3.0:1777497392.692999:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564814464:0@lo:400:kworker.0 00000100:00100000:1.0:1777497392.957090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497392.957158:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:1.0:1777497392.957242:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546260480 offset 0 length 224: 4 00000100:00100000:1.0:1777497392.957260:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497392.957296:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497392.957327:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260864 00000100:00100000:1.0:1777497392.957339:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260864 00000100:00100000:1.0:1777497392.957394:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260992 00000100:00100000:1.0:1777497392.957397:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260992 00000100:00100000:1.0:1777497392.957421:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5826 00000100:00100000:1.0:1777497392.957430:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546260864:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1777497392.957458:0:25497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691b6e2 00000100:00080000:1.0:1777497392.957466:0:25497:0:(import.c:65:import_set_state_nolock()) ffff9240849d4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497392.957508:0:25497:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:1.0:1777497392.957686:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546260864:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 256us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497392.957693:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5826 00000100:00100000:1.0:1777497392.957708:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5827 00000100:00100000:1.0:1777497392.957715:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546260992:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1777497392.957726:0:25497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bb7a 00000100:00080000:1.0:1777497392.957731:0:25497:0:(import.c:65:import_set_state_nolock()) ffff92409c468000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497392.957754:0:25497:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969446 00010000:00010000:0.0:1777497392.957766:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497392.957776:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497392.957781:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497392.957831:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546260992:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 115us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497392.957838:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5827 00000100:00100000:3.0:1777497392.959267:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260736 00000100:00100000:3.0:1777497392.959277:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260736 00000100:00100000:3.0:1777497392.959416:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546260608 00000100:00100000:3.0:1777497392.959420:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546260608 00000100:00100000:3.0:1777497392.959447:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1013 00000100:00100000:3.0:1777497392.959457:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546260736:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497392.959525:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546260736:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (2444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497392.959532:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1013 00000100:00100000:3.0:1777497392.959547:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1048 00000100:00100000:3.0:1777497392.959551:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546260608:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497392.959582:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497392.959610:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546260608:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 57us (2452us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497392.959616:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1048 00010000:00010000:3.0:1777497392.960038:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497392.966382:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1777497393.319767:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497394.342722:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497395.367298:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497396.388211:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497397.282465:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564814720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497397.282548:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497397.282803:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814720 00000100:00100000:0.0:1777497397.282811:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814720 00000100:00080000:2.0:1777497397.282864:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497397.282876:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:0.0:1777497397.282885:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564814720:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497397.283002:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564814848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497397.283029:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.283116:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564814848 00000100:00100000:2.0:1777497397.283121:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564814848 00002000:00000024:0.0:1777497397.283138:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497397.283152:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:2.0:1777497397.283159:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564814848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497397.283174:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497397.283182:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564814720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 299us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497397.283189:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:2.0:1777497397.283201:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564814848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497397.283207:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00080000:2.0:1777497397.283218:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497397.283286:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564814848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497397.283318:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564814720:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777497397.413895:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497397.796300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497397.796308:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497397.796312:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497397.796320:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1777497397.796326:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497397.796331:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497397.796353:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ac000 x1863837564815104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497397.796378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497397.796381:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497397.796383:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497397.796386:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1777497397.796389:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497397.796392:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497397.796402:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ae680 x1863837564815360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497397.796448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497397.796452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497397.796453:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497397.796457:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1777497397.796460:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497397.796464:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497397.796491:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ace00 x1863837564815616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497397.796511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497397.796514:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497397.796516:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497397.796519:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3522 00000100:00080000:3.0:1777497397.796532:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497397.796535:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497397.796546:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f861de680 x1863837564816000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497397.796616:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564814976:0@lo:400:kworker.0 00000400:00000100:2.0:1777497397.796680:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564814976 offset 0 length 224: 4 00000100:00100000:2.0:1777497397.796713:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564815872:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.796741:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.796774:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497397.796780:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564815232:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.796823:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.796849:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564815104:0@lo:38:kworker.0 00000100:00100000:2.0:1777497397.796869:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.796883:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564815360:0@lo:38:kworker.0 00000100:00100000:2.0:1777497397.796901:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.796918:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564815616:0@lo:38:kworker.0 00000100:00100000:2.0:1777497397.796941:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.796957:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564816000:0@lo:38:kworker.0 00000100:00100000:2.0:1777497397.796975:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.797005:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815232 00000100:00100000:2.0:1777497397.797012:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815232 00000100:00100000:2.0:1777497397.797067:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815104 00000100:00100000:2.0:1777497397.797070:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815104 00000100:00100000:2.0:1777497397.797087:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815360 00000100:00100000:2.0:1777497397.797089:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815360 00000100:00100000:2.0:1777497397.797123:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816000 00000100:00100000:2.0:1777497397.797127:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816000 00000100:00100000:2.0:1777497397.797139:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1777497397.797149:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564815232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.797200:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564815232:12345-0@lo:400:kworker.0 Request processed in 53us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497397.797206:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1777497397.797221:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1777497397.797224:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564815104:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497397.797244:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497397.798171:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564815104:12345-0@lo:38:kworker.0 Request processed in 939us (1296us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497397.798190:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1777497397.798210:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1777497397.798214:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564815360:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497397.798229:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497397.798253:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564815360:12345-0@lo:38:kworker.0 Request processed in 38us (1351us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497397.798259:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1777497397.798270:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1777497397.798274:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564816000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497397.798284:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497397.798309:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564816000:12345-0@lo:38:kworker.0 Request processed in 33us (1333us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497397.798315:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1777497397.798346:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815616 00000100:00100000:2.0:1777497397.798351:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815616 00000100:00100000:2.0:1777497397.798375:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3820 00000100:00100000:2.0:1777497397.798379:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564815616:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497397.798388:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497397.798414:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564815616:12345-0@lo:38:kworker.0 Request processed in 34us (1472us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497397.798419:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3820 00000100:00080000:2.0:1777497397.798439:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497397.798557:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497397.798565:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497397.798569:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564815104:0@lo:38:kworker.0 00000100:00080000:2.0:1777497397.798590:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497397.798594:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497397.798596:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564815360:0@lo:38:kworker.0 00000100:00080000:2.0:1777497397.798604:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497397.798607:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497397.798610:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564815616:0@lo:38:kworker.0 00000100:00080000:2.0:1777497397.798616:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497397.798619:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497397.798621:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564816000:0@lo:38:kworker.0 00000100:00100000:2.0:1777497397.798681:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564815232:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.798723:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564815744:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.798754:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.798776:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497397.798782:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564815488:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.798802:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497397.798829:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815488 00000100:00100000:2.0:1777497397.798832:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815488 00000100:00100000:2.0:1777497397.798864:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1777497397.798870:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564815488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.798907:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564815488:12345-0@lo:400:kworker.0 Request processed in 37us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497397.798913:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00080000:2.0:1777497397.798928:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497397.798944:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564815488:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.798975:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815872 00000100:00100000:2.0:1777497397.798979:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815872 00000100:00100000:2.0:1777497397.799003:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564815744 00000100:00100000:2.0:1777497397.799005:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564815744 00000100:00100000:2.0:1777497397.799023:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1777497397.799030:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564815872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.799063:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564815872:12345-0@lo:400:kworker.0 Request processed in 35us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497397.799070:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1777497397.799081:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:2.0:1777497397.799086:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564815744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.799144:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564815744:12345-0@lo:400:kworker.0 Request processed in 58us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497397.799150:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:2.0:1777497397.799173:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564815744:0@lo:400:kworker.0 00000100:00100000:2.0:1777497397.799194:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564815872:0@lo:400:kworker.0 00000100:00100000:1.0:1777497398.083660:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:1.0:1777497398.083695:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546261120 offset 0 length 224: 4 00000100:00100000:1.0:1777497398.083772:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497398.083885:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546261248 00000100:00100000:0.0:1777497398.083897:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546261248 00000100:00100000:0.0:1777497398.083942:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546261376 00000100:00100000:0.0:1777497398.083946:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546261376 00000100:00100000:0.0:1777497398.083993:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1016 00000100:00100000:0.0:1777497398.084004:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546261376:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497398.084082:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546261376:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 80us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497398.084089:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1016 00000100:00100000:0.0:1777497398.084126:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1052 00000100:00100000:0.0:1777497398.084130:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546261248:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497398.084156:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497398.084183:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546261248:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 51us (532us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497398.084189:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1052 00000100:00080000:0.0:1777497398.084205:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:2.0:1777497398.109256:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546261504 offset 0 length 520: 4 00000100:00000400:2.0:1777497398.290299:0:3657:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497382/real 1777497382] req@ffff923f86226a00 x1863837564810752/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497398 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497398.290338:0:3657:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff923f86226a00 x1863837564810752/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497398.290347:0:3657:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1777497398.290352:0:3657:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1777497398.317309:0:3657:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1777497398.317323:0:3657:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1777497398.317332:0:3657:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f86226a00 x1863837564810752/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497398 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497398.317346:0:3657:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff92409882bb80 x1863837564812416/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497403 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497398.317366:0:3657:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff924098828000 x1863837564813568/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497408 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497398.317379:0:3657:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240867aed80 x1863837564814976/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497413 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1777497398.317388:0:3657:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1777497398.317390:0:3657:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1777497398.317391:0:3657:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1777497398.317393:0:3657:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1777497398.317458:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564814976:0@lo:400:kworker.0 00000100:00100000:2.0:1777497398.317469:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564812416:0@lo:400:kworker.0 00000100:00080000:2.0:1777497398.317510:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497398.317515:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00100000:0.0:1777497398.317685:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564813568:0@lo:400:kworker.0 00000100:00100000:3.0:1777497398.319791:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564810752:0@lo:400:kworker.0 00000100:00080000:2.0:1777497398.320148:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497398.328760:0:38121:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3294 00000100:00080000:2.0:1777497398.328773:0:38121:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497398.328818:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867aed80 x1863837564816128/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497398.329000:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564816128:0@lo:250:kworker.0 00000400:00000100:3.0:1777497398.329060:0:3656:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564816128 offset 0 length 520: 4 00010000:00010000:0.0:1777497398.434197:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497398.823142:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:1.0:1777497398.823150:0:9460:0:(genops.c:906:class_export_put()) final put ffff92409c46e000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:3.0:1777497398.823238:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497398.823242:0:8391:0:(genops.c:906:class_export_put()) final put ffff9240849d5000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:0.0:1777497398.823927:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46e000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0001 00000020:00000080:0.0:1777497398.826011:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d5000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0000 00000020:00000080:0.0:1777497398.826065:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c468000 for lustre-OST0001 00000020:00000080:0.0:1777497398.826087:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240849d4800 for lustre-OST0000 00010000:00010000:1.0:1777497399.458918:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497400.484379:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497401.516389:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497402.405139:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497402.405168:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497402.405233:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497402.405277:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816256 00000100:00100000:3.0:1777497402.405285:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816256 00000100:00100000:3.0:1777497402.405340:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1777497402.405349:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564816256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497402.405378:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497402.405418:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564816256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497402.405425:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00080000:3.0:1777497402.405453:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497402.405497:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564816256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497402.409626:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497402.409649:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564816384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497402.409719:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497402.409842:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816384 00000100:00100000:2.0:1777497402.409850:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816384 00000100:00100000:2.0:1777497402.409916:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1777497402.409934:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564816384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497402.409976:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497402.410020:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564816384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497402.410028:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:2.0:1777497402.410071:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564816384:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777497402.410185:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497402.530261:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497403.209788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497403.213000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497403.228979:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546261760 00000100:00100000:0.0:1777497403.228992:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546261760 00000100:00100000:0.0:1777497403.229060:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546261632 00000100:00100000:0.0:1777497403.229064:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546261632 00000100:00100000:0.0:1777497403.229085:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1017 00000100:00100000:0.0:1777497403.229108:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546261760:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497403.229187:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546261760:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 95us (19409us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497403.229194:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1017 00000100:00100000:0.0:1777497403.229212:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00100000:0.0:1777497403.229216:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546261632:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497403.229236:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497403.229258:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546261632:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 41us (16268us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497403.229263:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00080000:0.0:1777497403.229280:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497403.429599:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497403.429606:0:38121:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1777497403.429608:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497403.429612:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497403.429624:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497403.429632:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1777497403.429636:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497403.429643:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497403.429752:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829880 x1863837564816512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497403.429807:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564816512:0@lo:38:kworker.0 00000100:00100000:1.0:1777497403.429872:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497403.433994:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497403.434001:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497403.434005:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497403.434013:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1777497403.434018:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497403.434025:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497403.434047:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882bb80 x1863837564816768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497403.434136:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564816640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497403.434202:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497403.434260:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816512 00000100:00100000:2.0:1777497403.434267:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816512 00000100:00100000:2.0:1777497403.434299:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816640 00000100:00100000:2.0:1777497403.434302:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816640 00000100:00100000:2.0:1777497403.434341:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1777497403.434349:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564816640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497403.434394:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564816640:12345-0@lo:400:kworker.0 Request processed in 46us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497403.434401:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1777497403.434415:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:2.0:1777497403.434419:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564816512:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497403.434438:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497403.435809:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564816768:0@lo:38:kworker.0 00000100:00100000:1.0:1777497403.435861:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497403.435915:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816768 00000100:00100000:1.0:1777497403.435921:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816768 00000100:00100000:1.0:1777497403.435953:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:1.0:1777497403.435959:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564816768:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497403.435976:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497403.436010:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564816768:12345-0@lo:38:kworker.0 Request processed in 50us (148us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497403.436016:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00080000:1.0:1777497403.436053:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497403.436058:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497403.436061:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564816768:0@lo:38:kworker.0 00000100:00080000:1.0:1777497403.436132:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497403.438211:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564816640:0@lo:400:kworker.0 00000100:00080000:0.0:1777497403.438742:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497403.438748:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497403.438751:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497403.438757:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1777497403.438761:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497403.438767:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497403.438790:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829c00 x1863837564817024/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497403.438822:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497403.438826:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497403.438842:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497403.438845:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1777497403.438847:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497403.438851:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497403.438863:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829180 x1863837564817408/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497403.438982:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564817152:0@lo:400:kworker.0 00000100:00100000:0.0:1777497403.439036:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497403.439062:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497403.439067:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564816896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497403.439084:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497403.439117:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564817280:0@lo:400:kworker.0 00000100:00100000:0.0:1777497403.439138:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497403.441727:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564817024:0@lo:38:kworker.0 00000100:00100000:3.0:1777497403.441797:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497403.441837:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564817408:0@lo:38:kworker.0 00000100:00100000:3.0:1777497403.441861:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497403.441905:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564816896 00000100:00100000:3.0:1777497403.441912:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564816896 00000100:00100000:3.0:1777497403.441967:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817408 00000100:00100000:3.0:1777497403.441970:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817408 00000100:00100000:3.0:1777497403.441991:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1777497403.442001:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564816896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497403.442055:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564816896:12345-0@lo:400:kworker.0 Request processed in 56us (2970us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497403.442062:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1777497403.442091:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1777497403.442113:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564817408:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497403.442133:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497403.442165:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564817408:12345-0@lo:38:kworker.0 Request processed in 51us (303us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497403.442171:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:3.0:1777497403.442187:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497403.442220:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564816896:0@lo:400:kworker.0 00000100:00080000:3.0:1777497403.442253:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497403.442258:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497403.442261:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564817408:0@lo:38:kworker.0 00000100:00100000:1.0:1777497403.442495:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817152 00000100:00100000:1.0:1777497403.442500:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817152 00000100:00100000:1.0:1777497403.442537:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817280 00000100:00100000:1.0:1777497403.442540:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817280 00000100:00100000:1.0:1777497403.442560:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1777497403.442566:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564817152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497403.442620:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564817152:12345-0@lo:400:kworker.0 Request processed in 55us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497403.442625:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1777497403.442637:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1777497403.442642:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564817280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497403.442683:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564817280:12345-0@lo:400:kworker.0 Request processed in 40us (3543us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497403.442689:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1777497403.442727:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564817280:0@lo:400:kworker.0 00000100:00100000:1.0:1777497403.442754:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564817152:0@lo:400:kworker.0 00000100:00100000:3.0:1777497403.443736:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817024 00000100:00100000:3.0:1777497403.443745:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817024 00000100:00100000:3.0:1777497403.443780:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3821 00000100:00100000:3.0:1777497403.443786:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564817024:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497403.443804:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497403.443853:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564817024:12345-0@lo:38:kworker.0 Request processed in 66us (2056us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497403.443859:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3821 00000100:00080000:3.0:1777497403.443892:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497403.443897:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497403.443901:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564817024:0@lo:38:kworker.0 00000100:00100000:2.0:1777497403.481817:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564816512:12345-0@lo:38:kworker.0 Request processed in 47386us (51935us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497403.482973:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:2.0:1777497403.483037:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497403.483043:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497403.483048:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564816512:0@lo:38:kworker.0 00010000:00010000:2.0:1777497403.563415:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1777497404.262710:0:81807:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1777497404.262715:0:81807:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1777497404.262717:0:81807:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1777497404.266386:0:81807:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9240a6837800 00000020:01000004:3.0:1777497404.266421:0:81807:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1777497404.266437:0:81807:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1777497404.266452:0:81807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9240a62eb380) 00000020:00000080:3.0:1777497404.266479:0:81807:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1777497404.421539:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1777497404.424359:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1777497404.440730:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1777497404.443932:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1777497404.444749:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1777497404.446847:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1777497404.447163:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1777497404.447430:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1777497404.452435:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1777497404.453262:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1777497404.453543:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.454219:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.454449:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.454707:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.454913:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.456243:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.456470:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.456684:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.457126:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.457384:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.457645:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.457848:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.458813:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.459264:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.459655:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.459908:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.460697:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.460918:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.461207:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.461421:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.461656:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.461802:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.461967:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.462572:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.462759:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.462964:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.463276:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.463525:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.463740:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.463967:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.464498:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.464816:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.465155:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.465363:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.465649:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.465949:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1777497404.466903:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1777497404.467975:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.468472:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.468682:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.469161:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.477023:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1777497404.477729:0:81807:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1777497404.478775:0:81807:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1777497404.478991:0:81807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1777497404.479037:0:81807:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:0.0:1777497404.479045:0:81807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bc92 00000020:01000004:0.0:1777497404.479049:0:81807:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1777497404.479059:0:81807:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1777497404.479063:0:81807:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a6837800 from MGS 00000020:01000004:0.0:1777497404.479065:0:81807:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1777497404.479072:0:81807:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9240a695b380) 00000020:00000080:0.0:1777497404.479078:0:81807:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:0.0:1777497404.479206:0:81807:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a6837800 from MGS, refs=2 00080000:01000000:0.0:1777497404.479210:0:81807:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:0.0:1777497404.479213:0:81807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bca0 00010000:00010000:0.0:1777497404.479291:0:81807:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1777497404.484330:0:81807:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1777497404.485844:0:81811:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1777497404.485941:0:81807:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1777497404.485975:0:81807:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777497404.488983:0:81807:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1777497404.489397:0:81807:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1777497404.489664:0:81807:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1777497404.489670:0:81807:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1777497404.490783:0:81807:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1777497404.490791:0:81807:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1777497404.499545:0:81807:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1777497404.499558:0:81807:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1777497404.500178:0:81807:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1777497404.500202:0:81807:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:1.0:1777497404.500204:0:81807:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:1.0:1777497404.500207:0:81807:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:1.0:1777497404.500211:0:81807:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 62, was 0): CONNECTING 00000100:00100000:1.0:1777497404.500216:0:81807:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:3.0:1777497404.578633:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497405.602530:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497406.628379:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497407.522389:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564817664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497407.522447:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564817536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497407.522467:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497407.522523:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817664 00000100:00100000:3.0:1777497407.522531:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817664 00000100:00100000:3.0:1777497407.522601:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1777497407.522610:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564817664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497407.522642:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1777497407.533059:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497407.533194:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564817664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 10581us (10721us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497407.533205:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:2.0:1777497407.533215:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564817664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497407.536329:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497407.541997:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817536 00000100:00100000:2.0:1777497407.542014:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817536 00000100:00100000:2.0:1777497407.542128:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:2.0:1777497407.542140:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564817536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497407.542175:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497407.542252:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564817536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 116us (5930us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497407.542259:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:0.0:1777497407.542445:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564817536:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497407.542524:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497407.650502:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497408.331067:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497408.331453:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262144 00000100:00100000:1.0:1777497408.331476:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262144 00000100:00100000:1.0:1777497408.331559:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1020 00000100:00100000:1.0:1777497408.331570:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546262144:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497408.331652:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546262144:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.331659:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1020 00000100:00080000:3.0:1777497408.332021:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497408.332224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497408.332520:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546261888 00000100:00100000:2.0:1777497408.332528:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546261888 00000100:00100000:2.0:1777497408.332565:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1777497408.332571:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2411:x1863837546261888:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:2.0:1777497408.332594:0:81812:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 95f1b493-372d-4153-ad35-48e1115be1b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 3537 last 0 00000020:00000080:2.0:1777497408.332632:0:81812:0:(genops.c:1406:class_connect()) connect: client 95f1b493-372d-4153-ad35-48e1115be1b1, cookie 0x3e357265691bca7 00000100:00080000:2.0:1777497408.332756:0:81812:0:(import.c:65:import_set_state_nolock()) ffff92408a0a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497408.332800:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+4:2411:x1863837546261888:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 227us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.332820:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1777497408.336460:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497408.336563:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262016 00000100:00100000:0.0:1777497408.336573:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262016 00000100:00100000:0.0:1777497408.336627:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1057 00000100:00100000:0.0:1777497408.336636:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546262016:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497408.336660:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497408.336746:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546262016:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 108us (292us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497408.336753:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1057 00000100:00100000:3.0:1777497408.546471:0:3656:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497398/real 1777497398] req@ffff9240867aed80 x1863837564816128/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497408 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497408.546526:0:3656:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9240867aed80 x1863837564816128/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497408 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497408.546547:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497408.546985:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1777497408.547394:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564816128:0@lo:250:kworker.0 10000000:01000000:1.0:1777497408.547842:0:81807:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:1.0:1777497408.547859:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691b958 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b95f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.547869:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691b958 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b95f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.547875:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1777497408.547897:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.547907:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691b958 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b95f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.547926:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d88600/0x3e357265691b8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.547933:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d88600/0x3e357265691b8be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.547938:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.547941:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.547945:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d88600/0x3e357265691b8be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b8c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.547970:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d89000/0x3e357265691b8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b8e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.547976:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d89000/0x3e357265691b8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b8e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.547981:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.547985:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.547989:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d89000/0x3e357265691b8da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b8e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.547996:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691b904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b90b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548001:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691b904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b90b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548006:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548009:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548012:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691b904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b90b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548019:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691b912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b919 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548025:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691b912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b919 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548030:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548041:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548045:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691b912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b919 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548053:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d89a00/0x3e357265691b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b935 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548058:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d89a00/0x3e357265691b92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b935 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548062:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548066:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548068:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d89a00/0x3e357265691b92e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b935 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548076:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086d88e00/0x3e357265691b93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b943 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548081:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086d88e00/0x3e357265691b93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b943 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548086:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548088:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548091:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086d88e00/0x3e357265691b93c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b943 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548131:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b96d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548148:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691b966 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b96d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548162:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548166:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548170:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691b966 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b96d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548182:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691b8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b8d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548188:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691b8cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b8d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548193:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548195:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548198:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691b8cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b8d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548208:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691b8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b8ef expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548213:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691b8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b8ef expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548219:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497408.548222:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548224:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691b8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b8ef expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548234:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691b8f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b8fd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548250:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691b8f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b8fd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548254:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777497408.548257:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548260:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691b8f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b8fd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548268:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38600/0x3e357265691b920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b927 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548275:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38600/0x3e357265691b920 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b927 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548279:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777497408.548282:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548285:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38600/0x3e357265691b920 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b927 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.548293:0:81807:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e95200/0x3e357265691b94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691b951 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497408.548299:0:81807:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e95200/0x3e357265691b94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691b951 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.548303:0:81807:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1777497408.548306:0:81807:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:1.0:1777497408.548309:0:81807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e95200/0x3e357265691b94a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691b951 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497408.553897:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497408.553905:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1777497408.553910:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497408.553918:0:38121:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3527 00000100:00080000:0.0:1777497408.553923:0:38121:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497408.553929:0:38121:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.553964:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409882bb80 x1863837564817792/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497408.553979:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497408.553983:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497408.553985:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497408.553989:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3532 00000100:00080000:0.0:1777497408.553990:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497408.553993:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.554008:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829880 x1863837564817920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497408.554047:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497408.554051:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497408.554052:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497408.554056:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3532 00000100:00080000:0.0:1777497408.554058:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497408.554062:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.554087:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098828a80 x1863837564818176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497408.554125:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497408.554129:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497408.554130:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497408.554133:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:0.0:1777497408.554135:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497408.554139:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.554161:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924098829180 x1863837564818432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497408.554184:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497408.554187:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497408.554189:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497408.554192:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3532 00000100:00080000:0.0:1777497408.554195:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497408.554198:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.554207:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aedc7100 x1863837564818816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497408.554280:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564818560:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.554341:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.554386:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497408.554392:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564818304:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.554414:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.554455:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818304 00000100:00100000:0.0:1777497408.554461:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818304 00000100:00100000:0.0:1777497408.554516:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1777497408.554523:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564818304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.554570:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564818304:12345-0@lo:400:kworker.0 Request processed in 47us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.554577:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1777497408.554948:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564818304:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.554982:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564818048:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555008:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.555028:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497408.555034:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564818688:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555055:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.555079:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818560 00000100:00100000:0.0:1777497408.555083:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818560 00000100:00100000:0.0:1777497408.555139:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818688 00000100:00100000:0.0:1777497408.555143:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818688 00000100:00100000:0.0:1777497408.555162:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1777497408.555168:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564818560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555201:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564818560:12345-0@lo:400:kworker.0 Request processed in 33us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.555207:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:0.0:1777497408.555219:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2358 00000100:00100000:0.0:1777497408.555224:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564818688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555254:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564818688:12345-0@lo:400:kworker.0 Request processed in 30us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.555260:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2358 00000100:00100000:0.0:1777497408.555290:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564818560:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555321:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564818688:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555340:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818048 00000100:00100000:0.0:1777497408.555343:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818048 00000100:00100000:0.0:1777497408.555369:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1777497408.555468:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564818048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.555504:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564818048:12345-0@lo:400:kworker.0 Request processed in 130us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.555510:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1777497408.555539:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564818048:0@lo:400:kworker.0 00000100:00080000:0.0:1777497408.555780:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497408.556244:0:81807:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 63, was 0): CONNECTING 00000100:00080000:1.0:1777497408.556250:0:81807:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1777497408.556313:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564817792:0@lo:250:kworker.0 00000100:00100000:3.0:1777497408.556354:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.556528:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564817920:0@lo:38:kworker.0 00000100:00100000:3.0:1777497408.556554:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.556576:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564818176:0@lo:38:kworker.0 00000100:00100000:3.0:1777497408.556595:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.556688:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564818432:0@lo:38:kworker.0 00000100:00100000:3.0:1777497408.556715:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.556734:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564818816:0@lo:38:kworker.0 00000100:00100000:3.0:1777497408.556754:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.556903:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817792 00000100:00100000:2.0:1777497408.556910:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817792 00000100:00100000:2.0:1777497408.556941:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1777497408.556948:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3656:x1863837564817792:12345-0@lo:250:kworker.0 00010000:00080000:2.0:1777497408.556980:0:81812:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3537 last 0 00000020:00000080:2.0:1777497408.557005:0:81812:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691bcae 00000100:00080000:2.0:1777497408.557161:0:81812:0:(import.c:65:import_set_state_nolock()) ffff924098a6b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497408.557206:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837564817792:12345-0@lo:250:kworker.0 Request processed in 258us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.557212:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1777497408.557273:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818432 00000100:00100000:2.0:1777497408.557276:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818432 00000100:00100000:2.0:1777497408.557294:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3822 00000100:00100000:2.0:1777497408.557299:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564818432:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497408.557314:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497408.557339:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564818432:12345-0@lo:38:kworker.0 Request processed in 39us (622us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497408.557344:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3822 00000100:00100000:3.0:1777497408.564061:0:3656:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 23 00000100:00080000:3.0:1777497408.564077:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1777497408.564087:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1777497408.564105:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1777497408.564111:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1777497408.564115:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1777497408.564140:0:3656:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1777497408.564152:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564817792:0@lo:250:kworker.0 00000100:00080000:3.0:1777497408.564168:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497408.564184:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497408.564187:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564818432:0@lo:38:kworker.0 00000020:01000000:3.0:1777497408.564250:0:38121:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:3.0:1777497408.564270:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777497408.564274:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497408.564275:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497408.564277:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497408.564278:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497408.564279:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497408.564280:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497408.564282:0:38121:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497408.564283:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497408.564284:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497408.564323:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497408.564330:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777497408.564332:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497408.564333:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497408.564335:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497408.564336:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497408.564337:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497408.564338:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497408.564339:0:38121:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497408.564340:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497408.564341:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497408.564360:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497408.564364:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1777497408.564365:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497408.564367:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497408.564368:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497408.564369:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497408.564370:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497408.564371:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497408.564372:0:38121:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497408.564373:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497408.564480:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497408.564497:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1777497408.564529:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497408.564548:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564818944:0@lo:253:kworker.0 00000100:00100000:3.0:1777497408.564604:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.564729:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564819200:0@lo:253:kworker.0 00000100:00100000:3.0:1777497408.564757:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.564775:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497408.564781:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564819072:0@lo:253:kworker.0 00000100:00100000:3.0:1777497408.564804:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.564836:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818944 00000100:00100000:3.0:1777497408.564842:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818944 00000100:00100000:3.0:1777497408.564870:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819200 00000100:00100000:3.0:1777497408.564872:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819200 00000100:00100000:3.0:1777497408.564880:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819072 00000100:00100000:3.0:1777497408.564881:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819072 00000100:00100000:3.0:1777497408.564892:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1777497408.564899:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837564818944:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497408.564924:0:81812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:3.0:1777497408.565026:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777497408.565032:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3658:x1863837564819200:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497408.565046:0:81814:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:3.0:1777497408.565079:0:81817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1777497408.565207:0:81812:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 100 00000100:00100000:1.0:1777497408.570702:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564817920 00000100:00100000:1.0:1777497408.570717:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564817920 00000100:00100000:1.0:1777497408.570775:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818176 00000100:00100000:1.0:1777497408.570778:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818176 00000100:00100000:1.0:1777497408.570799:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564818816 00000100:00100000:1.0:1777497408.570802:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564818816 00000100:00100000:1.0:1777497408.570830:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1777497408.570837:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564817920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497408.570860:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497408.570936:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564817920:12345-0@lo:38:kworker.0 Request processed in 98us (14380us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497408.570943:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:1.0:1777497408.570959:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1777497408.570962:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564818176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497408.570972:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497408.570994:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564818176:12345-0@lo:38:kworker.0 Request processed in 30us (14397us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497408.571000:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:1.0:1777497408.571010:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1777497408.571013:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564818816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497408.571022:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497408.571042:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564818816:12345-0@lo:38:kworker.0 Request processed in 27us (14288us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497408.571064:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:1.0:1777497408.571131:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.571137:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497408.571142:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564817920:0@lo:38:kworker.0 00000100:00080000:1.0:1777497408.571151:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.571155:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497408.571158:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564818176:0@lo:38:kworker.0 00000100:00080000:1.0:1777497408.571167:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.571171:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497408.571173:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564818816:0@lo:38:kworker.0 00000100:00080000:1.0:1777497408.571212:0:81807:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1777497408.571223:0:81807:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1777497408.571255:0:81807:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1777497408.571260:0:81807:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1777497408.571358:0:81807:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1777497408.571392:0:81807:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1777497408.571396:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1777497408.571398:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497408.571399:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497408.571401:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497408.571402:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497408.571404:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497408.571405:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497408.571407:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497408.571408:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497408.571410:0:81807:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777497408.571412:0:81807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1777497408.571415:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777497408.571416:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497408.571433:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497408.571434:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497408.571435:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497408.571436:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497408.571437:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497408.571438:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497408.571439:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497408.571439:0:81807:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777497408.571462:0:81807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1777497408.571479:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1777497408.571517:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.571547:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497408.571584:0:81815:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1777497408.571590:0:81815:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1777497408.571687:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819328 00000100:00100000:1.0:1777497408.571692:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819328 00000100:00100000:1.0:1777497408.571762:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1777497408.571770:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564819072:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1777497408.571794:0:81818:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1777497408.577770:0:81819:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1777497408.577777:0:81819:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1777497408.577780:0:81819:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1777497408.577783:0:81819:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1777497408.578780:0:81819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1777497408.579229:0:81812:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777497408.579250:0:81812:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777497408.598606:0:81814:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1777497408.598938:0:81812:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777497408.599062:0:81812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1777497408.608236:0:81817:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1777497408.608246:0:81817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1777497408.608317:0:81817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608349:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497408.608359:0:81817:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000113841s 00010000:00010000:3.0:1777497408.608363:0:81817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608370:0:81817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608729:0:81817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608737:0:81817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608743:0:81817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497408.608747:0:81817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608755:0:81817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608768:0:81817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608776:0:81817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.608782:0:81817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691bcb5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497408.634140:0:81814:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497408.634153:0:81814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1777497408.634317:0:81817:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497408.634323:0:81817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497408.634348:0:81817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634365:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497408.634374:0:81817:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000113841s 00010000:00010000:0.0:1777497408.634378:0:81817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634385:0:81817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634391:0:81817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634398:0:81817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634417:0:81817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497408.634434:0:81817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634442:0:81817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634454:0:81817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634461:0:81817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.634467:0:81817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9000/0x3e357265691bcbc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497408.634711:0:81818:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497408.634961:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564819200:12345-0@lo:253:kworker.0 Request processed in 69925us (70198us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.634971:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1777497408.635012:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1777497408.635023:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:81807:x1863837564819328:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777497408.635064:0:81814:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777497408.635067:0:81814:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1777497408.635070:0:81814:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:1.0:1777497408.635075:0:81814:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:3.0:1777497408.635244:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497408.635247:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497408.635248:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497408.635249:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497408.635251:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497408.635252:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497408.635253:0:3658:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497408.635255:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497408.635257:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497408.635260:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564819200:0@lo:253:kworker.0 00000100:00100000:2.0:1777497408.635418:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837564818944:12345-0@lo:253:kworker.0 Request processed in 70518us (70813us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.635434:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:01000004:3.0:1777497408.635508:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497408.635510:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497408.635511:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497408.635512:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497408.635513:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497408.635514:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497408.635515:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497408.635517:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497408.635518:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497408.635520:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564818944:0@lo:253:kworker.0 20000000:01000000:3.0:1777497408.639808:0:81818:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777497408.639826:0:81818:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1777497408.639941:0:81817:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497408.639946:0:81817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497408.639967:0:81817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.639984:0:81817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497408.639993:0:81817:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000113841s 00010000:00010000:0.0:1777497408.639998:0:81817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640004:0:81817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640027:0:81817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640034:0:81817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640040:0:81817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497408.640044:0:81817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640051:0:81817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640062:0:81817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640071:0:81817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.640077:0:81817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8800/0x3e357265691bcc3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497408.642092:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:3658:x1863837564819072:12345-0@lo:253:kworker.0 Request processed in 70313us (77278us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.642144:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1777497408.642278:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777497408.642281:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777497408.642283:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497408.642284:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497408.642286:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497408.642287:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497408.642289:0:3658:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777497408.642290:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497408.642292:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777497408.642295:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564819072:0@lo:253:kworker.0 00000100:00100000:1.0:1777497408.643969:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:81807:x1863837564819328:12345-0@lo:253:mount.lustre.0 Request processed in 8942us (72443us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.643982:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1777497408.647642:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819328:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497408.647667:0:81807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497408.647691:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497408.647694:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497408.647695:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497408.647696:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497408.647697:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497408.647698:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497408.647700:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497408.647701:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497408.647703:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497408.647704:0:81807:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1777497408.647743:0:81807:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a6837800 from lustre-MDT0000 10000000:01000000:2.0:1777497408.647781:0:81807:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1777497408.647785:0:81807:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497408.647797:0:81807:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9240a6837800 10000000:01000000:2.0:1777497408.647802:0:81807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777497408.647809:0:81807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9240a6837800 10000000:01000000:2.0:1777497408.647813:0:81807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777497408.647817:0:81807:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240a6837800 from 1 10000000:01000000:2.0:1777497408.647821:0:81807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497408.647871:0:81807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.647884:0:81807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.647894:0:81807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497408.647920:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819456:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497408.647991:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.648092:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497408.651274:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819456 00000100:00100000:1.0:1777497408.651288:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819456 00000100:00100000:1.0:1777497408.651351:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1777497408.651360:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:81807:x1863837564819456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497408.651469:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497408.651494:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f84353200/0x3e357265691bcd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bcca expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.651522:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f84353200/0x3e357265691bcd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bcca expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.651532:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f84353200/0x3e357265691bcd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bcca expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.651541:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84353200, rc 0) 00000100:00100000:1.0:1777497408.654731:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:81807:x1863837564819456:12345-0@lo:101:mount.lustre.0 Request processed in 3362us (6729us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.654742:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1777497408.655371:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497408.655566:0:81807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.655579:0:81807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497408.655624:0:81807:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1777497408.655641:0:81807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.655648:0:81807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497408.655656:0:81807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497408.655758:0:81807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777497408.655766:0:81807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9240a6837800 10000000:01000000:2.0:1777497408.655774:0:81807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1777497408.655778:0:81807:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1777497408.655780:0:81807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1777497408.655812:0:81807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.655819:0:81807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.655827:0:81807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497408.655846:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497408.655900:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.655943:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.656007:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819584 00000100:00100000:3.0:1777497408.656015:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819584 00000100:00100000:3.0:1777497408.656071:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1777497408.656080:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:81807:x1863837564819584:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497408.656110:0:81818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497408.656124:0:81818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691bcdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bcd8 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.656143:0:81818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691bcdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bcd8 expref: 6 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.656153:0:81818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeec00/0x3e357265691bcdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bcd8 expref: 6 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.656162:0:81818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:3.0:1777497408.656218:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:81807:x1863837564819584:12345-0@lo:101:mount.lustre.0 Request processed in 139us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.656225:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497408.656365:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497408.656488:0:81807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.656497:0:81807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497408.656557:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497408.656581:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.656606:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.656665:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819712 00000100:00100000:3.0:1777497408.656669:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819712 00000100:00100000:3.0:1777497408.656741:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1777497408.656748:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:81807:x1863837564819712:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497408.656877:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81807:x1863837564819712:12345-0@lo:501:mount.lustre.0 Request processed in 130us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.656883:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1777497408.656937:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497408.656966:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497408.657001:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.663509:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497408.666816:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819840 00000100:00100000:1.0:1777497408.666833:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819840 00000100:00100000:1.0:1777497408.666916:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1777497408.666925:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81807:x1863837564819840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497408.668476:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81807:x1863837564819840:12345-0@lo:503:mount.lustre.0 Request processed in 1546us (11468us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.668488:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777497408.669532:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564819840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497408.669980:0:81820:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81820:1863837564819968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497408.670040:0:81820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.670075:0:81820:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2600 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.670125:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564819968 00000100:00100000:3.0:1777497408.670130:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564819968 00000100:00100000:3.0:1777497408.670167:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1777497408.670175:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81820:x1863837564819968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497408.672939:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81820:x1863837564819968:12345-0@lo:502:llog_process_th.0 Request processed in 2754us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.672953:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1777497408.673258:0:81820:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81820:1863837564819968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777497408.673310:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497408.673321:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.673323:0:81820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1777497408.673329:0:81820:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1777497408.673332:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497408.673345:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff923f82aab380) 00000020:00000080:2.0:1777497408.673369:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:2.0:1777497408.673402:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1777497408.673490:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:2.0:1777497408.673497:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bced 00000020:00000080:2.0:1777497408.673718:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1777497408.673723:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497408.673726:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.673728:0:81820:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1777497408.673730:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497408.673734:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.673736:0:81820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1777497408.673739:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497408.673746:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff923f82aa8000) 00000020:00000080:2.0:1777497408.673758:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:2.0:1777497408.673762:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1777497408.673764:0:81820:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1777497408.673767:0:81820:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1777497408.673773:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1777497408.673814:0:81820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a6837800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1777497408.673825:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff923f82aacd40) 00000020:00000080:2.0:1777497408.673844:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:2.0:1777497408.673895:0:81820:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:2.0:1777497408.673902:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd02 00000020:00000080:2.0:1777497408.673989:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1777497408.673995:0:81820:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1777497408.673999:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691bd09 00080000:01000000:2.0:1777497408.674004:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:2.0:1777497408.674008:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bd10 00010000:00010000:3.0:1777497408.680220:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497408.800236:0:81820:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1777497408.800368:0:81820:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6d03493e-1218-49f3-bdd0-b10716c402e0 idx: 0 lr: 0 srv lr: 94489280512 lx: 0 gen 22 00000001:00080000:2.0:1777497408.801616:0:81820:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 94489280512 lx: 0 gen 21 00000001:00000004:2.0:1777497408.801653:0:81820:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 94489280512 00000001:00080000:2.0:1777497408.801770:0:81820:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1777497408.801827:0:81820:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff924087dc8840: xid 1863837546253952, transno 94489280513, client gen 22, slot idx 0 00000020:00000080:2.0:1777497408.802303:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff923f84b08000) 00000020:00000080:2.0:1777497408.802319:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1777497408.802463:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:2.0:1777497408.802470:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bd2c 00000020:00000080:2.0:1777497408.803711:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497408.812670:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691bd33 00000020:00000080:1.0:1777497408.818779:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777497408.818792:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497408.818801:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497408.818804:0:81820:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777497408.818807:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497408.818809:0:81820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777497408.818811:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497408.818813:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497408.818814:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497408.818817:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497408.818818:0:81820:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497408.818820:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497408.818826:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497408.818828:0:81820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777497408.818832:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777497408.818887:0:81820:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777497408.818906:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497408.818909:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497408.818910:0:81820:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777497408.818913:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497408.818916:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497408.818917:0:81820:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777497408.818920:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497408.818925:0:81820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:1.0:1777497408.818952:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497408.818969:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240aecd8000) 00000020:00000080:1.0:1777497408.818990:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1777497408.818995:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497408.819060:0:81820:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777497408.819065:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777497408.819072:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bd41 00010000:00080000:1.0:1777497408.819123:0:81820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240a68ce000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497408.821825:0:81820:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1777497408.831548:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497408.831563:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1777497408.831609:0:81820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1777497408.831631:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd48 00000100:00080000:2.0:1777497408.831642:0:81820:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777497408.831648:0:81820:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9240a68ce000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497408.831685:0:81820:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867aed80 x1863837564820096/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497408.831715:0:81820:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1777497408.831797:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497408.831801:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.831803:0:81820:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1777497408.831805:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497408.831808:0:81820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1777497408.831810:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497408.831811:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497408.831812:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497408.831815:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.831816:0:81820:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497408.831818:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1777497408.831823:0:81820:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1777497408.831826:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497408.831827:0:81820:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1777497408.831830:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1777497408.831834:0:81820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1777497408.831858:0:81820:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1777497408.831860:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497408.831873:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff923f84b099c0) 00000020:00000080:2.0:1777497408.831890:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1777497408.831896:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1777497408.831956:0:81820:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1777497408.831961:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:2.0:1777497408.831966:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bd56 00010000:00080000:2.0:1777497408.831999:0:81820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f818b3800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1777497408.832199:0:81820:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00080000:2.0:1777497408.832451:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497408.832456:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497408.832459:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497408.832463:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1777497408.832467:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497408.832475:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497408.832492:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867adf80 x1863837564820224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497408.832522:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497408.832525:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497408.832527:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497408.832530:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1777497408.832532:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497408.832535:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497408.832546:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de3800 x1863837564820480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497408.832561:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497408.832564:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497408.832565:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497408.832568:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1777497408.832570:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497408.832573:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497408.832582:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de2a00 x1863837564820736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497408.833001:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564820096:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497408.833066:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.833138:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564820224:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.833161:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.833176:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564820480:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.833192:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.833206:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564820736:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.833224:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.833259:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820224 00000100:00100000:1.0:1777497408.833265:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820224 00000100:00100000:1.0:1777497408.833288:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820480 00000100:00100000:1.0:1777497408.833290:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820480 00000100:00100000:0.0:1777497408.833560:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820096 00000100:00100000:0.0:1777497408.833565:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820096 00000100:00100000:0.0:1777497408.833585:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820736 00000100:00100000:0.0:1777497408.833587:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820736 00000100:00100000:0.0:1777497408.833604:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1777497408.833611:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564820096:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1777497408.833638:0:80394:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3538 last 0 00000020:00000080:0.0:1777497408.833671:0:80394:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd5d 00000004:00100000:0.0:1777497408.833686:0:80394:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777497408.833780:0:80394:0:(import.c:65:import_set_state_nolock()) ffff923f82ab2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497408.833836:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564820096:12345-0@lo:38:llog_process_th.0 Request processed in 224us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.833844:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3823 00000100:00100000:0.0:1777497408.833862:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3824 00000100:00100000:0.0:1777497408.833866:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564820736:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777497408.833896:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564820736:12345-0@lo:38:kworker.0 Request processed in 28us (670us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777497408.833902:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3824 00000100:00100000:3.0:1777497408.834593:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564820352:0@lo:400:kworker.0 00000100:00100000:3.0:1777497408.834633:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497408.834769:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497408.834774:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497408.834776:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497408.834781:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3537 00000100:00080000:2.0:1777497408.834784:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497408.834800:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497408.834818:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de2d80 x1863837564821120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497408.834852:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564820608:0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835048:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564820992:0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835075:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.835117:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497408.835123:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564820864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835144:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.835167:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820992 00000100:00100000:2.0:1777497408.835171:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820992 00000100:00100000:2.0:1777497408.835202:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820864 00000100:00100000:2.0:1777497408.835204:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820864 00000100:00100000:2.0:1777497408.835223:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1777497408.835230:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564820992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835268:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564820992:12345-0@lo:400:kworker.0 Request processed in 38us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.835274:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2359 00000100:00100000:2.0:1777497408.835300:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1777497408.835306:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564820864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835329:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564820864:12345-0@lo:400:kworker.0 Request processed in 23us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.835334:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2360 00000100:00100000:2.0:1777497408.835368:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564820864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497408.835386:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564820992:0@lo:400:kworker.0 00000040:01000000:2.0:1777497408.835739:0:81820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777497408.835760:0:81820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1777497408.836037:0:81820:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 21, last_idx 22 00000040:00080000:2.0:1777497408.836720:0:81820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777497408.836745:0:81820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].23, 64 off9664 00000040:00080000:2.0:1777497408.836860:0:81820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5c:0x0].1, 64 off8256 00000100:00100000:1.0:1777497408.837309:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820352 00000100:00100000:1.0:1777497408.837317:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820352 00000100:00100000:1.0:1777497408.837359:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1777497408.837367:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564820352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497408.837449:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564820352:12345-0@lo:400:kworker.0 Request processed in 83us (2816us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.837456:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:1.0:1777497408.837472:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1777497408.837477:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564820224:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.837514:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564820224:12345-0@lo:38:kworker.0 Request processed in 36us (4353us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497408.837520:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1777497408.837532:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1777497408.837536:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564820480:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.837563:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564820480:12345-0@lo:38:kworker.0 Request processed in 25us (4369us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497408.837575:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1777497408.837612:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564821120:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.837643:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.837672:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497408.837681:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1777497408.837688:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1777497408.837692:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1777497408.837695:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240a68ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497408.837702:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564820096:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1777497408.837715:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.837719:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497408.837722:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564820224:0@lo:38:kworker.0 00000100:00080000:1.0:1777497408.837731:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.837734:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497408.837737:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564820480:0@lo:38:kworker.0 00000100:00080000:1.0:1777497408.837746:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.837749:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497408.837752:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564820736:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.837793:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564820352:0@lo:400:kworker.0 00000100:00100000:1.0:1777497408.837809:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821120 00000100:00100000:1.0:1777497408.837812:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821120 00000100:00100000:1.0:1777497408.837828:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:1.0:1777497408.837832:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564821120:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.837870:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564821120:12345-0@lo:38:kworker.0 Request processed in 37us (226us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497408.837877:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00080000:1.0:1777497408.837898:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.837902:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497408.837905:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564821120:0@lo:38:kworker.0 00000100:00100000:1.0:1777497408.838260:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564821248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497408.838288:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.838507:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.838605:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564820608 00000100:00100000:1.0:1777497408.838610:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564820608 00000100:00100000:1.0:1777497408.838644:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1777497408.838651:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564820608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497408.838691:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564820608:12345-0@lo:400:kworker.0 Request processed in 41us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.838697:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:1.0:1777497408.838723:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564820608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497408.839061:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821248 00000100:00100000:0.0:1777497408.839066:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821248 00000100:00100000:0.0:1777497408.839124:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3825 00000100:00100000:0.0:1777497408.839131:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564821248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497408.839158:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497408.839200:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564821248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.839207:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3825 00000040:00080000:0.0:1777497408.839283:0:81826:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:0.0:1777497408.839289:0:81826:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000100:00100000:3.0:1777497408.839569:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564821248:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1777497408.840245:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497408.840260:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777497408.840298:0:81820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1777497408.840315:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd64 00000100:00080000:3.0:1777497408.840322:0:81820:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777497408.840327:0:81820:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff923f818b3800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497408.840354:0:81820:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bdf80 x1863837564821376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497408.840478:0:81820:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1777497408.840548:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.840552:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.840554:0:81820:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1777497408.840557:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777497408.840561:0:81820:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1777497408.840562:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777497408.840564:0:81820:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777497408.840565:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777497408.840567:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.840569:0:81820:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777497408.840571:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777497408.840575:0:81820:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777497408.840577:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.840579:0:81820:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1777497408.840581:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777497408.840585:0:81820:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:3.0:1777497408.840605:0:81820:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777497408.840608:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497408.840619:0:81820:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9240a62e99c0) 00000020:00000080:3.0:1777497408.840634:0:81820:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:3.0:1777497408.840638:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777497408.840689:0:81820:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1777497408.840694:0:81820:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:3.0:1777497408.840699:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691bd72 00010000:00080000:3.0:1777497408.840728:0:81820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240849d5000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1777497408.840893:0:81820:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:3.0:1777497408.840953:0:81820:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777497408.840966:0:81820:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1777497408.841588:0:81820:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 21, last_idx 22 00000100:00100000:0.0:1777497408.841857:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564821376:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497408.841929:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.842040:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821376 00000100:00100000:2.0:1777497408.842048:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821376 00000100:00100000:2.0:1777497408.842085:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5828 00000100:00100000:2.0:1777497408.842109:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:0+-99:3656:x1863837564821376:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1777497408.842137:0:25497:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3538 last 0 00000020:00000080:2.0:1777497408.842163:0:25497:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd79 00002000:00100000:2.0:1777497408.842175:0:25497:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff924086e24800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1777497408.842180:0:25497:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1777497408.842183:0:25497:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1777497408.842238:0:25497:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1777497408.842267:0:25497:0:(import.c:65:import_set_state_nolock()) ffff9240b543a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497408.842315:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564821376:12345-0@lo:8:llog_process_th.0 Request processed in 221us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.842322:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5828 00000100:00100000:0.0:1777497408.842442:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777497408.842452:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777497408.842460:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777497408.842465:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1777497408.842468:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777497408.842487:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777497408.842492:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564821376:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497408.842568:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497408.842578:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564821504:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1777497408.842605:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.842638:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821504 00000100:00100000:0.0:1777497408.842643:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821504 00000100:00100000:0.0:1777497408.842680:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5829 00000100:00100000:0.0:1777497408.842686:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564821504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1777497408.842705:0:25489:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:642 count 1 00000100:00100000:0.0:1777497408.842766:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564821504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 80us (160us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497408.842772:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5829 00000100:00080000:0.0:1777497408.842791:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1777497408.842808:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9240aedc4700, transno 0 00000004:00080000:0.0:1777497408.842812:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9240aedc4700/1, rc -2, transno 0 00000100:00100000:0.0:1777497408.842818:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564821504:0@lo:6:osp-syn-0-0.0 00000040:00080000:0.0:1777497408.842912:0:81826:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000040:00080000:0.0:1777497408.842942:0:81826:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x58:0x0] at index 22 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1777497408.842954:0:81826:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x58:0x0] index 2 count 1 00000040:00080000:0.0:1777497408.843122:0:81826:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:0.0:1777497408.843126:0:81826:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000004:00080000:0.0:1777497408.843147:0:81826:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777497408.843169:0:81826:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3538184074153ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777497408.843175:0:81826:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1777497408.844217:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497408.844232:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564821632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497408.844288:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.844633:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821632 00000100:00100000:1.0:1777497408.844641:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821632 00000100:00100000:1.0:1777497408.844686:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1777497408.844694:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564821632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497408.844718:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497408.845191:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564821632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 496us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.845199:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000040:00080000:3.0:1777497408.845395:0:81820:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497408.845436:0:81820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].23, 64 off9664 00000040:00080000:3.0:1777497408.845582:0:81820:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5e:0x0].1, 64 off8256 00000004:00080000:0.0:1777497408.846584:0:81808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1777497408.846808:0:81828:0:(llog.c:800:llog_process_thread()) index: 22, lh_last_idx: 23 synced_idx: 0 lgh_last_idx: 23 00000040:00080000:1.0:1777497408.846820:0:81828:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497408.846957:0:81828:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000040:00080000:1.0:1777497408.846973:0:81828:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x5a:0x0] at index 22 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497408.847066:0:81828:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 23 synced_idx: 23 lgh_last_idx: 23 00000040:00080000:1.0:1777497408.847069:0:81828:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1777497408.847772:0:81820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497408.847784:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777497408.847819:0:81820:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777497408.847836:0:81820:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd80 00000100:00080000:3.0:1777497408.847846:0:81820:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777497408.847852:0:81820:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9240849d5000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497408.847882:0:81820:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bd180 x1863837564821760/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497408.847910:0:81820:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1777497408.847957:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.847961:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.847963:0:81820:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1777497408.847967:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497408.847971:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.847972:0:81820:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1777497408.847975:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1777497408.847978:0:81820:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1777497408.847980:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.847982:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.847984:0:81820:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1777497408.847986:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497408.847988:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.847990:0:81820:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1777497408.847993:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1777497408.848020:0:81820:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81820:1863837564821888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497408.848088:0:81820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.848157:0:81820:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240910fe000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.848280:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564821760:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497408.848313:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.850489:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821760 00000100:00100000:0.0:1777497408.850508:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821760 00000100:00100000:0.0:1777497408.850560:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1777497408.850568:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:3656:x1863837564821760:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497408.850603:0:25488:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3538 last 0 00000020:00000080:0.0:1777497408.850637:0:25488:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691bd87 00002000:00100000:0.0:1777497408.850654:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff923f82ab0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1777497408.850658:0:25488:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1777497408.850661:0:25488:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497408.850740:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1777497408.850770:0:25488:0:(import.c:65:import_set_state_nolock()) ffff923f82758000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497408.850854:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564821760:12345-0@lo:8:llog_process_th.0 Request processed in 286us (2539us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.850861:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5830 00000100:00100000:0.0:1777497408.850887:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564821888 00000100:00100000:0.0:1777497408.850891:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564821888 00000100:00100000:0.0:1777497408.850918:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777497408.850924:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81820:x1863837564821888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.851048:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81820:x1863837564821888:12345-0@lo:502:llog_process_th.0 Request processed in 123us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.851055:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777497408.851134:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777497408.851142:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777497408.851148:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777497408.851153:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1777497408.851156:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240849d5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777497408.851166:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777497408.851171:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564821760:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1777497408.851378:0:81828:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1777497408.851444:0:81828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3538192348106ns, next at 0ns, rc = 0 00080000:00080000:1.0:1777497408.851450:0:81828:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1777497408.851666:0:81820:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81820:1863837564821888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497408.851697:0:81820:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.851705:0:81820:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.851712:0:81820:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1777497408.851718:0:81820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:0.0:1777497408.852453:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497408.852470:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564822016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497408.852523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.852849:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822016 00000100:00100000:3.0:1777497408.852855:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822016 00000100:00100000:3.0:1777497408.852901:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1777497408.852909:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564822016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497408.852932:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497408.852987:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564822016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.852994:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00080000:3.0:1777497408.853013:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497408.853048:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564822016:0@lo:13:osp-pre-1-0.0 00000020:01000000:1.0:1777497408.853131:0:81807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1777497408.853157:0:81807:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1777497408.853176:0:81807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853189:0:81807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.853198:0:81807:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a6837800 from 1 10000000:01000000:1.0:1777497408.853201:0:81807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497408.853227:0:81807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853236:0:81807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853245:0:81807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497408.853262:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822144:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497408.853292:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.853315:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408c2f6480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497408.853339:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822144 00000100:00100000:1.0:1777497408.853343:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822144 00000100:00100000:1.0:1777497408.853365:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777497408.853371:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:81807:x1863837564822144:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497408.853379:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497408.853391:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bd8e expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853412:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bd8e expref: 8 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853436:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bd8e expref: 8 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853446:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84353000, rc 0) 00000100:00100000:1.0:1777497408.853470:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:81807:x1863837564822144:12345-0@lo:101:mount.lustre.0 Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.853476:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777497408.853509:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822144:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497408.853522:0:81807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.853530:0:81807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497408.854015:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822272:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1777497408.854049:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.854062:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.854612:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822272 00000100:00100000:0.0:1777497408.854618:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822272 00000100:00100000:0.0:1777497408.854833:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777497408.854843:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:81807:x1863837564822272:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777497408.854861:0:81818:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777497408.854882:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777497408.854886:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777497408.854890:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777497408.854893:0:81818:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 103 00000100:00100000:0.0:1777497408.854983:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:81807:x1863837564822272:12345-0@lo:256:mount.lustre.0 Request processed in 142us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.854991:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777497408.855076:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822272:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1777497408.855671:0:81807:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497408.855687:0:81807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.855698:0:81807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497408.855706:0:81807:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240a6837800 from 1 10000000:01000000:1.0:1777497408.855709:0:81807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777497408.855735:0:81807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.855743:0:81807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.855752:0:81807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497408.855769:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497408.855801:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.855938:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564821632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497408.856268:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226840 going to sleep for 11 seconds 00000004:00080000:1.0:1777497408.859037:0:81808:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1777497408.859207:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822400 00000100:00100000:3.0:1777497408.859219:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822400 00000100:00100000:3.0:1777497408.859270:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1777497408.859278:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:81807:x1863837564822400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497408.859295:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497408.859314:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefc00/0x3e357265691bda3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bd9c expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.859341:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefc00/0x3e357265691bda3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bd9c expref: 9 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.859352:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefc00/0x3e357265691bda3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bd9c expref: 9 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497408.859360:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefc00, rc 0) 00000100:00100000:3.0:1777497408.859583:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564822400:12345-0@lo:101:mount.lustre.0 Request processed in 305us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.859605:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777497408.859797:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497408.859814:0:81807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.859824:0:81807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497408.859909:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497408.859950:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.859983:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226840 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.860264:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822528 00000100:00100000:3.0:1777497408.860269:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822528 00000100:00100000:3.0:1777497408.860289:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1777497408.860295:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564822528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497408.860889:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564822528:12345-0@lo:501:mount.lustre.0 Request processed in 592us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.860895:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1777497408.860988:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497408.861024:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497408.861065:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.861119:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.861170:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822656 00000100:00100000:0.0:1777497408.861175:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822656 00000100:00100000:0.0:1777497408.861219:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777497408.861226:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564822656:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497408.861313:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564822656:12345-0@lo:503:mount.lustre.0 Request processed in 88us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.861320:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777497408.861538:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564822656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497408.862642:0:81830:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81830:1863837564822784:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497408.862705:0:81830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.862744:0:81830:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408795ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.862785:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822784 00000100:00100000:0.0:1777497408.862791:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822784 00000100:00100000:0.0:1777497408.862830:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1777497408.862838:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81830:x1863837564822784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.863313:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81830:x1863837564822784:12345-0@lo:502:llog_process_th.0 Request processed in 474us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.863321:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1777497408.863526:0:81830:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81830:1863837564822784:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497408.863551:0:81830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497408.863561:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.863563:0:81830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1777497408.863571:0:81830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a6837800 00000020:00000080:3.0:1777497408.863574:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777497408.863581:0:81830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.863583:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.863585:0:81830:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1777497408.863587:0:81830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497408.863589:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.863591:0:81830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1777497408.863595:0:81830:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a6837800 00000020:00000080:3.0:1777497408.863597:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777497408.863673:0:81830:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81830:1863837564822912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497408.863706:0:81830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.863734:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564822912 00000100:00100000:3.0:1777497408.863738:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564822912 00000100:00100000:3.0:1777497408.863765:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497408.863772:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81830:x1863837564822912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497408.863835:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81830:x1863837564822912:12345-0@lo:502:llog_process_th.0 Request processed in 64us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.863842:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497408.863873:0:81830:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408795ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.863883:0:81830:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81830:1863837564822912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497408.863899:0:81830:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497408.863903:0:81830:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497408.863905:0:81830:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1777497408.863908:0:81830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1777497408.864174:0:81807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1777497408.864198:0:81807:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497408.864214:0:81807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864225:0:81807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497408.864290:0:81807:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1777497408.864294:0:81807:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9240a6837800 10000000:01000000:0.0:1777497408.864298:0:81807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9240a6837800 10000000:01000000:0.0:1777497408.864301:0:81807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1777497408.864307:0:81807:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240a6837800 from 1 10000000:01000000:0.0:1777497408.864310:0:81807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497408.864333:0:81807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864348:0:81807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864358:0:81807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497408.864372:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777497408.864414:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.864438:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.864455:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823040 00000100:00100000:0.0:1777497408.864459:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823040 00000100:00100000:0.0:1777497408.864481:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777497408.864488:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:81807:x1863837564823040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497408.864496:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497408.864508:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9000/0x3e357265691bdb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bdaa expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864531:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9000/0x3e357265691bdb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bdaa expref: 10 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864541:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9000/0x3e357265691bdb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bdaa expref: 10 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864550:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9000, rc 0) 00000100:00100000:0.0:1777497408.864576:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823040:12345-0@lo:101:mount.lustre.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.864582:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777497408.864624:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497408.864636:0:81807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.864644:0:81807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497408.864687:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777497408.864708:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.864720:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.864731:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823168 00000100:00100000:0.0:1777497408.864734:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823168 00000100:00100000:0.0:1777497408.864751:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1777497408.864756:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823168:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777497408.864838:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823168:12345-0@lo:501:mount.lustre.0 Request processed in 81us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.864844:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1777497408.864870:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777497408.864892:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497408.864921:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.864932:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.864955:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823296 00000100:00100000:0.0:1777497408.864958:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823296 00000100:00100000:0.0:1777497408.864975:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1777497408.864980:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823296:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497408.865040:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823296:12345-0@lo:503:mount.lustre.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.865051:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1777497408.865085:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497408.865297:0:81831:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.865325:0:81831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.865340:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823424 00000100:00100000:0.0:1777497408.865343:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823424 00000100:00100000:0.0:1777497408.865361:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1777497408.865366:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.865437:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823424:12345-0@lo:502:llog_process_th.0 Request processed in 70us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.865443:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1777497408.865472:0:81831:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268600 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.865483:0:81831:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823424:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1777497408.865530:0:81831:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1777497408.865544:0:81831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9240a695cd40) 00000020:00000080:0.0:1777497408.865569:0:81831:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1777497408.865724:0:81831:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a6837800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1777497408.865729:0:81831:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a6837800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1777497408.865732:0:81831:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a6837800 4 00010000:00080000:0.0:1777497408.865760:0:81831:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240ae4b7800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497408.867323:0:81831:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1777497408.880082:0:81831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1777497408.880156:0:81831:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1777497408.880169:0:81831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691bdbf 00000100:00080000:0.0:1777497408.880181:0:81831:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497408.880188:0:81831:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240ae4b7800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497408.880230:0:81831:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aedc5500 x1863837564823552/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497408.880263:0:81831:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1777497408.881115:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564823552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497408.881201:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.881264:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823552 00000100:00100000:1.0:1777497408.881271:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823552 00000100:00100000:1.0:1777497408.881298:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1777497408.881304:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564823552:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497408.881352:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564823552:12345-0@lo:38:llog_process_th.0 Request processed in 46us (151us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497408.881359:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1777497408.881496:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497408.881506:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497408.881510:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497408.881514:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564823552:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777497408.882255:0:81831:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.882312:0:81831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.882338:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823680 00000100:00100000:0.0:1777497408.882342:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823680 00000100:00100000:0.0:1777497408.882369:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1777497408.883062:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.883198:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823680:12345-0@lo:502:llog_process_th.0 Request processed in 140us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.883206:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1777497408.883259:0:81831:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268600 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.883278:0:81831:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.883320:0:81831:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497408.883351:0:81831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497408.883516:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823808 00000100:00100000:1.0:1777497408.883521:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823808 00000100:00100000:1.0:1777497408.883550:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1777497408.883557:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497408.883632:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81831:x1863837564823808:12345-0@lo:502:llog_process_th.0 Request processed in 76us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.883639:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1777497408.885087:0:81831:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.885131:0:81831:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81831:1863837564823808:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1777497408.885165:0:81831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1777497408.885247:0:81807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1777497408.885278:0:81807:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497408.885293:0:81807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.885305:0:81807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1777497408.885357:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1777497408.885360:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497408.885361:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497408.885363:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497408.885364:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497408.885366:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497408.885367:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497408.885369:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497408.885370:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497408.886186:0:81807:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497408.886191:0:81807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1777497408.886195:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777497408.886196:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497408.886198:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497408.886199:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497408.886200:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497408.886201:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497408.886202:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497408.886203:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497408.886204:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497408.886205:0:81807:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497408.886229:0:81807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1777497408.886248:0:81807:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777497408.886311:0:81807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.886331:0:81807:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.886694:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564823936 00000100:00100000:0.0:1777497408.886701:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564823936 00000100:00100000:0.0:1777497408.886742:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1777497408.886751:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777497408.886777:0:81812:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1777497408.886791:0:81812:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1777497408.896904:0:81812:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497408.896920:0:81812:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1777497408.897271:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:81807:x1863837564823936:12345-0@lo:253:mount.lustre.0 Request processed in 10516us (10955us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.897282:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 20000000:01000000:0.0:1777497408.897397:0:81817:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497408.897403:0:81817:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497408.897447:0:81817:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.897463:0:81817:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bd8e expref: 9 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.897472:0:81817:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.897512:0:81817:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 9 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497408.897526:0:81817:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 9 pid: 81815 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497408.897540:0:81817:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81817:1863837564824064:0@lo:104: 00000100:00100000:0.0:1777497408.897577:0:81817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497408.897620:0:81817:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.897658:0:81807:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:81807:1863837564823936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1777497408.897668:0:81807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1777497408.897672:0:81807:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1777497408.897673:0:81807:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497408.897675:0:81807:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497408.897677:0:81807:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497408.897678:0:81807:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497408.897680:0:81807:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497408.897681:0:81807:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497408.897683:0:81807:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497408.897685:0:81807:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497408.897686:0:81807:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1777497408.897700:0:81807:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1777497408.898067:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824064 00000100:00100000:2.0:1777497408.898075:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824064 00000100:00100000:2.0:1777497408.898147:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1777497408.898155:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:81817:x1863837564824064:12345-0@lo:104: 00010000:00010000:2.0:1777497408.898167:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898212:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777497408.898217:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:81817:x1863837564824064:12345-0@lo:104: Request processed in 64us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.898223:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00010000:00010000:2.0:1777497408.898254:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497408.898259:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898266:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497408.898269:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898277:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497408.898284:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497408.898289:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497408.898312:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898318:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497408.898338:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898355:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f84353400/0x3e357265691bd8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691bd95 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898369:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497408.898371:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497408.898372:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497408.898379:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497408.898391:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564824192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497408.898429:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497408.898460:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824192 00000100:00100000:2.0:1777497408.898464:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824192 00010000:00010000:2.0:1777497408.898479:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 10 pid: 81815 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497408.898501:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1777497408.898507:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3660:x1863837564824192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497408.898518:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497408.898522:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 10 pid: 81815 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898532:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 10 pid: 81815 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898549:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898559:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497408.898583:0:6501:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001181573s 00010000:00010000:2.0:1777497408.898587:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898594:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898601:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898607:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898613:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497408.898616:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898623:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898631:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497408.898640:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497408.898666:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3660:x1863837564824192:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497408.898672:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1777497408.898704:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564824192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497408.901226:0:81817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f84353000/0x3e357265691bd95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691bd8e expref: 9 pid: 81815 timeout: 3638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497408.901245:0:81817:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:81817:1863837564824064:0@lo:104: 00010000:00010000:1.0:1777497408.901267:0:81817:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.901276:0:81817:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.901283:0:81817:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497408.901290:0:81817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9200/0x3e357265691bdc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81817 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777497408.915588:0:81807:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:2.0:1777497408.916058:0:81807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1777497408.916353:0:81839:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:2.0:1777497408.916407:0:81839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1777497408.918287:0:81807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1777497408.918710:0:81840:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824320:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497408.918789:0:81840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.918815:0:81840:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408795e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497408.918875:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824320 00000100:00100000:0.0:1777497408.918883:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824320 00000100:00100000:0.0:1777497408.918932:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3826 00000100:00100000:0.0:1777497408.918940:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824320:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497408.919024:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824320:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497408.919031:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3826 00000040:01000000:0.0:1777497408.919368:0:81807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1777497408.919406:0:81807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1777497408.919848:0:81807:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1777497408.919856:0:81807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1777497408.919887:0:81807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497408.921011:0:81807:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1777497408.921658:0:81807:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1777497408.921694:0:81807:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1777497408.921792:0:81807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1777497408.922277:0:81807:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4a:0x0] (8/32) registered 00000100:00100000:3.0:1777497408.922552:0:81840:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824320:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1777497408.922598:0:81840:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1777497408.922651:0:81840:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497408.922721:0:81840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.922757:0:81840:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408795ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497408.923755:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824448 00000100:00100000:3.0:1777497408.923766:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824448 00000100:00100000:3.0:1777497408.923827:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1777497408.923835:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497408.924020:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 184us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497408.924042:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3827 00000100:00100000:3.0:1777497408.924088:0:81840:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497408.924192:0:81840:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824576:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497408.924223:0:81840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497408.924245:0:81840:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091564300 going to sleep for 11 seconds 00000040:00080000:2.0:1777497408.925061:0:81839:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1777497408.925166:0:81839:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:1.0:1777497408.925729:0:81838:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:1.0:1777497408.925734:0:81838:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000100:00100000:1.0:1777497408.925954:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824576 00000100:00100000:1.0:1777497408.925964:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824576 00000100:00100000:1.0:1777497408.926022:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3828 00000100:00100000:1.0:1777497408.926046:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824576:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497408.926547:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:81840:x1863837564824576:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 502us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497408.926555:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3828 00000100:00100000:3.0:1777497408.931326:0:81840:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bce00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:81840:1863837564824576:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1777497408.931549:0:81840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497408.934059:0:81840:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777497408.934183:0:81840:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1777497408.934189:0:81840:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:1.0:1777497408.937149:0:81807:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 94489280513 00010000:00080000:1.0:1777497408.938216:0:81841:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 81841 00010000:02000000:1.0:1777497408.938228:0:81841:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1777497408.938232:0:81841:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1777497408.938236:0:81841:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1777497408.938362:0:81807:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1777497408.938481:0:81807:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1777497408.938508:0:81807:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:3.0:1777497408.938538:0:81807:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1777497408.939607:0:81807:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777497408.939857:0:81807:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777497409.698354:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497409.917328:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497409.922803:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262272 00000100:00100000:2.0:1777497409.922818:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262272 00000100:00100000:2.0:1777497409.922895:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1777497409.922906:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+4:41987:x1863837546262272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497409.922923:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497409.922953:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5ae00/0x3e357265691bdcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c081 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497409.922980:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5ae00/0x3e357265691bdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c081 expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497409.922991:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5ae00/0x3e357265691bdcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c081 expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497409.923000:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ae00, rc 0) 00000100:00100000:2.0:1777497409.923070:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546262272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 166us (5751us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497409.923078:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1777497409.935942:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497409.943598:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262400 00000100:00100000:0.0:1777497409.943612:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262400 00000100:00100000:3.0:1777497409.945557:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1777497409.945568:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546262400:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777497409.945593:0:81818:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:3.0:1777497409.945607:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777497409.945610:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777497409.945613:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777497409.945616:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777497409.945618:0:81818:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:0.0:1777497409.951894:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546262400:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 6319us (15952us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497409.951907:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1777497409.960359:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497409.960433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497409.960701:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262656 00000100:00100000:1.0:1777497409.960711:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262656 00000100:00100000:1.0:1777497409.960782:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1777497409.960792:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546262656:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497409.960810:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497409.960827:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f84353800/0x3e357265691bdd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c088 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497409.960863:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f84353800/0x3e357265691bdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c088 expref: 6 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497409.960873:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f84353800/0x3e357265691bdd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c088 expref: 6 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497409.960881:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84353800, rc 0) 00000100:00100000:1.0:1777497409.960945:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546262656:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 154us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497409.960969:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1777497409.961674:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262528 00000100:00100000:0.0:1777497409.961683:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262528 00000100:00100000:0.0:1777497409.961726:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1065 00000100:00100000:0.0:1777497409.961732:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546262528:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1777497409.961757:0:64885:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '6d03493e-1218-49f3-bdd0-b10716c402e0' at ffff9240911d7000, cookie 0x3e357265691bd17 00010000:00080000:0.0:1777497409.961762:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp recovering/t94489280514 exp ffff9240911d7000 cur 3539 last 1777497408 00010000:02000400:0.0:1777497409.961778:0:64885:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1777497409.961792:0:64885:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1777497409.961814:0:64885:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1777497409.961955:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f8275f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497409.962009:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546262528:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 Request processed in 276us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497409.962016:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1065 00000100:00100000:1.0:1777497409.964988:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497409.965075:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262784 00000100:00100000:0.0:1777497409.965085:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262784 00000100:00100000:0.0:1777497409.965164:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1777497409.965173:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546262784:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497409.965314:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546262784:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 142us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497409.965321:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1777497409.974714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497409.974998:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546255744 00000100:00100000:1.0:1777497409.975008:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546255744 00000100:00100000:1.0:1777497409.975081:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1066 00000100:00100000:1.0:1777497409.975091:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546255744:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00080000:1.0:1777497409.975132:0:63728:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280514, current: 94489280514, replaying 00000100:00100000:1.0:1777497409.975152:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546255744:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 64us (449us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497409.975158:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1066 00010000:00080000:0.0:1777497409.975421:0:81841:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1777497410.007428:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497410.007508:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546262912 00000100:00100000:3.0:1777497410.007526:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546262912 00000100:00100000:3.0:1777497410.007579:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1777497410.007588:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546262912:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.007746:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546262912:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 158us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.007753:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:3.0:1777497410.025447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497410.026497:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263040 00000100:00100000:2.0:1777497410.026508:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263040 00000100:00100000:2.0:1777497410.026576:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1777497410.026587:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546263040:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.026626:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.026645:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5be00/0x3e357265691bddb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c08f expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.026676:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5be00/0x3e357265691bddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c08f expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.026685:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5be00/0x3e357265691bddb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c08f expref: 8 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.026692:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5be00, rc 0) 00000100:00100000:2.0:1777497410.026765:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263040:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 178us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.026781:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1777497410.037468:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497410.037552:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263168 00000100:00100000:2.0:1777497410.037563:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263168 00000100:00100000:2.0:1777497410.037618:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:2.0:1777497410.037628:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263168:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.037760:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263168:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 133us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.037768:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1777497410.047144:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497410.047289:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263296 00000100:00100000:0.0:1777497410.047299:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263296 00000100:00100000:0.0:1777497410.047348:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1777497410.047357:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263296:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.047509:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5455850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263296:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 152us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.047516:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1777497410.069429:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497410.069644:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263424 00000100:00100000:2.0:1777497410.069653:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263424 00000100:00100000:2.0:1777497410.069839:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1777497410.069854:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546263424:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.069872:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.069895:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b600/0x3e357265691bde2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c096 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.069921:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b600/0x3e357265691bde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c096 expref: 9 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.069932:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b600/0x3e357265691bde2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c096 expref: 9 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.069941:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b600, rc 0) 00000100:00100000:2.0:1777497410.070007:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5456850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546263424:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 158us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.070014:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:1.0:1777497410.083666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497410.083738:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263552 00000100:00100000:0.0:1777497410.083748:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263552 00000100:00100000:0.0:1777497410.083797:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1777497410.083807:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546263552:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.083933:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5455050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546263552:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 127us (278us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497410.083942:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 10000000:01000000:1.0:1777497410.530381:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777497410.530388:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a6837800 from 104 10000000:01000000:1.0:1777497410.530393:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497410.530455:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.530467:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.530478:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497410.530505:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.530575:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497410.530635:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091564e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.531593:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824704 00000100:00100000:2.0:1777497410.531604:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824704 00000100:00100000:2.0:1777497410.531673:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1777497410.531683:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837564824704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.531698:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.531715:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b800/0x3e357265691bdf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bde9 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.531740:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b800/0x3e357265691bdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bde9 expref: 10 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.531752:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b800/0x3e357265691bdf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bde9 expref: 10 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.531761:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b800, rc 0) 00000100:00100000:2.0:1777497410.531821:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5454850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564824704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.531840:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1777497410.531955:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497410.531971:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.531981:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497410.532038:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.532074:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497410.532131:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091564e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.532192:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824832 00000100:00100000:0.0:1777497410.532197:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824832 00000100:00100000:0.0:1777497410.532234:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1777497410.532242:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564824832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777497410.532257:0:81812:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777497410.532273:0:81812:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777497410.532276:0:81812:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 104 00000100:00100000:0.0:1777497410.532354:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5457850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564824832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 113us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.532361:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1777497410.532442:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1777497410.532490:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777497410.532496:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.532504:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497410.532513:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497410.532515:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:2.0:1777497410.532518:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497410.532537:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.532543:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.532551:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.532563:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.532584:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.532604:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.532651:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564824960 00000100:00100000:0.0:1777497410.532655:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564824960 00000100:00100000:0.0:1777497410.532682:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1777497410.532688:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564824960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.532695:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497410.532703:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9600/0x3e357265691bdfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691bdf7 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.532718:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9600/0x3e357265691bdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691bdf7 expref: 11 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.532725:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9600/0x3e357265691bdfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691bdf7 expref: 11 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.532732:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9600, rc 0) 00000100:00100000:0.0:1777497410.532760:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5456450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564824960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.532766:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1777497410.532869:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564824960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.532879:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.532897:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.532949:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.532972:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.532990:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.533041:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825088 00000100:00100000:0.0:1777497410.533045:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825088 00000100:00100000:0.0:1777497410.533070:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1777497410.533076:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564825088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.533210:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5457450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564825088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.533217:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1777497410.533567:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.533597:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.533636:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.533668:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.533730:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825216 00000100:00100000:0.0:1777497410.533734:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825216 00000100:00100000:0.0:1777497410.533762:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1777497410.533768:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564825216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.533847:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5457c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564825216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.533853:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1777497410.533930:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497410.535412:0:81901:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1777497410.535573:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1777497410.535604:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497410.535612:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.535624:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.535632:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497410.535635:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 101 10000000:01000000:0.0:1777497410.535637:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497410.535679:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.535685:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.535694:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.535713:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.535764:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.535801:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497410.535852:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825344 00000100:00100000:1.0:1777497410.535858:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825344 00000100:00100000:1.0:1777497410.535898:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1777497410.535906:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564825344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497410.535918:0:81818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497410.535929:0:81818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f84352a00/0x3e357265691be0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be05 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.535953:0:81818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f84352a00/0x3e357265691be0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be05 expref: 12 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.535964:0:81818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f84352a00/0x3e357265691be0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be05 expref: 12 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.535972:0:81818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84352a00, rc 0) 00000100:00100000:1.0:1777497410.536015:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5454450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564825344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.536021:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1777497410.536690:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.536706:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.536714:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.536766:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825472:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.536804:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.536833:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497410.536925:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825472 00000100:00100000:1.0:1777497410.536930:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825472 00000100:00100000:1.0:1777497410.537312:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1777497410.537321:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564825472:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497410.537338:0:81818:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777497410.537356:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497410.537359:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497410.537362:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497410.537365:0:81818:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777497410.537367:0:81818:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 104 00000100:00100000:1.0:1777497410.537460:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5456050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564825472:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.537467:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1777497410.537534:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825472:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1777497410.537610:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777497410.537617:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.537625:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.537638:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1777497410.537641:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1777497410.537644:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497410.537666:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.537687:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.537697:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.537711:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.537737:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.540315:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.540936:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825600 00000100:00100000:2.0:1777497410.540947:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825600 00000100:00100000:2.0:1777497410.541026:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777497410.541036:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564825600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.541053:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.541072:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b000/0x3e357265691be1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be13 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.541129:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b000/0x3e357265691be1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be13 expref: 13 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.541141:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b000/0x3e357265691be1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be13 expref: 13 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.541150:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b000, rc 0) 00000100:00100000:2.0:1777497410.541210:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5456c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (3470us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.541230:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1777497410.541425:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.541442:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.541452:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.541525:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.541559:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.541592:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.542124:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825728 00000100:00100000:2.0:1777497410.542129:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825728 00000100:00100000:2.0:1777497410.542160:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1777497410.542168:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.542306:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5455c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.542313:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1777497410.544569:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.544625:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.548161:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.548226:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.548260:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825856 00000100:00100000:0.0:1777497410.548268:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825856 00000100:00100000:0.0:1777497410.548322:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1777497410.548330:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.563324:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5455450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 14982us (15160us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.563340:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1777497410.566126:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497410.567560:0:81903:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1777497410.569954:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1777497410.569998:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1777497410.570009:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.570021:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.570030:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1777497410.570034:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:0.0:1777497410.570037:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1777497410.570077:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.570084:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.570148:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.570186:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.570249:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.570290:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.570452:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564825984 00000100:00100000:3.0:1777497410.570460:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564825984 00000100:00100000:3.0:1777497410.570511:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1777497410.570520:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564825984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.570533:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497410.570544:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefe00/0x3e357265691be28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be21 expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.570567:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefe00/0x3e357265691be28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be21 expref: 14 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.570577:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefe00/0x3e357265691be28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be21 expref: 14 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.570585:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefe00, rc 0) 00000100:00100000:3.0:1777497410.570632:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5454050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564825984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.570638:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1777497410.571673:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564825984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.571705:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.571716:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.571732:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777497410.571737:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.571744:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.571751:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777497410.571754:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:0.0:1777497410.571756:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497410.571781:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.572000:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.572009:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.572039:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.572086:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.572159:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.573234:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826112 00000100:00100000:3.0:1777497410.573250:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826112 00000100:00100000:3.0:1777497410.573312:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777497410.573321:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564826112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.573336:0:81818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497410.573350:0:81818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeee00/0x3e357265691be36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be2f expref: -99 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.573373:0:81818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeee00/0x3e357265691be36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be2f expref: 15 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.573383:0:81818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeee00/0x3e357265691be36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be2f expref: 15 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.573391:0:81818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeee00, rc 0) 00000100:00100000:3.0:1777497410.573457:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5454c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.573464:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497410.573885:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.573902:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.573912:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.573981:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.574013:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.574050:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.574067:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826240 00000100:00100000:0.0:1777497410.574071:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826240 00000100:00100000:0.0:1777497410.574203:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497410.574212:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.574325:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.574331:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497410.574361:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.574387:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.574434:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.574445:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.574462:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826368 00000100:00100000:0.0:1777497410.574465:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826368 00000100:00100000:0.0:1777497410.574483:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777497410.574488:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.574552:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.574557:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777497410.574594:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497410.597578:0:81904:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1777497410.597815:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1777497410.597843:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497410.597853:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.597864:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.597873:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497410.597876:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:0.0:1777497410.597879:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497410.597919:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.597926:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.597936:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.597960:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.598030:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.598074:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497410.598450:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826496 00000100:00100000:1.0:1777497410.598458:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826496 00000100:00100000:1.0:1777497410.598508:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1777497410.598517:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564826496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497410.598530:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497410.598544:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f84352200/0x3e357265691be44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be3d expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.598567:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f84352200/0x3e357265691be44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be3d expref: 16 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.598578:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f84352200/0x3e357265691be44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be3d expref: 16 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.598592:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84352200, rc 0) 00000100:00100000:1.0:1777497410.598627:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.598634:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1777497410.598723:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.598736:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.598745:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.598943:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.598970:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.599002:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497410.599051:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826624 00000100:00100000:1.0:1777497410.599055:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826624 00000100:00100000:1.0:1777497410.599088:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1777497410.599135:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.599242:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.599248:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1777497410.601008:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.601064:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.601162:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.601197:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.603864:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826752 00000100:00100000:0.0:1777497410.603877:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826752 00000100:00100000:0.0:1777497410.603945:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777497410.603955:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.604149:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (2986us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.604155:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777497410.604220:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497410.614009:0:81905:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1777497410.614520:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1777497410.614562:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497410.614572:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.614584:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.614593:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1777497410.614595:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1777497410.614598:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497410.614634:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.614642:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.614653:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.614688:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.614751:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.614807:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084980b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.617068:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564826880 00000100:00100000:3.0:1777497410.617082:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564826880 00000100:00100000:3.0:1777497410.617167:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777497410.617177:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564826880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.617194:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497410.617211:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeea00/0x3e357265691be52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be4b expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.617236:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeea00/0x3e357265691be52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be4b expref: 17 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.617263:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeea00/0x3e357265691be52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be4b expref: 17 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.617271:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeea00, rc 0) 00000100:00100000:3.0:1777497410.617337:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564826880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.617344:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1777497410.617541:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564826880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.617560:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.617569:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.617644:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.617693:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.617731:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084980b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.618969:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827008 00000100:00100000:3.0:1777497410.618979:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827008 00000100:00100000:3.0:1777497410.619035:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777497410.619045:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564827008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.619221:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564827008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.619228:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1777497410.619502:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.619543:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.619588:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.619624:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084980b40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.622052:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827136 00000100:00100000:3.0:1777497410.622063:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827136 00000100:00100000:3.0:1777497410.622151:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777497410.622161:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564827136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.624015:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564827136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1844us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.624046:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.624652:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000040:00080000:1.0:1777497410.638603:0:81906:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1777497410.638928:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1777497410.638959:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1777497410.638970:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.638982:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497410.638991:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497410.638993:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:2.0:1777497410.638996:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497410.639042:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639050:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639061:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.639087:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.639188:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.639231:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.639265:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827264 00000100:00100000:2.0:1777497410.639272:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827264 00000100:00100000:2.0:1777497410.639314:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497410.639321:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564827264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.639335:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.639347:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a600/0x3e357265691be60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be59 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639368:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a600/0x3e357265691be60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be59 expref: 18 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639378:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a600/0x3e357265691be60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be59 expref: 18 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639385:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a600, rc 0) 00000100:00100000:2.0:1777497410.639432:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.639439:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497410.639500:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.639512:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.639520:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.639568:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.639593:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.639614:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.640028:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827392 00000100:00100000:0.0:1777497410.640034:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827392 00000100:00100000:0.0:1777497410.640063:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497410.640069:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.640208:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.640214:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1777497410.641317:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.641362:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.641432:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497410.641465:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827520 00000100:00100000:1.0:1777497410.641470:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827520 00000100:00100000:1.0:1777497410.641501:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1777497410.641509:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.641595:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497410.641601:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1777497410.641641:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497410.641652:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497410.654886:0:81907:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1777497410.655158:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1777497410.655190:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777497410.655201:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.655215:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497410.655226:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497410.655229:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:1.0:1777497410.655233:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497410.655275:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.655283:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497410.655294:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497410.655320:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.655383:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497410.655436:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.655659:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827648 00000100:00100000:2.0:1777497410.655668:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827648 00000100:00100000:2.0:1777497410.655734:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1777497410.655744:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564827648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.655759:0:81814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.655771:0:81814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a200/0x3e357265691be6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be67 expref: -99 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.655808:0:81814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a200/0x3e357265691be6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be67 expref: 19 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.655819:0:81814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a200/0x3e357265691be6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be67 expref: 19 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.655828:0:81814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a200, rc 0) 00000100:00100000:2.0:1777497410.655879:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564827648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.655886:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1777497410.656190:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.656205:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.656230:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497410.656291:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.656315:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.656331:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.656806:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827776 00000100:00100000:2.0:1777497410.656811:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827776 00000100:00100000:2.0:1777497410.656851:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777497410.656859:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564827776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.656993:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088fa5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564827776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.656999:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1777497410.657186:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.657220:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497410.657259:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497410.657288:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.657457:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564827904 00000100:00100000:3.0:1777497410.657461:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564827904 00000100:00100000:3.0:1777497410.657496:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1777497410.657504:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a63ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564827904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.657579:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a63ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564827904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.657585:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1777497410.657662:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564827904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497410.658597:0:81908:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1777497410.658967:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1777497410.658991:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497410.659000:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.659012:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497410.659020:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1777497410.659022:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1777497410.659025:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497410.659055:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.659076:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.659085:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497410.659127:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.659184:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.659215:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085215840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.659358:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828032 00000100:00100000:2.0:1777497410.659369:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828032 00000100:00100000:2.0:1777497410.659414:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1777497410.659422:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8412a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564828032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.659433:0:81818:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.659446:0:81818:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a400/0x3e357265691be7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be75 expref: -99 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.659466:0:81818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a400/0x3e357265691be7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be75 expref: 20 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.659476:0:81818:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a400/0x3e357265691be7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be75 expref: 20 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.659485:0:81818:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a400, rc 0) 00000100:00100000:2.0:1777497410.659521:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8412a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.659527:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1777497410.659654:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.659666:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.659674:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497410.659739:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.659761:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.659790:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085215840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.659958:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828160 00000100:00100000:2.0:1777497410.659962:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828160 00000100:00100000:2.0:1777497410.659991:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1777497410.659998:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8412a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.661372:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8412a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1369us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.661383:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1777497410.661614:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.661659:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.661717:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.661742:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085215840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.661923:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828288 00000100:00100000:2.0:1777497410.661929:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828288 00000100:00100000:2.0:1777497410.661967:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1777497410.661975:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.666631:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4647us (4905us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.666644:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1777497410.667014:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497410.668004:0:81909:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1777497410.668300:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1777497410.668337:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1777497410.668347:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.668370:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497410.668379:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777497410.668382:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:3.0:1777497410.668384:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777497410.668427:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.668434:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.668443:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497410.668467:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.668523:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.668554:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268900 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.676920:0:81815:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828416 00000100:00100000:2.0:1777497410.676936:0:81815:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828416 00000100:00100000:2.0:1777497410.676996:0:81815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1777497410.677007:0:81815:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564828416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.677026:0:81815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497410.677043:0:81815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a800/0x3e357265691be8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be83 expref: -99 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.677069:0:81815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a800/0x3e357265691be8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be83 expref: 21 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.677079:0:81815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a800/0x3e357265691be8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be83 expref: 21 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.677087:0:81815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a800, rc 0) 00000100:00100000:2.0:1777497410.677197:0:81815:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (8672us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.677204:0:81815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1777497410.677617:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.677636:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.677647:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497410.677726:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.677774:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.677799:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268900 going to sleep for 11 seconds 00000100:00100000:2.0:1777497410.678334:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828544 00000100:00100000:2.0:1777497410.678339:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828544 00000100:00100000:2.0:1777497410.678379:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1777497410.678385:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.678491:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497410.678508:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1777497410.679025:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.679063:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497410.679128:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497410.679152:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.679237:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828672 00000100:00100000:0.0:1777497410.679241:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828672 00000100:00100000:0.0:1777497410.679281:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1777497410.679289:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.679377:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.679387:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777497410.679547:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497410.683250:0:81911:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1777497410.683600:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1777497410.683627:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497410.683637:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.683649:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497410.683682:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1777497410.683685:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:0.0:1777497410.683688:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1777497410.683732:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.683739:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.683750:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497410.683782:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.683844:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497410.683885:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240849803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497410.684320:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828800 00000100:00100000:3.0:1777497410.684328:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828800 00000100:00100000:3.0:1777497410.684386:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777497410.684396:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564828800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497410.684419:0:81814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497410.684433:0:81814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef600/0x3e357265691be98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be91 expref: -99 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.684455:0:81814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef600/0x3e357265691be98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be91 expref: 22 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.684465:0:81814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef600/0x3e357265691be98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be91 expref: 22 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497410.684474:0:81814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef600, rc 0) 00000100:00100000:3.0:1777497410.684514:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564828800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497410.684520:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1777497410.688443:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.688469:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.688482:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497410.688504:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1777497410.688509:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.688516:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497410.688525:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1777497410.688528:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497410.688531:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1777497410.688562:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.688569:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.688577:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.688596:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.688663:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.688713:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.694497:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564828928 00000100:00100000:0.0:1777497410.694511:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564828928 00000100:00100000:0.0:1777497410.694562:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1777497410.694572:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564828928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497410.694590:0:81812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497410.694609:0:81812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8000/0x3e357265691bea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691be9f expref: -99 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.694645:0:81812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8000/0x3e357265691bea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691be9f expref: 23 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.694657:0:81812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8000/0x3e357265691bea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691be9f expref: 23 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497410.694679:0:81812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8000, rc 0) 00000100:00100000:0.0:1777497410.694756:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564828928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (6093us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497410.694763:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1777497410.694919:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564828928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497410.694938:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.694947:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497410.695022:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564829056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497410.695054:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497410.695119:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497410.699287:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829056 00000100:00100000:0.0:1777497410.699303:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829056 00000100:00100000:0.0:1777497410.699371:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1777497410.699380:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564829056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497410.699516:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564829056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (4461us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497410.699524:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1777497410.700896:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564829056:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1777497410.700943:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1777497410.700952:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.700963:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497410.724331:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497411.754615:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497412.644275:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564829184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497412.644394:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497412.644485:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829184 00000100:00100000:2.0:1777497412.644495:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829184 00000100:00100000:2.0:1777497412.644557:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1777497412.644579:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564829184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497412.644630:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497412.644687:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564829184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497412.644695:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00080000:2.0:1777497412.644718:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497412.644891:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564829184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497412.646818:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564829312:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497412.646886:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497412.647084:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829312 00000100:00100000:0.0:1777497412.647126:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829312 00000100:00100000:0.0:1777497412.647187:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1777497412.647197:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564829312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497412.647227:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497412.647270:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564829312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497412.647275:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1777497412.647335:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564829312:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497412.648677:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497412.771482:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497413.440980:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497413.441061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497413.441135:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263808 00000100:00100000:3.0:1777497413.441146:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263808 00000100:00100000:3.0:1777497413.441246:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1025 00000100:00100000:3.0:1777497413.441256:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546263808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497413.441324:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546263808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497413.441332:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1025 00000100:00100000:0.0:1777497413.447769:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263680 00000100:00100000:0.0:1777497413.447782:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263680 00000100:00100000:0.0:1777497413.447855:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1777497413.447866:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546263680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497413.447953:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546263680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 89us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497413.447960:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00080000:1.0:1777497413.453324:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1777497413.797270:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497414.023451:0:82075:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1777497414.184401:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497414.184407:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497414.184411:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497414.184422:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497414.184446:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5ba4380 x1863837564829568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497414.184475:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497414.184478:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497414.184480:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497414.184484:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497414.184492:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5ba7480 x1863837564829824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497414.184504:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497414.184507:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497414.184509:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497414.184513:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497414.184520:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5ba7100 x1863837564830080/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497414.184552:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497414.184555:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497414.184557:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497414.184561:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497414.184571:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f84364380 x1863837564830464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497414.184591:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1777497414.184594:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497414.184595:0:38121:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497414.184599:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240ae4b7800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497414.184608:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086ea0700 x1863837564830976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497414.184634:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564830208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.184691:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184716:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564830848:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.184736:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184753:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1777497414.184759:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564829440:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.184781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184803:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564830336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.184823:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184845:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564829568:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.184868:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184892:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564829824:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.184913:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184927:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564830080:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.184947:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184962:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564830464:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.184979:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.184990:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564830976:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.185007:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.185032:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564829696:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185053:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.185069:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564830592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185085:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.185220:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1777497414.185226:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564829952:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185245:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.185257:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564830720:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185275:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.185300:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830208 00000100:00100000:1.0:1777497414.185306:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830208 00000100:00100000:1.0:1777497414.185352:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830848 00000100:00100000:1.0:1777497414.185354:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830848 00000100:00100000:1.0:1777497414.185384:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830336 00000100:00100000:1.0:1777497414.185387:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830336 00000100:00100000:1.0:1777497414.185406:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830720 00000100:00100000:1.0:1777497414.185408:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830720 00000100:00100000:1.0:1777497414.185429:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2361 00000100:00100000:1.0:1777497414.185437:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564830208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185489:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564830208:12345-0@lo:400:kworker.0 Request processed in 53us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185497:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2361 00000100:00100000:1.0:1777497414.185512:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1777497414.185517:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564830848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185537:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564830848:12345-0@lo:400:kworker.0 Request processed in 21us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185543:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2362 00000100:00100000:1.0:1777497414.185551:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1777497414.185556:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564830336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185578:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564830336:12345-0@lo:400:kworker.0 Request processed in 22us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185582:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2363 00000100:00100000:1.0:1777497414.185593:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1777497414.185598:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185625:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564830720:12345-0@lo:400:kworker.0 Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185631:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2364 00000100:00100000:1.0:1777497414.185654:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829568 00000100:00100000:1.0:1777497414.185657:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829568 00000100:00100000:1.0:1777497414.185668:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829824 00000100:00100000:1.0:1777497414.185669:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829824 00000100:00100000:1.0:1777497414.185675:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830464 00000100:00100000:1.0:1777497414.185676:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830464 00000100:00100000:1.0:1777497414.185681:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830976 00000100:00100000:1.0:1777497414.185683:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830976 00000100:00100000:1.0:1777497414.185688:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829696 00000100:00100000:1.0:1777497414.185695:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829696 00000100:00100000:1.0:1777497414.185708:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829952 00000100:00100000:1.0:1777497414.185710:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829952 00000100:00100000:1.0:1777497414.185721:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1777497414.185726:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564829696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185751:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564829696:12345-0@lo:400:kworker.0 Request processed in 25us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185757:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1777497414.185768:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1777497414.185773:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564829952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.185795:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564829952:12345-0@lo:400:kworker.0 Request processed in 22us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.185800:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1777497414.185813:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1777497414.185816:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564829568:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497414.185836:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3543 last 0 00000020:00000080:1.0:1777497414.185869:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691bead 00000004:00100000:1.0:1777497414.185883:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497414.186000:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240a6370000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497414.186036:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837564829568:12345-0@lo:38:kworker.0 Request processed in 218us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.186042:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1777497414.186053:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1777497414.186057:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564829824:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497414.186068:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3543 last 0 00000020:00000080:1.0:1777497414.186088:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691beb4 00000100:00100000:0.0:1777497414.187278:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564829440 00000100:00100000:0.0:1777497414.187288:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564829440 00000100:00100000:0.0:1777497414.187338:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1777497414.187346:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497414.187409:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564829440:12345-0@lo:400:kworker.0 Request processed in 65us (2626us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.187416:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1777497414.188276:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1777497414.188284:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564830464:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777497414.188308:0:63727:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3543 last 0 00000020:00000080:0.0:1777497414.188338:0:63727:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691bebb 00000004:00100000:0.0:1777497414.188352:0:63727:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777497414.188392:0:63727:0:(import.c:65:import_set_state_nolock()) ffff923f8275b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497414.188433:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837564830464:12345-0@lo:38:kworker.0 Request processed in 149us (3453us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.188439:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1777497414.188457:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1777497414.188461:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564830976:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777497414.188473:0:63727:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3543 last 0 00000020:00000080:0.0:1777497414.188505:0:63727:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691bec2 00000004:00100000:0.0:1777497414.188510:0:63727:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777497414.188523:0:63727:0:(import.c:65:import_set_state_nolock()) ffff923f8275e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497414.188547:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564830976:12345-0@lo:38:kworker.0 Request processed in 84us (3539us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.188552:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1777497414.188576:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830080 00000100:00100000:0.0:1777497414.188582:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830080 00000100:00100000:0.0:1777497414.188603:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564830592 00000100:00100000:0.0:1777497414.188606:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564830592 00000100:00100000:0.0:1777497414.188630:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3829 00000100:00100000:0.0:1777497414.188634:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564830080:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1777497414.188647:0:8406:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9240911d0000, cookie 0x3e357265691bd1e 00010000:00080000:0.0:1777497414.188651:0:8406:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9240911d0000 cur 3543 last 1777497408 00000004:00100000:0.0:1777497414.188660:0:8406:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777497414.188674:0:8406:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497414.188707:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564830080:12345-0@lo:38:kworker.0 Request processed in 71us (3758us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.188713:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3829 00000100:00100000:0.0:1777497414.188725:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3830 00000100:00100000:0.0:1777497414.188729:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564830592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497414.188758:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564830592:12345-0@lo:400:kworker.0 Request processed in 28us (3671us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.188763:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3830 00010000:00080000:0.0:1777497414.188793:0:81841:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1777497414.188798:0:81841:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 94489280514 00000020:00080000:0.0:1777497414.188807:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.188811:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 94489280514, next_transno: 94489280514 00010000:00080000:0.0:1777497414.188815:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280514) 00000020:00080000:0.0:1777497414.188817:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.188827:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546255744 t94489280514 from 192.168.202.4@tcp req@ffff9240aedc7b80 x1863837546255744/t0(94489280514) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:165/0 lens 528/0 e 0 to 0 dl 1777497420 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00100000:1.0:1777497414.190175:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497414.190205:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240a6370800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497414.190251:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837564829824:12345-0@lo:38:kworker.0 Request processed in 4191us (5336us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.190258:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:1.0:1777497414.190285:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497414.190289:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497414.190292:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497414.190333:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564829440:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190347:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564830336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190356:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564830208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190376:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564830848:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190413:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564829952:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190424:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564830720:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190435:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564829696:0@lo:400:kworker.0 00000100:00100000:1.0:1777497414.190444:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564830592:0@lo:400:kworker.0 00010000:00080000:1.0:1777497414.190470:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b5ba4380 x1863837564829568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.190482:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 23 00000100:00080000:1.0:1777497414.191336:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9240b5ba4380 x1863837564829568/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.191346:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497414.191350:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497414.191363:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000004:00080000:0.0:1777497414.191739:0:81841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2864us 00000100:00100000:2.0:1777497414.192275:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564831104:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497414.192327:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497414.196442:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564829568:0@lo:38:kworker.0 00010000:00080000:1.0:1777497414.196485:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b5ba7480 x1863837564829824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.196501:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 23 00000100:00080000:1.0:1777497414.197410:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9240b5ba7480 x1863837564829824/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.197421:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497414.197426:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497414.197431:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497414.197436:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564829824:0@lo:38:kworker.0 00000100:00080000:1.0:1777497414.197462:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 23 00000100:00080000:1.0:1777497414.197470:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1777497414.197474:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1777497414.197476:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1777497414.197480:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1777497414.197483:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1777497414.197527:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831104 00000100:00100000:1.0:1777497414.197535:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831104 00000100:00100000:1.0:1777497414.208716:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564830080:0@lo:38:kworker.0 00010000:00080000:1.0:1777497414.208756:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f84364380 x1863837564830464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.208774:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 23 00000100:00080000:1.0:1777497414.209598:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff923f84364380 x1863837564830464/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497439 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.209622:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497414.209627:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497414.209631:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497414.209636:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564830464:0@lo:38:kworker.0 00010000:00080000:1.0:1777497414.209660:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924086ea0700 x1863837564830976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497414.209669:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 23 00000100:00080000:1.0:1777497414.209675:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1777497414.209678:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1777497414.209680:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b7800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497414.209684:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564830976:0@lo:38:kworker.0 00000100:00100000:1.0:1777497414.209748:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1777497414.209761:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564831104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497414.209798:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497414.209866:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564831104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (17539us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.209872:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3831 00000100:00100000:1.0:1777497414.209909:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564831104:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1777497414.209994:0:82083:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1777497414.209999:0:82083:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1777497414.210004:0:82083:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1777497414.210408:0:82083:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1777497414.213574:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564831232:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1777497414.213651:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497414.219518:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831232 00000100:00100000:2.0:1777497414.219534:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831232 00000100:00100000:2.0:1777497414.219584:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3832 00000100:00100000:2.0:1777497414.219593:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564831232:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1777497414.219613:0:23359:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240bc2ee300 x1863837564831232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1777497425 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497414.219625:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564831232:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 34us (5975us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497414.219631:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3832 00010000:00010000:0.0:1777497414.226586:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226609:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226623:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226636:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226643:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226650:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.226991:0:81841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227000:0:81841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227017:0:81841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227022:0:81841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497414.227025:0:81841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227031:0:81841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227043:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:0.0:1777497414.227045:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497414.227049:0:81841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227054:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691bec9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497414.227070:0:81841:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000093e7c01b reply state 000000006e9b466d transno 94489280514 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227080:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.227086:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924083c2b200) 00010000:00010000:0.0:1777497414.227088:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497414.227090:0:81841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1777497414.230825:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:0.0:1777497414.230851:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.230854:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000020:00080000:0.0:1777497414.230865:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.230867:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280515 00000100:00100000:0.0:1777497414.241720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497414.241799:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546256256 00000100:00100000:0.0:1777497414.241809:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546256256 00000100:00100000:0.0:1777497414.241861:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1071 00000100:00100000:0.0:1777497414.241870:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546256256:12345-192.168.202.4@tcp:36:rm.0 00010000:00080000:0.0:1777497414.241889:0:63727:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280515, current: 94489280515, replaying 00000100:00100000:0.0:1777497414.241899:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546256256:12345-192.168.202.4@tcp:36:rm.0 Request processed in 31us (191us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497414.241905:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1071 00000020:00080000:0.0:1777497414.241948:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.241952:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280515, next_transno: 94489280515 00010000:00080000:0.0:1777497414.241956:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280515) 00000020:00080000:0.0:1777497414.241958:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.241967:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546256256 t94489280515 from 192.168.202.4@tcp req@ffff9240aedc7100 x1863837546256256/t0(94489280515) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 512/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777497414.242046:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242061:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242073:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242085:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242130:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242137:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242219:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242227:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242234:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242459:0:81841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242467:0:81841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242472:0:81841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242478:0:81841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497414.242482:0:81841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242489:0:81841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242501:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x1:0x0].0x0 (ffff9240b565da00) 00010000:00010000:0.0:1777497414.242509:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777497414.242514:0:81841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242520:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691bee5 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242542:0:81841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242547:0:81841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242553:0:81841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242558:0:81841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497414.242561:0:81841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242566:0:81841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242573:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d900) 00010000:00010000:0.0:1777497414.242576:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497414.242578:0:81841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242583:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691bed7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497414.242594:0:81841:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dc0e7755 reply state 000000000b47ac86 transno 94489280515 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242617:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.242623:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924083c2b200) 00010000:00010000:0.0:1777497414.242625:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497414.242627:0:81841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1777497414.242692:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1777497414.242707:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.242709:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000020:00080000:0.0:1777497414.242713:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.242715:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280516 00000001:00080000:2.0:1777497414.247530:0:81808:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280514 is committed 00010000:00010000:2.0:1777497414.247586:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247598:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247605:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247611:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497414.247617:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247624:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247643:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924083c2b200) 00010000:00010000:2.0:1777497414.247646:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497414.247650:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.247656:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691bed0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497414.254718:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.256520:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258048 00000100:00100000:3.0:1777497414.256531:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258048 00000100:00100000:3.0:1777497414.256588:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1072 00000100:00100000:3.0:1777497414.256598:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546258048:12345-192.168.202.4@tcp:101:lfs.0 00010000:00080000:3.0:1777497414.256616:0:73210:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280516, current: 94489280516, replaying 00000100:00100000:3.0:1777497414.256628:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546258048:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 32us (1917us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497414.256636:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1072 00000020:00080000:0.0:1777497414.256748:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.256752:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280516, next_transno: 94489280516 00010000:00080000:0.0:1777497414.256756:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280516) 00000020:00080000:0.0:1777497414.256759:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.256767:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546258048 t94489280516 from 192.168.202.4@tcp req@ffff9240a6de2d80 x1863837546258048/t0(94489280516) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 536/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1777497414.256788:0:81841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497414.256811:0:81841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691beec lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c073 expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.256959:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.256973:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.256984:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.257004:0:81841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.257012:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.257018:0:81841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497414.260762:0:81841:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:0.0:1777497414.260788:0:81841:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x3e357265691bc6f 00000004:00080000:0.0:1777497414.260791:0:81841:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x3e357265691bc6f in new mfd 00010000:00010000:0.0:1777497414.260804:0:81841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260816:0:81841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260823:0:81841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260829:0:81841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dce00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497414.260833:0:81841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260841:0:81841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260854:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d900) 00010000:00010000:0.0:1777497414.260858:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497414.260869:0:81841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260876:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691bef3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497414.260889:0:81841:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002d3e6d13 reply state 0000000019e4c0f7 transno 94489280516 ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260901:0:81841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260908:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240b565da00) 00010000:00010000:0.0:1777497414.260911:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497414.260914:0:81841:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497414.260946:0:81841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691beec lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 10 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260957:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d900) 00010000:00010000:0.0:1777497414.260959:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497414.260963:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691beec lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c073 expref: 10 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.260977:0:81841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd600, rc 0) 00010000:00080000:0.0:1777497414.261049:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1777497414.261066:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.261069:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000020:00080000:0.0:1777497414.261073:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497414.261075:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280517 00000100:00100000:0.0:1777497414.312851:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.313206:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258304 00000100:00100000:3.0:1777497414.313218:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258304 00000100:00100000:3.0:1777497414.313282:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1073 00000100:00100000:3.0:1777497414.313293:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546258304:12345-192.168.202.4@tcp:101:lfs.0 00010000:00080000:3.0:1777497414.313334:0:63729:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280517, current: 94489280517, replaying 00000100:00100000:3.0:1777497414.313350:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546258304:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 60us (508us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497414.313357:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1073 00000020:00080000:3.0:1777497414.313385:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.313389:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280517, next_transno: 94489280517 00010000:00080000:3.0:1777497414.313393:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280517) 00000020:00080000:3.0:1777497414.313402:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.313410:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546258304 t94489280517 from 192.168.202.4@tcp req@ffff9240aedc5880 x1863837546258304/t0(94489280517) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 736/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:3.0:1777497414.313432:0:81841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497414.313456:0:81841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691bf08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c07a expref: -99 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497414.314207:0:81841:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x2:0x0]: returning size 0 00000004:00080000:3.0:1777497414.314399:0:81841:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x2:0x0], cookie = 0x3e357265691bc84 00000004:00080000:3.0:1777497414.314403:0:81841:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x3e357265691bc84 in new mfd 00010000:00010000:3.0:1777497414.314442:0:81841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691bf08 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c07a expref: 12 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.314459:0:81841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408ca41d00) 00010000:00010000:3.0:1777497414.314462:0:81841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497414.314466:0:81841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691bf08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c07a expref: 12 pid: 81841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.314480:0:81841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef000, rc 0) 00010000:00080000:3.0:1777497414.314539:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1777497414.316824:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.316833:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000020:00080000:3.0:1777497414.316839:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.316841:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280518 00000100:00100000:0.0:1777497414.320457:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.320575:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258688 00000100:00100000:3.0:1777497414.320587:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258688 00000100:00100000:3.0:1777497414.320641:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00100000:3.0:1777497414.320652:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2411:x1863837546258688:12345-192.168.202.4@tcp:35:lfs.0 00010000:00080000:3.0:1777497414.320679:0:63731:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280518, current: 94489280518, replaying 00000100:00100000:3.0:1777497414.320693:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2411:x1863837546258688:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 43us (244us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497414.320701:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 218 00000020:00080000:3.0:1777497414.320723:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.320727:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280518, next_transno: 94489280518 00010000:00080000:3.0:1777497414.320731:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280518) 00000020:00080000:3.0:1777497414.320734:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.320742:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546258688 t94489280518 from 192.168.202.4@tcp req@ffff9240aedc4380 x1863837546258688/t0(94489280518) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 392/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497414.320968:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1777497414.320980:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.320982:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000020:00080000:3.0:1777497414.320986:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.320988:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280519 00000100:00100000:3.0:1777497414.323632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497414.325037:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546258944 00000100:00100000:2.0:1777497414.325047:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546258944 00000100:00100000:2.0:1777497414.325159:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 219 00000100:00100000:2.0:1777497414.325169:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546258944:12345-192.168.202.4@tcp:35:lfs.0 00010000:00080000:2.0:1777497414.325189:0:63730:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 94489280519, current: 94489280519, replaying 00000100:00100000:2.0:1777497414.325206:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546258944:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 39us (1583us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497414.325213:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 219 00000020:00080000:3.0:1777497414.325358:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.325363:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 94489280519, next_transno: 94489280519 00010000:00080000:3.0:1777497414.325377:0:81841:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (94489280519) 00000020:00080000:3.0:1777497414.325380:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.325389:0:81841:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546258944 t94489280519 from 192.168.202.4@tcp req@ffff9240b50bf800 x1863837546258944/t0(94489280519) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 392/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497414.325849:0:81841:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1777497414.325865:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.325867:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000020:00080000:3.0:1777497414.325876:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.325878:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 94489280520 00000100:00100000:3.0:1777497414.331291:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.331686:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546263936 00000100:00100000:3.0:1777497414.331695:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546263936 00000100:00100000:3.0:1777497414.331747:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1028 00000100:00100000:3.0:1777497414.331757:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546263936:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1777497414.331783:0:63727:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240b50bf100 x1863837546263936/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 224/0 e 0 to 0 dl 1777497425 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497414.331800:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546263936:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 Request processed in 46us (519us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497414.331807:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1028 00000020:00080000:3.0:1777497414.331824:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.331827:0:81841:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 94489280520 00010000:00080000:3.0:1777497414.331831:0:81841:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:3.0:1777497414.331833:0:81841:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497414.331839:0:81841:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777497414.331842:0:81841:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1777497414.331931:0:81841:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 23, last_transno is 98784247808 00000001:00100000:3.0:1777497414.340709:0:81808:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:3.0:1777497414.340717:0:81808:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:3.0:1777497414.340737:0:81808:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 94489280519 is committed 00000001:00080000:3.0:1777497414.340781:0:81841:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:3.0:1777497414.340815:0:81841:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:3.0:1777497414.340829:0:81841:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9240bc2ee300 x1863837564831232/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:170/0 lens 224/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1777497414.340952:0:81841:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff9240b50bf100 x1863837546263936/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:170/0 lens 224/0 e 0 to 0 dl 1777497425 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1777497414.341001:0:81841:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:1.0:1777497414.345322:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345356:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345364:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345381:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497414.345386:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345394:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345414:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924083c2b200) 00010000:00010000:1.0:1777497414.345417:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497414.345422:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345428:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691bede lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345454:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345460:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345466:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345471:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497414.345479:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345484:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345492:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240b565da00) 00010000:00010000:1.0:1777497414.345495:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497414.345497:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.345503:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691befa lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 81841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497414.346529:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1777497414.346544:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff9240a6de0a80 x1863837564831232/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497430 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497414.346555:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9240a6de0a80 x1863837564831232/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497430 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497414.346562:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497414.346574:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777497414.346578:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564831232:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1777497414.346744:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564831360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497414.346797:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497414.346837:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831360 00000100:00100000:2.0:1777497414.346844:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831360 00000100:00100000:2.0:1777497414.346884:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1777497414.346891:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564831360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497414.346923:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1777497414.346960:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564831360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497414.346966:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3833 00000100:00100000:2.0:1777497414.346997:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564831360:0@lo:41:osp-pre-0-1.0 00000004:00000080:3.0:1777497414.355407:0:81841:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef07ecbe10 00100000:10000000:3.0:1777497414.355422:0:81841:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1777497414.370502:0:81829:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:3.0:1777497414.370546:0:81829:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81829:1863837564831488:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777497414.370693:0:81829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497414.370721:0:81829:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084980a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497414.370743:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831488 00000100:00100000:3.0:1777497414.370749:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831488 00000100:00100000:3.0:1777497414.370795:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5831 00000100:00100000:3.0:1777497414.370804:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:81829:x1863837564831488:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777497414.370831:0:8397:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -561 00002000:02000040:3.0:1777497414.370836:0:8397:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:705) 00000004:00080000:0.0:1777497414.371691:0:81827:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:0.0:1777497414.371720:0:81827:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81827:1863837564831616:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497414.371760:0:81827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497414.371788:0:81827:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497414.372150:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831616 00000100:00100000:0.0:1777497414.372156:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831616 00000100:00100000:0.0:1777497414.372188:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5832 00000100:00100000:0.0:1777497414.372196:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:81827:x1863837564831616:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1777497414.372216:0:25491:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 705 -> diff = -63 00002000:02000040:0.0:1777497414.372220:0:25491:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:705) 00002000:00010000:3.0:1777497414.383208:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497414.383219:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.383236:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497414.383239:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497414.383245:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.383262:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.383287:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.383296:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.383315:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497414.384050:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497414.384058:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384067:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497414.384071:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384080:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497414.384256:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.384261:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.384281:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.384282:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.384286:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.384297:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.384304:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.384310:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384458:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384467:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691bf16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384483:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497414.384491:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384497:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497414.384500:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384507:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384517:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.384525:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.384526:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.384666:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497414.384671:0:8397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691bf1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497414.384723:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497414.384819:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.384829:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.385501:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385515:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.385517:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.385522:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385546:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385890:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385899:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385915:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.385926:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.385930:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385937:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.385941:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385949:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385962:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385968:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691bf24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.385989:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.385991:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.385993:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.386064:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.386068:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386075:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.386076:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.386079:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386087:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386110:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386117:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386132:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.386139:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.386143:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386160:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.386163:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386171:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386181:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386187:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691bf2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386199:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.386200:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.386202:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.386240:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.386246:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386253:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.386254:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.386257:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386266:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386279:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386285:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.386298:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497414.387541:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1777497414.387718:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.387726:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387739:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.387741:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.387745:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387757:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387766:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387774:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387791:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.387853:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.387858:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387865:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.387867:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.387869:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387878:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387885:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387892:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387908:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497414.387915:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497414.387919:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387925:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.387929:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387938:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387960:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387967:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059e2b179/0x3e357265691bf39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387984:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.387987:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.387994:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.387996:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388003:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388013:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388020:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691bf40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388032:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.388033:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.388040:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.388081:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.388086:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388111:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.388113:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.388115:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388124:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388133:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388139:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388153:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.388160:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.388164:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388171:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.388174:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388192:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388202:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388209:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691bf47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388220:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.388221:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.388222:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.388255:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.388259:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388266:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.388267:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.388270:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388277:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388284:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388300:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.388311:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.388318:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497414.388448:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.388455:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497414.388459:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.388466:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.388486:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.388493:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f05bcca/0x3e357265691bf32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.388506:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.388508:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.388510:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.388516:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.390242:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390257:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.390262:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390271:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390290:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390297:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691bf4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390317:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.390319:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.390321:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.390430:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.390443:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390453:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.390455:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.390459:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390470:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390477:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390485:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390501:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.390511:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.390514:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390521:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.390524:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.390530:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.391468:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.391480:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691bf55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.391497:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.391499:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.391501:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.392507:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.392516:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392529:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392530:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392535:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392547:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392785:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392792:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392832:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.392894:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.392898:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392906:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392907:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392910:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392919:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392926:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392934:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392945:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1777497414.392974:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.392979:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.392985:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392986:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.392993:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393002:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393009:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393016:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393027:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777497414.393038:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497414.393043:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393050:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.393054:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393062:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393074:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393090:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691bf5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393123:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497414.393126:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393133:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.393136:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393143:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393152:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393159:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691bf63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393170:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.393172:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393178:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.393185:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393192:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393200:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393206:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691bf6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393216:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.393217:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.393219:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.393250:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.393254:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393261:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.393262:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.393265:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393273:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393281:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393292:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.393303:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.393309:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.393312:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497414.393839:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497414.393847:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497414.394961:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1777497414.395463:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.395476:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.395492:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.395509:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.395515:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691bf71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.395535:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.395537:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.395540:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.397010:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.397029:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397046:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397048:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397053:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397066:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397075:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397082:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397118:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.397128:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.397133:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397139:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.397143:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397150:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397174:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397181:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691bf78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397200:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.397201:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.397203:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.397246:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.397251:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397258:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397259:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397262:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397270:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397276:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397282:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397311:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.397698:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.397704:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397712:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397713:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.397716:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397724:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.397741:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.397970:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.397976:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.397985:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.397989:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.397997:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398010:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398032:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691bf7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398050:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.398051:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.398053:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.398857:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.398881:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.398946:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.398952:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398960:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.398961:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.398962:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.398965:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.398971:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398972:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.398976:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.398981:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398983:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.398989:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.398996:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.398996:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399004:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691bf86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399011:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.399018:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.399019:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399021:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399021:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.399022:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399028:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.399031:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399038:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399047:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399062:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187f3a92/0x3e357265691bf8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399075:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399076:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399078:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.399130:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.399134:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399142:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399143:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399146:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399154:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399162:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399169:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399181:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.399188:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.399197:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399204:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.399207:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399214:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399225:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399231:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc14aadc/0x3e357265691bf94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399245:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399247:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399248:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.399282:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.399286:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399294:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399295:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399298:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399315:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399321:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399328:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399347:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.399392:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1777497414.399396:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.399396:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399400:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399405:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.399408:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.399408:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399409:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399412:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399416:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399421:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399425:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399428:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399432:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab16ab41/0x3e357265691bf9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399435:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399445:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.399447:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.399448:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399457:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.399463:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.399466:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399472:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.399476:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497414.399490:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.399493:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399494:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399502:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399503:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.399504:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399506:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399512:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fea1795/0x3e357265691bfa2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399515:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399522:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.399524:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.399525:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.399527:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399529:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399540:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.399545:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.399549:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399555:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.399558:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399572:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399581:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399588:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001ff09f5/0x3e357265691bfa9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399600:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399601:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.399603:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.399642:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.399647:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399654:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399655:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.399658:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399665:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399672:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399688:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399700:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.399707:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.399709:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399715:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.399718:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399725:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399734:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.399741:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b47e767a/0x3e357265691bfb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.401465:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.401470:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.401472:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.402399:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.402417:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402432:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.402434:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.402439:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402452:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402461:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402469:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402490:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.402534:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.402538:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.402545:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.402547:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.402939:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.402947:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.402955:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.402959:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.402967:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.402982:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.403011:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8058a08/0x3e357265691bfb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.403030:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.403031:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.403033:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.403881:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.403899:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.403916:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.403925:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.403949:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.404037:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.404043:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404052:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404054:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404057:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404066:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404074:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404081:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404114:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497414.404132:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497414.404138:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404146:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.404150:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404159:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404174:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404181:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006705d075/0x3e357265691bfbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404200:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.404203:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404208:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.404211:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404218:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404240:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404247:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021d9c18a/0x3e357265691bfc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404260:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404261:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404263:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.404308:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.404313:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404321:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404323:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404326:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404335:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404342:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404350:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404388:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.404400:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.404404:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404409:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.404412:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404418:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404427:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404433:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf1dd54d/0x3e357265691bfcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404443:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404445:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404446:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.404482:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.404486:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404494:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404501:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404504:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404512:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404518:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404525:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404536:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497414.404577:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.404581:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404589:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.404589:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.404590:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.404593:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404595:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404602:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404603:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.404606:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404610:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404614:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404624:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404625:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404631:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000528dd700/0x3e357265691bfd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404638:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497414.404644:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.404644:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.404646:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404647:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404648:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404654:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.404656:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.404659:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404664:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404673:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404679:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d33435a/0x3e357265691bfda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.404690:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404692:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.404693:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497414.404730:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497414.404741:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497414.405508:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.405515:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405524:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.405525:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.405528:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405541:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405548:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405556:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405571:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.405579:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.405583:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405590:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.405593:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405613:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405625:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405632:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691bfe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.405648:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.405649:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.405651:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.406031:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.406037:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406046:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406048:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406050:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406059:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406067:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406082:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406121:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497414.406174:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.406179:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406187:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406188:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406191:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406200:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406207:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406213:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406224:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497414.406230:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497414.406234:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406250:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.406253:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406259:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406270:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406277:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691bfef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406289:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.406291:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406297:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.406300:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406307:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406315:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406330:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691bff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406341:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406343:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406344:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.406396:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2be:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.406401:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406409:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406410:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406413:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406421:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406428:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406433:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406445:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.406451:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.406460:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406467:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.406470:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406476:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406485:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406491:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691bffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2be:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406501:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406502:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406504:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.406537:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.406540:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406547:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406548:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406550:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406569:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406576:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406582:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406592:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.406599:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.406602:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406608:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.406611:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406617:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406626:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406633:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406650:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406651:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406653:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.406689:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.406694:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406701:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406702:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.406705:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406712:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406719:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406725:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406737:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.406742:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.406745:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406761:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.406764:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406771:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406781:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406787:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c00b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.406800:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406802:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.406803:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.406920:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.406922:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497414.406926:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.406936:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.406943:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.406949:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.407271:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.408619:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2bb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.408629:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408643:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.408645:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.408648:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408659:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408675:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408682:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408704:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497414.408752:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ba:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.408756:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408763:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.408765:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.408767:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408776:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408783:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408790:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.408804:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497414.408818:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497414.408878:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497414.408885:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.408892:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497414.408896:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.408903:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.408926:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.408933:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ba:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497414.408948:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.408950:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497414.408952:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1777497414.410003:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777497414.410951:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.410965:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.410969:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.410980:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.410998:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411005:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c012 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2bb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411029:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411031:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411033:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.411145:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411150:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411161:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411165:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497414.411165:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.411169:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411199:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411208:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411215:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497414.411225:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411227:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497414.411229:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411231:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411238:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497414.411239:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497414.411240:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411241:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411243:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411249:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411253:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411260:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411260:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411267:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050eb0c42/0x3e357265691bfe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411273:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411287:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.411291:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.411294:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411294:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411300:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dce00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.411303:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411310:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411320:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411327:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691c027 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497414.411339:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497414.411344:0:8397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411350:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411352:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497414.411352:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497414.411353:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411354:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497414.411356:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411372:0:8397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411375:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497414.411380:0:8397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411383:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.411387:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411388:0:8397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411394:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497414.411400:0:8397:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.411402:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411410:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411421:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411427:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f34bcc4/0x3e357265691c020 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411440:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.411443:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411450:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dca00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.411453:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411462:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411472:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411480:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691c02e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411499:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411500:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411502:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411507:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.411542:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411547:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411554:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411556:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411559:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411567:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411575:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411582:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411598:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497414.411601:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497414.411605:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411617:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497414.411620:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411627:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497414.411629:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411633:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411638:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411645:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d54fefd/0x3e357265691c035 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411648:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411650:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411653:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.411658:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497414.411659:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497414.411660:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411661:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411668:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411674:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411686:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.411692:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.411695:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411702:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.411705:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411713:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411733:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411740:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691c03c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411754:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411755:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411757:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.411795:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411800:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411808:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411809:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411812:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411834:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411842:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411849:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411871:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.411877:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.411880:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411887:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.411890:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411898:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411907:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411914:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dcdfe167/0x3e357265691c043 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411926:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411928:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.411929:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.411963:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.411968:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411975:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411980:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.411984:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.411993:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412000:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412007:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412017:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.412022:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.412026:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412031:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.412034:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412041:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412050:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412065:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005947ac74/0x3e357265691c04a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.412079:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.412081:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.412082:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.413044:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413050:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413062:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413064:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413067:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413077:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413086:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413107:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413127:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497414.413159:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413171:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413179:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413181:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413183:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413192:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413200:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413207:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413218:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497414.413228:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497414.413232:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413239:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413242:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413250:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413274:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413281:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691c051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413296:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.413298:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413304:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413307:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413314:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413322:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413328:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9de5f75/0x3e357265691c058 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413338:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413340:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413345:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.413394:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413399:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413406:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413408:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413410:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413419:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413427:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413434:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413445:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.413451:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.413454:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413460:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413463:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413481:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413491:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413498:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691c05f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413509:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413510:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413512:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.413542:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413546:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413553:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413555:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413557:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413565:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413572:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413588:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413599:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.413606:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.413610:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413617:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413620:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413628:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413638:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413646:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a590f888/0x3e357265691c066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413657:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413658:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413660:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.413692:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2b0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413702:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413709:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413711:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413714:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413722:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413729:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413736:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413747:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.413753:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.413756:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413762:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413764:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413771:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413791:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413798:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc2b77c/0x3e357265691c06d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413810:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413811:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413813:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.413861:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2af:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.413866:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413873:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413875:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.413878:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413886:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413894:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413901:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413921:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.413926:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.413930:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413936:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.413939:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413947:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413957:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413964:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b906b8c3/0x3e357265691c074 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2af:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.413975:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413977:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.413978:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414008:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ae:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414012:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414019:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414026:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414029:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414038:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414046:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414053:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414064:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414069:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414072:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414078:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414081:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414088:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414116:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414132:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e8bc85e/0x3e357265691c07b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ae:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414144:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414146:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414147:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414180:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ad:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414184:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414192:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414193:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414196:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414205:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414213:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414220:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414230:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414234:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414242:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414249:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414252:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414259:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414268:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414275:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691c082 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ad:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414287:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414288:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414289:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414319:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ac:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414323:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414331:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414332:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414335:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414353:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414360:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414378:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414390:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414397:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414400:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414407:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414409:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414417:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414427:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414434:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691c089 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ac:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414451:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414453:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414455:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414488:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ab:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414493:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414500:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414501:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414504:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414513:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414521:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414528:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414538:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414542:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414545:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414561:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414564:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414570:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414580:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414586:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691c090 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ab:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414599:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414601:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414602:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414639:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2aa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414644:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414652:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414653:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414656:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414665:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414678:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414686:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414697:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414702:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414705:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414712:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414715:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414723:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414732:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414738:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fa51d06/0x3e357265691c097 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2aa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414750:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414759:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414761:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414800:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414805:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414813:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414814:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414817:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414825:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414832:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414840:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414852:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.414859:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.414862:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414869:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.414872:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414889:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414899:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497414.414904:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414906:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080c1d926/0x3e357265691c09e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414917:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414919:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.414920:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.414953:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.414958:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414965:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414967:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.414969:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414977:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.414984:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415000:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415011:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.415018:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415021:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415027:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415031:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415038:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415049:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415056:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691c0a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415069:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415070:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415072:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.415120:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415131:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415139:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415141:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415144:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415153:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415161:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415169:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415180:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.415187:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415190:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415197:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415201:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415208:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415228:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415236:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016445048/0x3e357265691c0ac lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415249:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415250:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415253:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.415289:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415293:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415301:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415302:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415305:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415314:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415322:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415329:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415356:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497414.415408:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415412:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415420:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415421:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415424:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415432:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415439:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415446:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415456:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497414.415462:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497414.415465:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415471:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415475:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415486:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415497:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415504:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0d74e2f/0x3e357265691c0b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415518:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415520:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415526:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415529:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415537:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415544:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415551:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3ae61ca/0x3e357265691c0ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415573:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415574:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415576:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.415615:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415619:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415627:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415628:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415631:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415639:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415647:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415655:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415666:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.415671:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415674:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415691:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415694:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415702:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415712:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415719:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c0c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415731:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415733:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415734:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.415769:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415774:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415781:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415782:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415785:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415793:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415807:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415814:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415826:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.415832:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415835:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415842:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415846:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415854:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415863:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415870:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c1bf0de/0x3e357265691c0c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415883:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415888:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.415890:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497414.415921:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2a2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497414.415926:0:25491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415934:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415935:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497414.415938:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415947:0:25491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415955:0:25491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415963:0:25491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415973:0:25491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497414.415977:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497414.415980:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.415986:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497414.415989:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.416006:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.416016:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.416022:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8ec2f47/0x3e357265691c0cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497414.416034:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.416036:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497414.416037:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1777497414.416237:0:25491:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:1.0:1777497414.416323:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:81827:x1863837564831616:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44124us (44559us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.416332:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5832 00010000:00010000:0.0:1777497414.416453:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1777497414.425525:0:8397:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:1.0:1777497414.427976:0:81827:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81827:1863837564831616:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777497414.427997:0:81827:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2c1:0x0] from OST, last_created [0x280000401:0x2c1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:2.0:1777497414.428085:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564831744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497414.428190:0:81827:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81827:1863837564831872:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497414.428681:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:81829:x1863837564831488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 57876us (57985us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.428691:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5831 00000100:00100000:3.0:1777497414.428902:0:81829:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81829:1863837564831488:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1777497414.428912:0:81829:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2c1:0x0] from OST, last_created [0x2c0000401:0x2c1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:0.0:1777497414.428974:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564832000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497414.429012:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497414.429074:0:81829:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81829:1863837564832128:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777497414.429119:0:81829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497414.429133:0:81829:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084980a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497414.429194:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832000 00000100:00100000:0.0:1777497414.429215:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832000 00000100:00100000:0.0:1777497414.429289:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:0.0:1777497414.429297:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564832000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497414.429441:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497414.429483:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564832000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 187us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.429490:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:0.0:1777497414.429513:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832128 00000100:00100000:0.0:1777497414.429517:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832128 00000100:00100000:0.0:1777497414.429675:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1777497414.429683:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:81829:x1863837564832128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1777497414.429709:0:8398:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 706 00000100:00100000:2.0:1777497414.430425:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497414.430660:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831744 00000100:00100000:3.0:1777497414.430665:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831744 00000100:00100000:0.0:1777497414.431580:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:81829:x1863837564832128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1896us (2456us total) trans 4294969447 rc 0/0 00000100:00100000:0.0:1777497414.431588:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5833 00000100:00100000:0.0:1777497414.431644:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564832000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497414.432007:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1777497414.432020:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564831744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497414.432045:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 215488 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497414.432071:0:81827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497414.432088:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564831744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.432106:0:81827:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c840 going to sleep for 11 seconds 00000100:00100000:3.0:1777497414.432116:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:1.0:1777497414.432129:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564831872 00000100:00100000:1.0:1777497414.432134:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564831872 00000100:00100000:1.0:1777497414.432161:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5834 00000100:00100000:1.0:1777497414.432168:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:81827:x1863837564831872:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497414.432194:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564831744:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1777497414.432199:0:25485:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 706 00000100:00100000:3.0:1777497414.432712:0:81829:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:81829:1863837564832128:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1777497414.432723:0:81829:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2c1:0x0]-[0x2c0000401:0x2e1:0x0] 00000100:00100000:1.0:1777497414.433641:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:81827:x1863837564831872:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1471us (1568us total) trans 4294969451 rc 0/0 00000100:00100000:1.0:1777497414.433650:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5834 00000100:00100000:0.0:1777497414.433665:0:81827:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:81827:1863837564831872:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1777497414.433675:0:81827:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2c1:0x0]-[0x280000401:0x2e1:0x0] 00000100:00100000:3.0:1777497414.461663:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.461713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497414.461885:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264192 00000100:00100000:1.0:1777497414.461896:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264192 00000100:00100000:1.0:1777497414.461966:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1029 00000100:00100000:1.0:1777497414.461976:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546264192:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497414.462040:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264064 00000100:00100000:0.0:1777497414.462046:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264064 00000100:00100000:1.0:1777497414.462057:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546264192:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497414.462066:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1029 00000100:00100000:0.0:1777497414.462071:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1777497414.462077:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546264064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497414.462143:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546264064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497414.462165:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:2.0:1777497414.466384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497414.466870:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264320 00000100:00100000:3.0:1777497414.466880:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264320 00000100:00100000:3.0:1777497414.467348:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1030 00000100:00100000:3.0:1777497414.467363:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546264320:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497414.467489:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546264320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 129us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497414.467498:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1030 00000001:00100000:0.0:1777497414.693042:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1777497414.821507:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1777497415.101381:0:82130:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497415.101771:0:82130:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497415.844252:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777497416.321889:0:82180:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497416.322444:0:82180:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1777497416.866402:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497417.762508:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564832256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497417.762588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497417.762834:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832256 00000100:00100000:2.0:1777497417.762843:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832256 00000100:00100000:2.0:1777497417.762914:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1777497417.762933:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564832256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497417.762977:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497417.763019:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564832256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497417.763026:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00080000:1.0:1777497417.763122:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497417.763159:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564832256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497417.772079:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564832384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497417.772198:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497417.772276:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832384 00000100:00100000:1.0:1777497417.772284:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832384 00000100:00100000:1.0:1777497417.772357:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1777497417.772367:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564832384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497417.772397:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497417.772439:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564832384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497417.772459:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00080000:1.0:1777497417.772942:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497417.772982:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564832384:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777497417.890801:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497418.732036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497418.732169:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264448 00000100:00100000:0.0:1777497418.732179:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264448 00000100:00100000:0.0:1777497418.732255:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1074 00000100:00100000:0.0:1777497418.732265:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546264448:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497418.732298:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497418.732322:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c0d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c09d expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777497418.732344:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1777497418.732398:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497418.732413:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497418.732428:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497418.732479:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497418.732483:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497418.732505:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497418.732529:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c0d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c09d expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497418.732546:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c09d expref: 7 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497418.732568:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:0.0:1777497418.732571:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497418.732574:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd200, rc 0) 00000100:00100000:0.0:1777497418.732654:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:64627:x1863837546264448:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 391us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497418.732661:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1074 00000100:00100000:1.0:1777497418.742586:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497418.742842:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264576 00000100:00100000:3.0:1777497418.742852:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264576 00000100:00100000:3.0:1777497418.742910:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1075 00000100:00100000:3.0:1777497418.742929:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:64627:x1863837546264576:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497418.742967:0:73210:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1777497418.743278:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:64627:x1863837546264576:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 350us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497418.743287:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1075 00000100:00100000:2.0:1777497418.753899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497418.753983:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264704 00000100:00100000:0.0:1777497418.753993:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264704 00000100:00100000:0.0:1777497418.754149:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1076 00000100:00100000:0.0:1777497418.754160:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546264704:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497418.754197:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497418.754265:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546264704:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 107us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497418.754272:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1076 00000100:00080000:1.0:1777497418.755979:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497418.759024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497418.759416:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264832 00000100:00100000:2.0:1777497418.759428:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264832 00000100:00100000:2.0:1777497418.759485:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5835 00000100:00100000:2.0:1777497418.759493:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:0+-99:2411:x1863837546264832:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:2.0:1777497418.759526:0:25495:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3548 last 0 00000020:00000080:2.0:1777497418.759551:0:25495:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691c0e4 00002000:00100000:2.0:1777497418.759562:0:25495:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff923f839d7800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1777497418.759574:0:25495:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1777497418.759634:0:25495:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1777497418.759662:0:25495:0:(import.c:65:import_set_state_nolock()) ffff923f839d1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497418.759741:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546264832:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 247us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497418.759748:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5835 00000100:00100000:2.0:1777497418.777008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497418.777276:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546264960 00000100:00100000:3.0:1777497418.777296:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546264960 00000100:00100000:3.0:1777497418.777373:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1946 00000100:00100000:3.0:1777497418.777393:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546264960:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497418.777421:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497418.777673:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546264960:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 290us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497418.777695:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1946 00000100:00080000:1.0:1777497418.777921:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497418.797615:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497418.802134:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265088 00000100:00100000:1.0:1777497418.802149:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265088 00000100:00100000:1.0:1777497418.802226:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5836 00000100:00100000:1.0:1777497418.802235:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:2411:x1863837546265088:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:1.0:1777497418.802274:0:25486:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3548 last 0 00000020:00000080:1.0:1777497418.807108:0:25486:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691c0eb 00002000:00100000:1.0:1777497418.807125:0:25486:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff924086e2f800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1777497418.807138:0:25486:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1777497418.807212:0:25486:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1777497418.807249:0:25486:0:(import.c:65:import_set_state_nolock()) ffff924086e28800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497418.807350:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c97d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546265088:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 5113us (9742us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497418.807360:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5836 00000100:00100000:2.0:1777497418.809808:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497418.809958:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265216 00000100:00100000:1.0:1777497418.809968:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265216 00000100:00080000:2.0:1777497418.810086:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497418.810875:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1947 00000100:00100000:1.0:1777497418.810889:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546265216:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1777497418.810918:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497418.811007:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:64627:x1863837546265216:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 122us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497418.811013:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1947 00010000:00010000:2.0:1777497418.914453:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497419.298782:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564832768:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.298863:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.298895:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564833280:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.298919:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.298935:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564833792:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.298953:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.298975:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497419.298980:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564832640:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.298998:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.299012:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564833152:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.299035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.299051:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564833664:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.299068:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497419.299137:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833280 00000100:00100000:1.0:1777497419.299144:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833280 00000100:00100000:2.0:1777497419.299297:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833152 00000100:00100000:2.0:1777497419.299301:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833152 00000100:00100000:2.0:1777497419.299350:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833664 00000100:00100000:2.0:1777497419.299353:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833664 00000100:00100000:2.0:1777497419.299373:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1777497419.299392:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564833152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.299451:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564833152:12345-0@lo:400:kworker.0 Request processed in 61us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.299457:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3834 00000100:00100000:2.0:1777497419.299476:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1777497419.299481:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564833664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.299528:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564833664:12345-0@lo:400:kworker.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.299534:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3835 00000100:00100000:2.0:1777497419.299578:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564833152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.299588:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564833664:0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.299607:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497419.299614:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564834176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497419.299634:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497419.299654:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834176 00000100:00100000:2.0:1777497419.299658:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834176 00000100:00100000:2.0:1777497419.299675:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1777497419.299680:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564834176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497419.299697:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497419.299728:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564834176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.299733:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3836 00000100:00100000:2.0:1777497419.299761:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564834176:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497419.299801:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833792 00000100:00100000:2.0:1777497419.299804:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833792 00000100:00100000:3.0:1777497419.299974:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832768 00000100:00100000:3.0:1777497419.299979:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832768 00000100:00100000:3.0:1777497419.300014:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832640 00000100:00100000:3.0:1777497419.300017:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832640 00000100:00100000:3.0:1777497419.300034:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1777497419.300042:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564832768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497419.300078:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564832768:12345-0@lo:400:kworker.0 Request processed in 38us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.300084:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1777497419.300110:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1777497419.300117:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564832640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497419.300143:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564832640:12345-0@lo:400:kworker.0 Request processed in 27us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.300149:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1777497419.300941:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564832512:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.300987:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301022:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564833024:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301044:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301063:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564833536:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301083:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301131:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564834048:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301166:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301197:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1777497419.301204:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564832896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301224:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301234:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564833408:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301253:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301268:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564833920:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301285:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497419.301318:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832512 00000100:00100000:0.0:1777497419.301334:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832512 00000100:00100000:0.0:1777497419.301367:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1777497419.301374:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301424:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564832512:12345-0@lo:400:kworker.0 Request processed in 50us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301431:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1777497419.301458:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833024 00000100:00100000:0.0:1777497419.301461:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833024 00000100:00100000:0.0:1777497419.301483:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833536 00000100:00100000:0.0:1777497419.301485:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833536 00000100:00100000:0.0:1777497419.301496:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834048 00000100:00100000:0.0:1777497419.301498:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834048 00000100:00100000:0.0:1777497419.301507:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564832896 00000100:00100000:0.0:1777497419.301509:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564832896 00000100:00100000:0.0:1777497419.301522:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1777497419.301527:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564833024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301557:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564833024:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301563:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1777497419.301574:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1777497419.301586:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564833536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301612:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564833536:12345-0@lo:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301617:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1777497419.301629:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1777497419.301633:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564834048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301656:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564834048:12345-0@lo:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301660:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1777497419.301670:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1777497419.301675:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564832896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301698:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564832896:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301704:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1777497419.301723:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833408 00000100:00100000:0.0:1777497419.301727:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833408 00000100:00100000:0.0:1777497419.301752:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564833920 00000100:00100000:0.0:1777497419.301755:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564833920 00000100:00100000:0.0:1777497419.301773:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1777497419.301778:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564833408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301807:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564833408:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301814:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2365 00000100:00100000:0.0:1777497419.301824:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1777497419.301830:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564833920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301853:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564833920:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497419.301864:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2366 00000100:00100000:0.0:1777497419.301911:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564832896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301922:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564833408:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301931:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564833920:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301940:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564832512:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301948:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564833024:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301959:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564833536:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.301967:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564834048:0@lo:400:kworker.0 00000100:00080000:0.0:1777497419.302044:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497419.302049:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497419.302051:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497419.302078:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564832640:0@lo:400:kworker.0 00000100:00100000:0.0:1777497419.302089:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564832768:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.302429:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2367 00000100:00080000:0.0:1777497419.302785:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497419.307567:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1777497419.307582:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564833792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.307688:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564833792:12345-0@lo:400:kworker.0 Request processed in 110us (8733us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.307695:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2368 00000100:00100000:2.0:1777497419.307742:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564833792:0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.308622:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564833280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497419.308679:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564833280:12345-0@lo:400:kworker.0 Request processed in 6244us (9758us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497419.308687:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2367 00000100:00100000:2.0:1777497419.308880:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564833280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497419.583965:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497419.584008:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497419.584041:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497419.584073:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497419.584147:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497419.584187:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265472 00000100:00100000:2.0:1777497419.584197:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265472 00000100:00100000:2.0:1777497419.584247:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265600 00000100:00100000:2.0:1777497419.584249:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265600 00000100:00100000:2.0:1777497419.584267:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1037 00000100:00100000:2.0:1777497419.584277:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546265472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497419.584359:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546265472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.584366:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1037 00000100:00100000:2.0:1777497419.584394:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1038 00000100:00100000:2.0:1777497419.584401:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497419.584427:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497419.584432:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1038 00000100:00100000:3.0:1777497419.584453:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265728 00000100:00100000:3.0:1777497419.584457:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265728 00000100:00100000:3.0:1777497419.584483:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265856 00000100:00100000:3.0:1777497419.584485:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265856 00000100:00100000:3.0:1777497419.584500:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2369 00000100:00100000:3.0:1777497419.584507:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265728:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497419.584533:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265728:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.584538:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2369 00000100:00100000:3.0:1777497419.584562:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2370 00000100:00100000:3.0:1777497419.584568:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265856:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497419.584602:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546265856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.584607:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2370 00000100:00100000:1.0:1777497419.584628:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265344 00000100:00100000:1.0:1777497419.584633:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265344 00000100:00100000:1.0:1777497419.584669:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:1.0:1777497419.584682:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546265344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497419.584724:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546265344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497419.584730:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1777497419.812555:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564834304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497419.812638:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497419.812689:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834304 00000100:00100000:3.0:1777497419.812709:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834304 00000100:00100000:3.0:1777497419.812757:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1777497419.812765:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564834304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497419.812802:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:3.0:1777497419.812850:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564834304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.812856:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3837 00000100:00100000:3.0:1777497419.813483:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564834304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497419.814712:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497419.814730:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564834432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497419.814784:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497419.814824:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834432 00000100:00100000:3.0:1777497419.814831:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834432 00000100:00100000:3.0:1777497419.814868:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1777497419.814877:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564834432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497419.814904:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497419.814943:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564834432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.814959:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1777497419.815005:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564834432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497419.817004:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564834560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497419.817064:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497419.817127:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834560 00000100:00100000:3.0:1777497419.817134:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834560 00000100:00100000:3.0:1777497419.817172:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1777497419.817179:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564834560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497419.817208:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497419.817246:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564834560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497419.817252:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1777497419.817328:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564834560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777497419.939659:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497420.847932:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497420.847950:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969447 is committed 00000001:00100000:1.0:1777497420.868199:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497420.868214:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969451 is committed 00010000:00010000:1.0:1777497420.962628:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497421.988812:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497422.883329:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497422.883352:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564834688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497422.883419:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497422.883472:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834688 00000100:00100000:1.0:1777497422.883481:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834688 00000100:00100000:1.0:1777497422.883540:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1777497422.883550:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564834688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497422.883579:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497422.883621:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564834688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497422.883627:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1777497422.883676:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564834688:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777497422.883734:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497422.883828:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497422.883838:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564834816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497422.883867:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497422.883924:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834816 00000100:00100000:2.0:1777497422.883929:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834816 00000100:00100000:2.0:1777497422.883967:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:2.0:1777497422.883974:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564834816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497422.883991:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497422.884050:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564834816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497422.884056:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00080000:0.0:1777497422.884127:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497422.884150:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564834816:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497423.010347:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497423.468443:0:82278:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1777497424.034443:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497424.419332:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564834944:0@lo:400:kworker.0 00000100:00100000:1.0:1777497424.419401:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.420411:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564835200:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.420454:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.420490:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564835712:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.420513:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.420539:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836224:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.420557:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.420577:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777497424.420582:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564835328:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.420601:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.421074:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564835840:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421118:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.421133:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836352:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421154:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.421186:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835712 00000100:00100000:3.0:1777497424.421194:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835712 00000100:00100000:3.0:1777497424.421250:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836224 00000100:00100000:3.0:1777497424.421253:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836224 00000100:00100000:3.0:1777497424.421269:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835840 00000100:00100000:3.0:1777497424.421292:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835840 00000100:00100000:3.0:1777497424.421310:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836352 00000100:00100000:3.0:1777497424.421312:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836352 00000100:00100000:3.0:1777497424.421330:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2371 00000100:00100000:3.0:1777497424.421339:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421388:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564835712:12345-0@lo:400:kworker.0 Request processed in 51us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.421394:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2371 00000100:00100000:3.0:1777497424.421409:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:3.0:1777497424.421415:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421440:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836224:12345-0@lo:400:kworker.0 Request processed in 25us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.421446:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:3.0:1777497424.421456:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:3.0:1777497424.421461:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564835840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421499:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564835840:12345-0@lo:400:kworker.0 Request processed in 38us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.421505:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:3.0:1777497424.421524:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:3.0:1777497424.421530:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.421556:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836352:12345-0@lo:400:kworker.0 Request processed in 26us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.421560:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:3.0:1777497424.421576:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835200 00000100:00100000:3.0:1777497424.421579:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835200 00000100:00100000:3.0:1777497424.421601:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835328 00000100:00100000:0.0:1777497424.421846:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:0.0:1777497424.421861:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564835200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.421896:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564835200:12345-0@lo:400:kworker.0 Request processed in 37us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.421902:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00080000:0.0:1777497424.421921:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497424.421925:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497424.421927:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497424.421943:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564835072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.421967:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.421995:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564835584:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422016:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.422029:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564836096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422047:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.422063:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1777497424.422068:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564835456:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422083:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.422109:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564835968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422125:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.422138:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564836480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422153:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.422171:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835584 00000100:00100000:0.0:1777497424.422174:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835584 00000100:00100000:0.0:1777497424.422196:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836096 00000100:00100000:0.0:1777497424.422198:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836096 00000100:00100000:0.0:1777497424.422214:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3838 00000100:00100000:0.0:1777497424.422219:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564835584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422260:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564835584:12345-0@lo:400:kworker.0 Request processed in 40us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422266:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3838 00000100:00100000:0.0:1777497424.422289:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1777497424.422295:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564836096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422320:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564836096:12345-0@lo:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422325:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3839 00000100:00100000:0.0:1777497424.422340:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835072 00000100:00100000:0.0:1777497424.422343:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835072 00000100:00100000:0.0:1777497424.422360:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835456 00000100:00100000:0.0:1777497424.422362:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835456 00000100:00100000:0.0:1777497424.422371:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564835968 00000100:00100000:0.0:1777497424.422373:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835968 00000100:00100000:0.0:1777497424.422381:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836480 00000100:00100000:0.0:1777497424.422382:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836480 00000100:00100000:0.0:1777497424.422392:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1777497424.422396:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422419:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564835072:12345-0@lo:400:kworker.0 Request processed in 23us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422424:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1777497424.422432:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1777497424.422436:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422453:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564835456:12345-0@lo:400:kworker.0 Request processed in 18us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422458:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1777497424.422466:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1777497424.422476:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564835968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422498:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564835968:12345-0@lo:400:kworker.0 Request processed in 23us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422503:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:0.0:1777497424.422512:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1777497424.422517:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564836480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422536:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564836480:12345-0@lo:400:kworker.0 Request processed in 19us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497424.422541:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00080000:0.0:1777497424.422558:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497424.422560:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497424.422586:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564835456:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.422595:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564835968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.422898:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564834944 00000100:00100000:2.0:1777497424.422904:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564834944 00000100:00100000:2.0:1777497424.422934:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1777497424.422940:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564834944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.422974:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564834944:12345-0@lo:400:kworker.0 Request processed in 34us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.422978:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1777497424.423081:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564835840:0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.423108:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 2 00000100:00100000:2.0:1777497424.423122:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.423132:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564835200:0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.423141:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564835712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497424.423149:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:2.0:1777497424.423156:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836224:0@lo:400:kworker.0 00000100:00100000:1.0:1777497424.424320:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564834944:0@lo:400:kworker.0 00000100:00100000:1.0:1777497424.424350:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497424.424359:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564836608:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497424.424396:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497424.424861:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564836480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.424886:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564835072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.424897:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564835584:0@lo:400:kworker.0 00000100:00100000:0.0:1777497424.424905:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564836096:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.425358:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564835328 00000100:00100000:3.0:1777497424.425810:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1777497424.425823:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564835328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.425887:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564835328:12345-0@lo:400:kworker.0 Request processed in 69us (5285us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.425893:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:0.0:1777497424.425946:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497424.426366:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836608 00000100:00100000:2.0:1777497424.426373:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836608 00000100:00100000:2.0:1777497424.426412:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1777497424.426419:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564836608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497424.426447:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497424.426513:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564836608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.426534:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3840 00000100:00100000:2.0:1777497424.426576:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564835328:0@lo:400:kworker.0 00000100:00100000:3.0:1777497424.427139:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564836608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497424.716690:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497424.716736:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497424.716759:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546265984 00000100:00100000:1.0:1777497424.716769:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546265984 00000100:00100000:2.0:1777497424.716772:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497424.716799:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497424.716824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497424.716827:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1777497424.716836:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546265984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497424.716845:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266240 00000100:00100000:2.0:1777497424.716848:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266240 00000100:00100000:2.0:1777497424.716883:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266112 00000100:00100000:2.0:1777497424.716885:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266112 00000100:00100000:1.0:1777497424.716902:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546265984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 68us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.716903:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1045 00000100:00100000:2.0:1777497424.716909:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546266240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497424.716910:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1777497424.716939:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546266240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.716945:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1045 00000100:00100000:2.0:1777497424.716958:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1046 00000100:00100000:2.0:1777497424.716963:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546266112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497424.716985:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546266112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 22us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.716990:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1046 00000100:00100000:2.0:1777497424.717009:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266496 00000100:00100000:2.0:1777497424.717012:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266496 00000100:00100000:2.0:1777497424.717035:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266368 00000100:00100000:2.0:1777497424.717038:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266368 00000100:00100000:2.0:1777497424.717055:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2375 00000100:00100000:2.0:1777497424.717190:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546266496:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497424.717231:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546266496:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 150us (451us total) trans 0 rc 0/0 00000100:00080000:0.0:1777497424.719784:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497424.719791:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497424.719795:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497424.719798:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497424.720117:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2376 00000100:00100000:1.0:1777497424.720139:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546266368:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497424.722966:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546266368:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2825us (6127us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497424.722981:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2376 00000100:00100000:2.0:1777497424.731128:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2375 00000100:00100000:3.0:1777497424.930624:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497424.930716:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497424.931467:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836736 00000100:00100000:3.0:1777497424.931476:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836736 00000100:00100000:3.0:1777497424.931525:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1777497424.931535:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497424.931564:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497424.931609:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564836736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497424.931616:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:3.0:1777497424.931977:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564836864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497424.932020:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497424.932051:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836864 00000100:00100000:1.0:1777497424.932055:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836864 00000100:00100000:3.0:1777497424.932070:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497424.932080:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:1.0:1777497424.932086:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564836864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497424.932120:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497424.932161:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564836864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497424.932167:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1777497424.932378:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564836864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497424.935786:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564836992:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497424.935862:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497424.936054:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564836992 00000100:00100000:2.0:1777497424.936062:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564836992 00000100:00100000:2.0:1777497424.936125:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3841 00000100:00100000:2.0:1777497424.936134:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564836992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497424.936164:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:2.0:1777497424.936220:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564836992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497424.936226:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3841 00000100:00100000:3.0:1777497424.937765:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564836992:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1777497425.066125:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777497425.552380:0:82326:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:0.0:1777497426.082202:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497427.112585:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497427.689864:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497427.690234:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266624 00000100:00100000:0.0:1777497427.690252:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266624 00000100:00100000:0.0:1777497427.690334:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00100000:0.0:1777497427.690345:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65074:x1863837546266624:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497427.690384:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1777497427.690455:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65074:x1863837546266624:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 114us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497427.690462:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00080000:2.0:1777497427.690770:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497427.710775:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497427.710918:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266752 00000100:00100000:2.0:1777497427.710930:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266752 00000100:00100000:2.0:1777497427.711015:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1078 00000100:00100000:2.0:1777497427.711027:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:65074:x1863837546266752:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497427.711069:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497427.711185:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:65074:x1863837546266752:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 162us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497427.711192:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1078 00000100:00080000:0.0:1777497427.711280:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497427.719452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497427.721186:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546266880 00000100:00100000:1.0:1777497427.721224:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546266880 00000100:00100000:1.0:1777497427.721326:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1954 00000100:00100000:1.0:1777497427.721339:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65074:x1863837546266880:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1777497427.721417:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497427.721497:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65074:x1863837546266880:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 162us (2053us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497427.721504:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1954 00000100:00080000:0.0:1777497427.722658:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497427.733733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497427.733813:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267008 00000100:00100000:3.0:1777497427.733835:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267008 00000100:00100000:3.0:1777497427.733905:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1955 00000100:00100000:3.0:1777497427.733916:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65074:x1863837546267008:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497427.733948:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497427.734028:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65074:x1863837546267008:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 114us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497427.734037:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1955 00000100:00080000:0.0:1777497427.734272:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497427.786623:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497427.786759:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267264 00000100:00100000:0.0:1777497427.786770:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267264 00000100:00100000:0.0:1777497427.786847:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1079 00000100:00100000:0.0:1777497427.786857:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65090:x1863837546267264:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497427.786879:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497427.786899:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c0f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0a4 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.786973:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.786988:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787001:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787015:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787035:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787041:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787141:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787149:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787155:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787161:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787167:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dca00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497427.787171:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787179:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787190:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:0.0:1777497427.787206:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497427.787210:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787217:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dca00/0x3e357265691c0f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787246:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787253:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787259:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787264:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dce00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497427.787267:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787273:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787282:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff924083c2bf00) 00010000:00010000:0.0:1777497427.787284:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497427.787287:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787293:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691c100 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787332:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c0f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0a4 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787342:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:0.0:1777497427.787345:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497427.787355:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c0f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0a4 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497427.787364:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc600, rc 0) 00000100:00100000:0.0:1777497427.787426:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65090:x1863837546267264:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 571us (814us total) trans 0 rc 301/301 00000100:00100000:0.0:1777497427.787433:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1079 00000100:00100000:2.0:1777497427.795149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497427.795663:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267392 00000100:00100000:1.0:1777497427.795673:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267392 00000100:00100000:1.0:1777497427.795924:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00100000:1.0:1777497427.795936:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65090:x1863837546267392:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:1.0:1777497427.796004:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796021:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796033:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796048:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796054:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796060:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796173:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796182:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796190:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497427.796228:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497427.796253:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796267:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796274:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796281:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796287:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796293:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497427.796470:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796481:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796503:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:1.0:1777497427.796506:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497427.796510:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796516:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691c107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796528:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796534:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796540:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796546:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497427.796548:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796555:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796562:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xed1d29cb (ffff9240a3b5d800) 00010000:00010000:1.0:1777497427.796565:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497427.796567:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796573:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c10e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xed1d29cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796597:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796604:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796610:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796614:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497427.796617:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796622:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796629:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x2:0x0].0x0 (ffff9240a3b5d200) 00010000:00010000:1.0:1777497427.796631:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497427.796634:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497427.796640:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c115 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497427.796996:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65090:x1863837546267392:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 1061us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497427.797006:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00100000:0.0:1777497428.002387:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564837120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497428.002492:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497428.002592:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564837248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497428.002618:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837120 00000100:00100000:1.0:1777497428.002620:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497428.002626:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837120 00000100:00080000:1.0:1777497428.002680:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497428.002683:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837248 00000100:00100000:2.0:1777497428.002686:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837248 00000100:00080000:1.0:1777497428.002700:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497428.002710:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:1.0:1777497428.002715:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:2.0:1777497428.002720:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564837120:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497428.002722:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564837248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497428.002741:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1777497428.002742:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497428.002780:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564837120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497428.002780:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564837248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497428.002787:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1777497428.002852:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564837120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497428.002929:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564837248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497428.004057:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00010000:00010000:3.0:1777497428.130658:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497429.155378:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497429.539365:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497429.539401:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564837376:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497429.539507:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497429.539785:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837376 00000100:00100000:2.0:1777497429.539800:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837376 00000100:00100000:2.0:1777497429.539877:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3842 00000100:00100000:2.0:1777497429.539887:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564837376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497429.539927:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497429.540033:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564837376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497429.540047:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3842 00000100:00100000:3.0:1777497429.540071:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564837632:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.540131:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497429.540143:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564837504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.540167:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564838144:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.540313:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564837888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.544347:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497429.545558:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564838016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497429.546230:0:81814:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837504 00000100:00100000:0.0:1777497429.546245:0:81814:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837504 00000100:00100000:0.0:1777497429.546316:0:81814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1777497429.546328:0:81814:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547089:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547167:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564838400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547214:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547249:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564838912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547276:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547312:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497429.547319:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564837760:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547361:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564838272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547397:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547418:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564838784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547440:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.547484:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838400 00000100:00100000:1.0:1777497429.547490:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838400 00000100:00100000:1.0:1777497429.547530:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838272 00000100:00100000:1.0:1777497429.547533:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838272 00000100:00100000:1.0:1777497429.547570:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838784 00000100:00100000:1.0:1777497429.547573:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838784 00000100:00100000:1.0:1777497429.547621:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1777497429.547630:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564838400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.547955:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564838400:12345-0@lo:400:kworker.0 Request processed in 325us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.547963:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1777497429.547985:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:1.0:1777497429.547993:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564838272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548024:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564838272:12345-0@lo:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548030:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:1.0:1777497429.548042:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:1.0:1777497429.548048:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548075:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564838784:12345-0@lo:400:kworker.0 Request processed in 28us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548082:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00080000:1.0:1777497429.548131:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497429.548169:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564838272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548192:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564838784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548203:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564838400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548649:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837632 00000100:00100000:1.0:1777497429.548656:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837632 00000100:00100000:1.0:1777497429.548711:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837888 00000100:00100000:1.0:1777497429.548715:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837888 00000100:00100000:1.0:1777497429.548734:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838912 00000100:00100000:1.0:1777497429.548747:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838912 00000100:00100000:1.0:1777497429.548764:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564837760 00000100:00100000:1.0:1777497429.548766:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564837760 00000100:00100000:1.0:1777497429.548783:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1777497429.548791:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564837632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548840:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564837632:12345-0@lo:400:kworker.0 Request processed in 51us (8709us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548847:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1777497429.548861:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1777497429.548867:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564837888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548900:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564837888:12345-0@lo:400:kworker.0 Request processed in 33us (1817us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548906:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1777497429.548917:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1777497429.548923:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564838912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548949:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564838912:12345-0@lo:400:kworker.0 Request processed in 27us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548954:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:1.0:1777497429.548964:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1777497429.548969:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564837760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.548992:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564837760:12345-0@lo:400:kworker.0 Request processed in 24us (1650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.548998:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:1.0:1777497429.549016:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497429.549019:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497429.549056:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564837376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497429.549118:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564837760:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.549132:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564837888:0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.549143:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564838912:0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.552042:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497429.552142:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838016 00000100:00100000:1.0:1777497429.552158:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838016 00000100:00100000:1.0:1777497429.552265:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1777497429.552278:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564838016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497429.553042:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564838016:12345-0@lo:400:kworker.0 Request processed in 763us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.553054:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1777497429.553064:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564838016:0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.553079:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564838528:0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.553149:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497429.553246:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838528 00000100:00100000:2.0:1777497429.553253:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838528 00000100:00100000:2.0:1777497429.553295:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1777497429.553303:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564838528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.553358:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564838528:12345-0@lo:400:kworker.0 Request processed in 55us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497429.553364:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00080000:1.0:1777497429.557914:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497429.558528:0:81814:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564837504:12345-0@lo:400:kworker.0 Request processed in 12194us (14179us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497429.558544:0:81814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777497429.559005:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497429.559060:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564838656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559163:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497429.559247:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564837632:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559289:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838656 00000100:00100000:3.0:1777497429.559296:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838656 00000100:00100000:3.0:1777497429.559356:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1777497429.559547:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564838656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559625:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564838656:12345-0@lo:400:kworker.0 Request processed in 261us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497429.559633:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1777497429.559667:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564838144 00000100:00100000:3.0:1777497429.559671:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564838144 00000100:00100000:3.0:1777497429.559721:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3843 00000100:00100000:3.0:1777497429.559728:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564838144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559765:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564838144:12345-0@lo:400:kworker.0 Request processed in 38us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497429.559771:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3843 00000100:00080000:3.0:1777497429.559795:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497429.559817:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564838144:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559829:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564838656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559895:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564837504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497429.559909:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564838528:0@lo:400:kworker.0 00000100:00100000:2.0:1777497429.841477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497429.841529:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497429.841565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497429.841590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497429.841632:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497429.841676:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267520 00000100:00100000:2.0:1777497429.841690:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267520 00000100:00100000:1.0:1777497429.841749:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267904 00000100:00100000:2.0:1777497429.841762:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:2.0:1777497429.841774:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546267520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497429.841777:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267904 00000100:00100000:2.0:1777497429.841870:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546267520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497429.841878:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:0.0:1777497429.842012:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267648 00000100:00100000:0.0:1777497429.842019:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267648 00000100:00100000:0.0:1777497429.842063:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546267776 00000100:00100000:0.0:1777497429.842065:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546267776 00000100:00100000:2.0:1777497429.842067:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00100000:2.0:1777497429.842074:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546267648:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497429.842089:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1054 00000100:00100000:2.0:1777497429.842147:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546267648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 72us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497429.842154:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00100000:0.0:1777497429.842156:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546267776:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497429.842174:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268032 00000100:00100000:1.0:1777497429.842181:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268032 00000100:00100000:0.0:1777497429.842195:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546267776:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 97us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497429.842204:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1054 00000100:00100000:0.0:1777497429.842256:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2381 00000100:00100000:0.0:1777497429.842271:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546267904:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497429.842273:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2382 00000100:00100000:1.0:1777497429.842293:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546268032:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497429.842340:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546267904:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497429.842348:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2381 00000100:00100000:1.0:1777497429.842384:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546268032:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 99us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497429.842393:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2382 00000100:00080000:1.0:1777497429.842430:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497429.842434:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497429.842437:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497429.842440:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497430.050488:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564839040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497430.050560:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497430.050618:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839040 00000100:00100000:3.0:1777497430.050637:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839040 00000100:00100000:3.0:1777497430.050680:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1777497430.050688:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564839040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497430.050717:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497430.050758:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564839040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497430.050899:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564839168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497430.050927:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497430.050966:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839168 00000100:00100000:1.0:1777497430.050970:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839168 00000100:00100000:1.0:1777497430.050995:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:1.0:1777497430.051002:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564839168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497430.051018:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497430.051048:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564839168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497430.051054:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:1.0:1777497430.051129:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564839168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497430.051466:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497430.051478:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564839296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497430.051522:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497430.051593:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839296 00000100:00100000:0.0:1777497430.051598:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839296 00000100:00100000:0.0:1777497430.051632:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3844 00000100:00100000:0.0:1777497430.051638:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564839296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497430.051661:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1777497430.051695:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564839296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497430.051701:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3844 00000100:00100000:3.0:1777497430.051903:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1777497430.051936:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564839040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497430.052005:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564839296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1777497430.178270:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497431.202665:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497432.226467:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497433.122698:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497433.122717:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564839424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497433.122824:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497433.122871:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839424 00000100:00100000:0.0:1777497433.122879:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839424 00000100:00100000:0.0:1777497433.122957:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1777497433.122966:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564839424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497433.122995:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497433.123037:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564839424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497433.123045:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00080000:0.0:1777497433.123065:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497433.123116:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564839424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497433.123398:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497433.123545:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564839552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497433.123585:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497433.124650:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839552 00000100:00100000:3.0:1777497433.124660:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839552 00000100:00100000:3.0:1777497433.124777:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1777497433.124786:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564839552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497433.124815:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497433.124869:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564839552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497433.124877:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:1.0:1777497433.128900:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564839552:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777497433.129011:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777497433.253170:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497434.274323:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497434.662231:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564840064:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662302:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662338:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564840576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662363:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662379:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564841088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662410:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662434:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1777497434.662440:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564839680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662716:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497434.662719:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840576 00000100:00100000:2.0:1777497434.662727:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840576 00000100:00100000:1.0:1777497434.662740:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564840192:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662760:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497434.662767:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841088 00000100:00100000:2.0:1777497434.662770:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841088 00000100:00100000:1.0:1777497434.662774:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564840704:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662793:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662808:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564841216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.662818:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:1.0:1777497434.662843:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662872:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564839808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.662892:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.662906:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564840320:0@lo:400:kworker.0 00000100:00080000:0.0:1777497434.663199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497434.663342:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564840576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.663399:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564840576:12345-0@lo:400:kworker.0 Request processed in 574us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.663407:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1777497434.663426:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1777497434.663432:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564841088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.663459:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564841088:12345-0@lo:400:kworker.0 Request processed in 28us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.663465:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:2.0:1777497434.663490:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840064 00000100:00100000:2.0:1777497434.663494:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840064 00000100:00100000:2.0:1777497434.663524:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840192 00000100:00100000:2.0:1777497434.663527:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840192 00000100:00100000:0.0:1777497434.664030:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564840576:0@lo:400:kworker.0 00000100:00100000:0.0:1777497434.664043:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564841088:0@lo:400:kworker.0 00000100:00080000:3.0:1777497434.664521:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497434.664525:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497434.665325:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840704 00000100:00100000:2.0:1777497434.665334:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840704 00000100:00100000:2.0:1777497434.665355:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841216 00000100:00100000:2.0:1777497434.665357:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841216 00000100:00100000:2.0:1777497434.665367:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839808 00000100:00100000:2.0:1777497434.665370:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839808 00000100:00100000:2.0:1777497434.665399:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1777497434.665408:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564840064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665499:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564840064:12345-0@lo:400:kworker.0 Request processed in 92us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.665505:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1777497434.665524:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1777497434.665531:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564840192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665660:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564840192:12345-0@lo:400:kworker.0 Request processed in 130us (2898us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.665666:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1777497434.665678:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1777497434.665683:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564840704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665708:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564840704:12345-0@lo:400:kworker.0 Request processed in 25us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.665713:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1777497434.665726:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1777497434.665731:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564841216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665756:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564841216:12345-0@lo:400:kworker.0 Request processed in 25us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.665762:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:2.0:1777497434.665773:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1777497434.665779:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564839808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665806:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564839808:12345-0@lo:400:kworker.0 Request processed in 28us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.665811:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00080000:2.0:1777497434.665835:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497434.665867:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564840192:0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665888:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564840704:0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665902:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564841216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.665913:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564840064:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.666384:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839680 00000100:00100000:3.0:1777497434.666389:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839680 00000100:00100000:3.0:1777497434.666430:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777497434.666437:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564839680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.666476:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564839680:12345-0@lo:400:kworker.0 Request processed in 41us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497434.666482:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1777497434.666530:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564839936:0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.667427:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564839680:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667565:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497434.667596:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564840448:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667620:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497434.667638:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564840960:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667655:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497434.667684:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564839936 00000100:00100000:3.0:1777497434.667689:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564839936 00000100:00100000:3.0:1777497434.667727:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1777497434.667734:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564839936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667770:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564839936:12345-0@lo:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497434.667775:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:3.0:1777497434.667794:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840448 00000100:00100000:3.0:1777497434.667796:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840448 00000100:00100000:3.0:1777497434.667816:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840960 00000100:00100000:3.0:1777497434.667819:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840960 00000100:00100000:3.0:1777497434.667840:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1777497434.667846:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564840448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667874:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564840448:12345-0@lo:400:kworker.0 Request processed in 29us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497434.667880:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1777497434.667890:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:3.0:1777497434.667895:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564840960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667920:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564840960:12345-0@lo:400:kworker.0 Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497434.667925:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00080000:3.0:1777497434.667961:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497434.667965:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497434.667984:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564839936:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.667993:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564840448:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.668001:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564840960:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.670145:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.670207:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564840832:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.670255:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497434.670270:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564841344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497434.670276:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840320 00000100:00100000:3.0:1777497434.670284:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840320 00000100:00100000:1.0:1777497434.670287:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497434.670326:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564840832 00000100:00100000:3.0:1777497434.670328:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564840832 00000100:00100000:3.0:1777497434.670338:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841344 00000100:00100000:3.0:1777497434.670340:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841344 00000100:00100000:1.0:1777497434.670340:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564839808:0@lo:400:kworker.0 00000100:00100000:3.0:1777497434.670349:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3845 00000100:00100000:3.0:1777497434.670356:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564840320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497434.670450:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3846 00000100:00100000:0.0:1777497434.670459:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564840832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497434.670577:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3847 00000100:00100000:2.0:1777497434.670587:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564841344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497434.670614:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497434.671195:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564840320:12345-0@lo:400:kworker.0 Request processed in 836us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497434.671204:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3845 00000100:00100000:0.0:1777497434.674666:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564840832:12345-0@lo:400:kworker.0 Request processed in 4197us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.674681:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3846 00000100:00100000:2.0:1777497434.674813:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564841344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4227us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497434.674822:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3847 00000100:00100000:1.0:1777497434.680393:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564840320:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.680420:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564840832:0@lo:400:kworker.0 00000100:00100000:1.0:1777497434.680440:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564841344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497434.950959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497434.950997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497434.951040:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497434.951070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497434.951122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497434.951182:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268160 00000100:00100000:0.0:1777497434.951192:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268160 00000100:00100000:0.0:1777497434.951247:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:0.0:1777497434.951258:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546268160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497434.951331:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546268160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.951339:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:0.0:1777497434.951374:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268288 00000100:00100000:0.0:1777497434.951378:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268288 00000100:00100000:0.0:1777497434.951428:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268416 00000100:00100000:0.0:1777497434.951431:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268416 00000100:00100000:0.0:1777497434.951450:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1061 00000100:00100000:0.0:1777497434.951456:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546268288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497434.951484:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546268288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.951490:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1061 00000100:00100000:0.0:1777497434.951501:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1062 00000100:00100000:0.0:1777497434.951507:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546268416:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497434.951529:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546268416:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 22us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.951548:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1062 00000100:00100000:0.0:1777497434.951569:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268544 00000100:00100000:0.0:1777497434.951573:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268544 00000100:00100000:0.0:1777497434.951599:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268672 00000100:00100000:0.0:1777497434.951601:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268672 00000100:00100000:0.0:1777497434.951619:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2387 00000100:00100000:0.0:1777497434.951625:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546268544:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497434.951649:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546268544:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.951655:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2387 00000100:00100000:0.0:1777497434.951667:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2388 00000100:00100000:0.0:1777497434.951672:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546268672:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497434.951696:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546268672:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497434.951710:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2388 00000100:00080000:0.0:1777497434.951842:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497434.951846:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497434.951848:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497434.951850:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1777497435.143472:0:82523:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 130b: DoM file create (inherited) replay ========================================================== 17:17:13 (1777497433) 00000100:00100000:3.0:1777497435.170607:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564841472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497435.170684:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497435.170775:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841472 00000100:00100000:0.0:1777497435.170784:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841472 00000100:00100000:1.0:1777497435.170943:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497435.170954:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564841600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497435.170983:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497435.174832:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497435.174899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497435.175058:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841600 00000100:00100000:0.0:1777497435.175066:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841600 00000100:00100000:0.0:1777497435.175150:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1777497435.175160:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564841472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497435.175200:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497435.175249:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564841472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (4565us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497435.175257:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1777497435.175274:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1777497435.175280:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564841600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497435.175295:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497435.175324:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564841600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (4341us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497435.175330:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1963 00000100:00100000:0.0:1777497435.176696:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841728 00000100:00100000:0.0:1777497435.176706:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841728 00000100:00100000:0.0:1777497435.176753:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3848 00000100:00100000:0.0:1777497435.176761:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564841728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497435.176789:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445244928 avail 1299005440 00000100:00100000:0.0:1777497435.176887:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564841728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497435.176904:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3848 00000100:00100000:1.0:1777497435.178952:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564841728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497435.178974:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564841600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497435.179166:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564841472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777497435.298904:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497435.389590:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497435.389883:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546268800 00000100:00100000:0.0:1777497435.389894:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546268800 00000100:00100000:0.0:1777497435.389966:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1081 00000100:00100000:0.0:1777497435.389976:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65672:x1863837546268800:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497435.389997:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497435.390017:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c11c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0ab expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390081:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390114:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390128:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390143:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390150:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390156:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390200:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390207:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390227:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390233:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390239:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497435.390244:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390251:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390263:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:0.0:1777497435.390266:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497435.390271:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390278:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390290:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390296:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390302:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390307:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497435.390315:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390322:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390329:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff924083c2bf00) 00010000:00010000:0.0:1777497435.390331:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497435.390334:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390339:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c12a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390372:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c11c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ab expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390381:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:0.0:1777497435.390383:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497435.390386:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c11c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ab expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.390394:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc600, rc 0) 00000100:00100000:0.0:1777497435.390470:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65672:x1863837546268800:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 495us (892us total) trans 0 rc 301/301 00000100:00100000:0.0:1777497435.390476:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1081 00000100:00100000:0.0:1777497435.408029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497435.408254:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546269056 00000100:00100000:2.0:1777497435.408266:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546269056 00000100:00100000:2.0:1777497435.408323:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1082 00000100:00100000:2.0:1777497435.408334:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65672:x1863837546269056:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:2.0:1777497435.408394:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497435.408422:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691c0dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c09d expref: 7 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408438:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d200) 00010000:00010000:2.0:1777497435.408450:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497435.408511:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408542:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408552:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408567:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408574:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497435.408579:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417466:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417498:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417512:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497435.417530:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000110b52d6 reply state 00000000c7a18af4 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417541:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417548:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:0.0:1777497435.417551:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497435.417555:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777497435.417561:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1777497435.417570:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417575:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417581:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417588:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417594:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497435.417599:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417616:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417628:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924084d21c00) 00010000:00010000:0.0:1777497435.417631:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497435.417634:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417640:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c131 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497435.417655:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000110b52d6 reply state 00000000c7a18af4 transno 98784247809 ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417662:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.417668:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff924084d21400) 00010000:00010000:0.0:1777497435.417669:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497435.417671:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1777497435.417766:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:65672:x1863837546269056:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 9430us (9738us total) trans 98784247809 rc 0/0 00000100:00100000:0.0:1777497435.417775:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1082 00000100:00100000:2.0:1777497435.441059:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497435.441206:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546269184 00000100:00100000:0.0:1777497435.441217:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546269184 00000100:00100000:0.0:1777497435.441279:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00100000:0.0:1777497435.441289:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:65676:x1863837546269184:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497435.441313:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497435.441336:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0b2 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441417:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441431:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441443:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497435.441483:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497435.441487:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497435.441507:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441544:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b2 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441563:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b2 expref: 9 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.441571:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b200) 00010000:00010000:0.0:1777497435.441574:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497435.441578:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc400, rc 0) 00000100:00100000:0.0:1777497435.441644:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:65676:x1863837546269184:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 356us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497435.441651:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00100000:1.0:1777497435.445291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497435.445391:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546269312 00000100:00100000:3.0:1777497435.445401:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546269312 00000100:00100000:3.0:1777497435.445482:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1084 00000100:00100000:3.0:1777497435.445493:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:65676:x1863837546269312:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497435.445514:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497435.445619:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c154 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0b9 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.445959:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.445987:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446001:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446014:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446021:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446028:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446129:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446138:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446145:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497435.446196:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777497435.446200:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497435.446219:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446230:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446245:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446250:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446256:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446261:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497435.446264:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446270:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446283:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b200) 00010000:00010000:3.0:1777497435.446286:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497435.446290:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446295:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446307:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446312:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446317:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446327:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497435.446329:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446333:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446340:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff924084d21400) 00010000:00010000:3.0:1777497435.446342:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497435.446344:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446349:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c162 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446374:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c154 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b9 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446384:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b9 expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497435.446390:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:3.0:1777497435.446393:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497435.446395:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee000, rc 0) 00000100:00100000:3.0:1777497435.446538:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65676:x1863837546269312:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1037us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497435.446547:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1084 00000100:00100000:2.0:1777497435.453461:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497435.454808:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546269568 00000100:00100000:0.0:1777497435.454822:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546269568 00000100:00100000:0.0:1777497435.454939:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1085 00000100:00100000:0.0:1777497435.454949:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65676:x1863837546269568:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497435.454971:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497435.454993:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c170 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0c0 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497435.455128:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1777497435.455242:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c170 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0c0 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.455257:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b200) 00010000:00010000:0.0:1777497435.455260:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497435.455265:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691c170 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0c0 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.455278:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc200, rc 0) 00000100:00100000:0.0:1777497435.455349:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65676:x1863837546269568:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 401us (1897us total) trans 98784247810 rc 301/301 00000100:00100000:0.0:1777497435.455356:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1085 00000100:00100000:2.0:1777497435.461609:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497435.461689:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546269824 00000100:00100000:0.0:1777497435.461700:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546269824 00000100:00100000:0.0:1777497435.461756:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00100000:0.0:1777497435.461765:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65676:x1863837546269824:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1777497435.461827:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497435.461853:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c169 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b9 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.461891:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:0.0:1777497435.461896:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497435.461919:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.461931:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.461940:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497435.462333:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7ecd2b4 reply state 00000000f66cc301 transno 98784247811 ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.462347:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497435.462353:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:0.0:1777497435.462355:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1777497435.462358:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777497435.462366:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000100:00100000:1.0:1777497435.463714:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+12:65676:x1863837546269824:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 1939us (2112us total) trans 98784247811 rc 0/0 00000100:00100000:1.0:1777497435.463725:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00100000:1.0:1777497435.477493:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497435.477768:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270080 00000100:00100000:3.0:1777497435.477793:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270080 00000100:00100000:3.0:1777497435.477855:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 220 00000100:00100000:3.0:1777497435.477865:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:65676:x1863837546270080:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1777497435.478242:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+13:65676:x1863837546270080:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 377us (758us total) trans 98784247812 rc 0/0 00000100:00100000:3.0:1777497435.478251:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 220 00000001:00080000:1.0:1777497436.226381:0:81808:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247812 is committed 00010000:00010000:2.0:1777497436.226444:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226458:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226466:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226472:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497436.226476:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226497:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226517:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff924084d21400) 00010000:00010000:2.0:1777497436.226520:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497436.226524:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226530:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95a00/0x3e357265691c138 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226551:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226557:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226562:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226568:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497436.226570:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226576:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226584:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:2.0:1777497436.226587:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497436.226589:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226604:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691c13f lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226621:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226626:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226631:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226636:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497436.226639:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226644:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226651:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff924083c2bf00) 00010000:00010000:2.0:1777497436.226653:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497436.226656:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497436.226662:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd400/0x3e357265691c17e lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497436.309376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497436.309451:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270208 00000100:00100000:0.0:1777497436.309461:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270208 00000100:00100000:0.0:1777497436.309530:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1087 00000100:00100000:0.0:1777497436.309540:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65690:x1863837546270208:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497436.309592:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1777497436.309665:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65690:x1863837546270208:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 127us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497436.309673:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1087 00000100:00080000:3.0:1777497436.309810:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497436.313929:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497436.314704:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270336 00000100:00100000:3.0:1777497436.314716:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270336 00000100:00100000:3.0:1777497436.322066:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1088 00000100:00100000:3.0:1777497436.322088:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:65690:x1863837546270336:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497436.322176:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497436.322257:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:65690:x1863837546270336:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 178us (8336us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497436.322265:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1088 00000100:00080000:3.0:1777497436.322291:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1777497436.323353:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497436.339477:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497436.344631:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270464 00000100:00100000:2.0:1777497436.344646:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270464 00000100:00100000:2.0:1777497436.344723:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1964 00000100:00100000:2.0:1777497436.344733:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65690:x1863837546270464:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497436.344767:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497436.344861:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65690:x1863837546270464:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 129us (5391us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497436.344868:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1964 00000100:00080000:3.0:1777497436.345384:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497436.348760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497436.348830:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270592 00000100:00100000:0.0:1777497436.348839:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270592 00000100:00100000:0.0:1777497436.348901:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1965 00000100:00100000:0.0:1777497436.348911:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65690:x1863837546270592:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:0.0:1777497436.348935:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497436.349000:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:65690:x1863837546270592:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 90us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497436.349007:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1965 00000100:00080000:3.0:1777497436.349088:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497436.541434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497436.541576:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270848 00000100:00100000:3.0:1777497436.541586:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270848 00000100:00100000:3.0:1777497436.541643:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1089 00000100:00100000:3.0:1777497436.541653:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:65697:x1863837546270848:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:3.0:1777497436.541705:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497436.541729:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc400/0x3e357265691c14d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0b2 expref: 7 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541766:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b200) 00010000:00010000:3.0:1777497436.541777:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497436.541826:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541838:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541846:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541856:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541862:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.541868:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542411:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542421:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542426:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542432:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542448:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497436.542453:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542460:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542469:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fc800) 00010000:00010000:3.0:1777497436.542472:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497436.542475:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542481:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c185 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497436.542495:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001cdaf9a9 reply state 000000003418ebc8 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542506:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.542512:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f8fce00) 00010000:00010000:3.0:1777497436.542514:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497436.542517:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497436.542608:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:65697:x1863837546270848:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 955us (1182us total) trans 98784247813 rc 0/0 00000100:00100000:3.0:1777497436.542616:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1089 00000100:00100000:1.0:1777497436.576815:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497436.577222:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270976 00000100:00100000:0.0:1777497436.577233:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270976 00000100:00100000:0.0:1777497436.577303:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1090 00000100:00100000:0.0:1777497436.577313:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:65700:x1863837546270976:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1777497436.577340:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497436.577365:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dcc00/0x3e357265691c193 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0c7 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577430:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577443:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577454:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497436.577493:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497436.577497:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497436.577518:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577660:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dcc00/0x3e357265691c193 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0c7 expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577680:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0c7 expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.577688:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:0.0:1777497436.577691:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497436.577695:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dde00, rc 0) 00000100:00100000:0.0:1777497436.577856:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:65700:x1863837546270976:12345-192.168.202.4@tcp:101:rm.0 Request processed in 543us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497436.577863:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1090 00000100:00100000:2.0:1777497436.583449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497436.583818:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271104 00000100:00100000:3.0:1777497436.583830:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271104 00000100:00100000:3.0:1777497436.583891:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1091 00000100:00100000:3.0:1777497436.583911:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:65700:x1863837546271104:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1777497436.583931:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497436.583949:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0ce expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584008:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584022:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584033:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584042:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584049:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584055:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584172:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584180:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584186:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497436.584235:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x4:0x0]: returning size 0 00000004:00200000:3.0:1777497436.584238:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497436.584260:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584271:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584282:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584289:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584296:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584303:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584308:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497436.584312:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584319:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584330:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:3.0:1777497436.584333:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497436.584337:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584352:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584366:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584372:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584377:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584382:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497436.584385:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584390:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584396:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f8fce00) 00010000:00010000:3.0:1777497436.584399:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497436.584401:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584407:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584429:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ce expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584440:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ce expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.584453:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff92409f8fc800) 00010000:00010000:3.0:1777497436.584456:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497436.584458:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee800, rc 0) 00000100:00100000:2.0:1777497436.585722:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65700:x1863837546271104:12345-192.168.202.4@tcp:101:rm.0 Request processed in 1806us (2277us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497436.585732:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1091 00000100:00100000:2.0:1777497436.592085:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497436.592204:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271360 00000100:00100000:3.0:1777497436.592215:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271360 00000100:00100000:3.0:1777497436.592282:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1092 00000100:00100000:3.0:1777497436.592292:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65700:x1863837546271360:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1777497436.592358:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777497436.592383:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1b6 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ce expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592404:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff92409f8fc800) 00010000:00010000:3.0:1777497436.592421:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dde00/0x3e357265691c19a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0c7 expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592431:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924083c2b500) 00010000:00010000:3.0:1777497436.592438:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497436.592463:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592477:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592486:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592496:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592517:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592524:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592598:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592607:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592614:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592810:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592819:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592827:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592833:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592839:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592845:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592887:0:63727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497436.592907:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592914:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592919:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592925:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497436.592929:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592936:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592945:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff92409f8fc500) 00010000:00010000:3.0:1777497436.592948:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777497436.592951:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592956:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1cb lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592973:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592979:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592985:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.592996:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593001:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497436.593003:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593009:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593015:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fcf00) 00010000:00010000:3.0:1777497436.593018:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497436.593020:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593025:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497436.593036:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006851ba52 reply state 000000007aa0c22e transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593047:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497436.593052:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f8fce00) 00010000:00010000:3.0:1777497436.593054:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497436.593056:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497436.593194:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65700:x1863837546271360:12345-192.168.202.4@tcp:36:rm.0 Request processed in 902us (1118us total) trans 98784247814 rc 0/0 00000100:00100000:3.0:1777497436.593202:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1092 00010000:00010000:0.0:1777497436.593378:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497436.593385:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.593391:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497436.593394:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.593400:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.593408:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff92409f8fc500) 00010000:00010000:0.0:1777497436.593410:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777497436.593413:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.593418:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1d2 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497436.593437:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497436.593439:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497436.593441:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497437.347219:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497438.243215:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497438.243240:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564841856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497438.243311:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497438.243360:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841856 00000100:00100000:0.0:1777497438.243367:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841856 00000100:00100000:0.0:1777497438.243420:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1777497438.243428:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564841856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497438.243455:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497438.243495:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564841856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497438.243502:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00080000:0.0:1777497438.243523:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497438.243557:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564841856:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497438.243697:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497438.243705:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564841984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497438.243729:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497438.243752:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564841984 00000100:00100000:0.0:1777497438.243756:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564841984 00000100:00100000:0.0:1777497438.243784:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1967 00000100:00100000:0.0:1777497438.243789:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564841984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497438.243806:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497438.243836:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564841984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497438.243854:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1967 00000100:00080000:0.0:1777497438.243871:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497438.243889:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564841984:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497438.370510:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497439.401654:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497439.778410:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497439.778444:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409094d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564842112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497439.778543:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.779011:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564842624:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.779086:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.779193:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564843136:0@lo:400:kworker.0 00000100:00100000:1.0:1777497439.779228:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564842496:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.779228:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.779258:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564843648:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.779452:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842624 00000100:00100000:3.0:1777497439.779463:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842624 00000100:00100000:3.0:1777497439.779540:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1777497439.779554:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564842624:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497439.779590:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086ea0000 x1863837564842624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:195/0 lens 224/224 e 0 to 0 dl 1777497450 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497439.783260:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497439.783287:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843136 00000100:00100000:2.0:1777497439.783299:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843136 00000100:00100000:2.0:1777497439.783368:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:2.0:1777497439.783379:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564843136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784017:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784055:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777497439.784063:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564842240:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784087:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784121:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564842752:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784152:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784175:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564843264:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784195:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784223:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842112 00000100:00100000:0.0:1777497439.784227:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842112 00000100:00100000:0.0:1777497439.784258:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1777497439.784265:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564842112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497439.784295:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497439.784331:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564842112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (5788us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497439.784338:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3849 00000100:00100000:0.0:1777497439.784377:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564842368:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784402:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784420:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564842880:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784437:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784450:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564843392:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.784467:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497439.784489:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843648 00000100:00100000:0.0:1777497439.784493:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843648 00000100:00100000:0.0:1777497439.786428:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842752 00000100:00100000:0.0:1777497439.786439:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842752 00000100:00100000:0.0:1777497439.786482:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843264 00000100:00100000:0.0:1777497439.786485:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843264 00000100:00100000:0.0:1777497439.786497:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842368 00000100:00100000:0.0:1777497439.786500:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842368 00000100:00100000:0.0:1777497439.786518:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1777497439.786526:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564843648:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1777497439.786551:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086ea0380 x1863837564843648/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:195/0 lens 224/224 e 0 to 0 dl 1777497450 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497439.793365:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497439.793432:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564843008:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.793878:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564842624:12345-0@lo:400:kworker.0 Request processed in 14326us (14788us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.793891:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1777497439.794373:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842496 00000100:00100000:3.0:1777497439.794385:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842496 00000100:00100000:3.0:1777497439.794438:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1777497439.794449:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564842752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.795653:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564842752:12345-0@lo:400:kworker.0 Request processed in 1196us (11489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.795666:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:3.0:1777497439.795704:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1777497439.795715:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564843264:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497439.795751:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5ba4380 x1863837564843264/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:195/0 lens 224/224 e 0 to 0 dl 1777497450 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497439.795789:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564843264:12345-0@lo:400:kworker.0 Request processed in 79us (11593us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.795796:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:3.0:1777497439.795810:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1777497439.795836:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564842368:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497439.795851:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5ba7480 x1863837564842368/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:195/0 lens 224/224 e 0 to 0 dl 1777497450 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497439.795896:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564842368:12345-0@lo:400:kworker.0 Request processed in 61us (11494us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.795902:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1777497439.795915:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1777497439.795922:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564842496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.795953:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564842496:12345-0@lo:400:kworker.0 Request processed in 32us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.795958:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1777497439.796000:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843392 00000100:00100000:3.0:1777497439.796009:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843392 00000100:00100000:3.0:1777497439.796076:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:0.0:1777497439.796088:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564843648:12345-0@lo:400:kworker.0 Request processed in 9540us (12049us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497439.796107:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1777497439.796117:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564843392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.796173:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564843392:12345-0@lo:400:kworker.0 Request processed in 84us (11703us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.796180:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:3.0:1777497439.796205:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842240 00000100:00100000:3.0:1777497439.796209:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842240 00000100:00100000:3.0:1777497439.796249:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1777497439.796260:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564842240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.796266:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564842880 00000100:00100000:0.0:1777497439.796276:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564842880 00000100:00100000:3.0:1777497439.796298:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564842240:12345-0@lo:400:kworker.0 Request processed in 42us (12208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497439.796306:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1777497439.796329:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3850 00000100:00100000:0.0:1777497439.796342:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564842880:12345-0@lo:400:kworker.0 00010000:00000080:0.0:1777497439.796374:0:8407:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5ba5880 x1863837564842880/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:195/0 lens 224/224 e 0 to 0 dl 1777497450 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497439.796380:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497439.796388:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497439.796391:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497439.796413:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564842240:0@lo:400:kworker.0 00000100:00100000:2.0:1777497439.796431:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564843136:12345-0@lo:400:kworker.0 Request processed in 13050us (17199us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497439.796438:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564842880:12345-0@lo:400:kworker.0 Request processed in 102us (12000us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497439.796440:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1777497439.796446:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3850 00000100:00100000:3.0:1777497439.796461:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564842752:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.796480:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564843264:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.796508:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564842624:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.796521:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564843136:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.796541:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564843648:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.796832:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564842368:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.796854:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564842880:0@lo:400:kworker.0 00000100:00100000:0.0:1777497439.796865:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564843392:0@lo:400:kworker.0 00000100:00100000:2.0:1777497439.797287:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409094d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564842112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497439.801344:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497439.801426:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564843520:0@lo:400:kworker.0 00000100:00100000:1.0:1777497439.801494:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497439.801570:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564842496:0@lo:400:kworker.0 00000100:00100000:2.0:1777497439.802627:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843008 00000100:00100000:2.0:1777497439.802642:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843008 00000100:00100000:2.0:1777497439.802699:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843520 00000100:00100000:2.0:1777497439.802702:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843520 00000100:00100000:2.0:1777497439.802770:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00080000:3.0:1777497439.802778:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497439.802788:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564843008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497439.802891:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564843008:12345-0@lo:400:kworker.0 Request processed in 112us (1556us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497439.802904:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1777497439.802927:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:2.0:1777497439.802933:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564843520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497439.802963:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564843520:12345-0@lo:400:kworker.0 Request processed in 31us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497439.802968:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1777497439.803034:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564843008:0@lo:400:kworker.0 00000100:00100000:3.0:1777497439.803049:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564843520:0@lo:400:kworker.0 00000100:00100000:1.0:1777497440.073395:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497440.073440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497440.073518:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271872 00000100:00100000:2.0:1777497440.073529:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271872 00000100:00100000:2.0:1777497440.073604:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2393 00000100:00100000:2.0:1777497440.073615:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546271872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497440.073693:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546271872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497440.073701:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2393 00000100:00100000:3.0:1777497440.073705:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271616 00000100:00100000:3.0:1777497440.073711:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271616 00000100:00100000:3.0:1777497440.073758:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1069 00000100:00100000:3.0:1777497440.073768:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2415:x1863837546271616:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:3.0:1777497440.073792:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409094c380 x1863837546271616/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:196/0 lens 224/224 e 0 to 0 dl 1777497451 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497440.073839:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2415:x1863837546271616:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497440.073846:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1069 00000100:00080000:1.0:1777497440.074403:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497440.074408:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497440.089277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497440.089351:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497440.089390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497440.089430:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272000 00000100:00100000:1.0:1777497440.089440:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272000 00000100:00100000:1.0:1777497440.089497:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2394 00000100:00100000:1.0:1777497440.089508:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546272000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497440.089565:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546272000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497440.089570:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2394 00000100:00080000:1.0:1777497440.089675:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497440.089720:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271744 00000100:00100000:2.0:1777497440.089725:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271744 00000100:00100000:2.0:1777497440.089770:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1070 00000100:00100000:2.0:1777497440.089777:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546271744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497440.089814:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546271744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497440.089821:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1070 00000100:00080000:1.0:1777497440.092487:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497440.094721:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271488 00000100:00100000:0.0:1777497440.094734:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271488 00000100:00100000:0.0:1777497440.094795:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:0.0:1777497440.094806:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546271488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497440.094892:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546271488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 88us (5625us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497440.094900:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:1.0:1777497440.294056:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497440.294077:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564843776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497440.294168:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497440.294205:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497440.294215:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564843904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497440.294243:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497440.294431:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497440.294441:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564844032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497440.294467:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497440.294511:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843776 00000100:00100000:0.0:1777497440.294518:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843776 00000100:00100000:0.0:1777497440.294559:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844032 00000100:00100000:0.0:1777497440.294562:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844032 00000100:00100000:0.0:1777497440.294582:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1777497440.294590:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564843776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497440.294618:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497440.294663:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564843776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497440.294694:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:0.0:1777497440.294711:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1777497440.294718:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564844032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497440.294734:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497440.294766:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564844032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497440.294772:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1777497440.294791:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564843904 00000100:00100000:0.0:1777497440.294794:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564843904 00000100:00100000:0.0:1777497440.294821:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1777497440.294827:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564843904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497440.294849:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00010000:00000080:0.0:1777497440.294861:0:8406:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b8a680 x1863837564843904/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:196/0 lens 224/368 e 0 to 0 dl 1777497451 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497440.294890:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564843904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 62us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497440.294896:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3851 00000100:00100000:0.0:1777497440.294949:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564844032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497440.294980:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564843776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497440.295310:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564843904:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1777497440.419861:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497441.443265:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497442.467273:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497442.703412:0:82918:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1777497442.814261:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497442.814355:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272128 00000100:00100000:3.0:1777497442.814365:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272128 00000100:00100000:3.0:1777497442.814441:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1093 00000100:00100000:3.0:1777497442.814451:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:65767:x1863837546272128:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497442.814615:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497442.814641:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0d5 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497442.814741:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1777497442.815227:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.815243:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.815257:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497442.815302:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497442.815306:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497442.815341:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.815366:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691c1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0d5 expref: 12 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.815386:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0d5 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.815396:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240c216f300) 00010000:00010000:3.0:1777497442.815399:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497442.815403:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefa00, rc 0) 00010000:00000080:3.0:1777497442.815411:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409882aa00 x1863837546272128/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:198/0 lens 576/688 e 0 to 0 dl 1777497453 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497442.815820:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65767:x1863837546272128:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1368us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497442.815836:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1093 00000100:00100000:2.0:1777497442.832134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497442.832209:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272256 00000100:00100000:3.0:1777497442.832219:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272256 00000100:00100000:3.0:1777497442.832279:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1094 00000100:00100000:3.0:1777497442.832289:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65767:x1863837546272256:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497442.832310:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497442.832329:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0dc expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832389:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832403:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832414:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832429:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832435:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832442:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832531:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832553:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832559:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497442.832597:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777497442.832601:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497442.832619:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832630:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832637:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832643:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832649:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832655:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497442.832660:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832667:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832679:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240c216f300) 00010000:00010000:3.0:1777497442.832683:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497442.832694:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832701:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691c1ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832716:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832722:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832728:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832733:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497442.832736:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832742:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832750:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9240c216f400) 00010000:00010000:3.0:1777497442.832752:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497442.832755:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832762:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef800/0x3e357265691c1f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832790:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691c1e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0dc expref: 13 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832815:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0dc expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497442.832823:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:3.0:1777497442.832826:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1777497442.832828:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee000, rc 0) 00010000:00000080:3.0:1777497442.832835:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d82d80 x1863837546272256/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:198/0 lens 592/688 e 0 to 0 dl 1777497453 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497442.832892:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+12:65767:x1863837546272256:12345-192.168.202.4@tcp:101:touch.0 Request processed in 606us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497442.832900:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1094 00000100:00100000:3.0:1777497442.840759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497442.840898:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272512 00000100:00100000:2.0:1777497442.840908:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272512 00000100:00100000:2.0:1777497442.840967:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1095 00000100:00100000:2.0:1777497442.840978:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+12:65767:x1863837546272512:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497442.841000:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497442.841018:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c203 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0e3 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841172:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841189:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841199:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841212:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841218:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841224:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841647:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841658:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841680:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497442.841719:0:65418:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1777497442.841722:0:65418:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 0 -> 1777497442 00000004:00010000:2.0:1777497442.841725:0:65418:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 0 -> 1777497442 00000004:00010000:2.0:1777497442.841727:0:65418:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 0 -> 1777497442 00000004:00010000:2.0:1777497442.841730:0:65418:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:2.0:1777497442.841733:0:65418:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:2.0:1777497442.841739:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841745:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 4/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841752:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841758:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841764:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497442.841769:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841776:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 5/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841787:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:2.0:1777497442.841790:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497442.841800:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 3/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841806:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95c00/0x3e357265691c20a lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497442.841820:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004060ad71 reply state 000000008efab980 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841830:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841836:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff923f83b83100) 00010000:00010000:2.0:1777497442.841839:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497442.841841:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497442.841869:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94600/0x3e357265691c203 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 15 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841882:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 14 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.841889:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff923f83b83000) 00010000:00010000:2.0:1777497442.841891:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:2.0:1777497442.841893:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086e95600, rc 0) 00010000:00000080:2.0:1777497442.841900:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f844cca80 x1863837546272512/t98784247815(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:198/0 lens 752/824 e 0 to 0 dl 1777497453 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497442.841969:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+15:65767:x1863837546272512:12345-192.168.202.4@tcp:101:touch.0 Request processed in 994us (1221us total) trans 98784247815 rc 0/0 00000100:00100000:2.0:1777497442.841977:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1095 00000001:00080000:3.0:1777497442.842577:0:81808:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247815 is committed 00010000:00010000:2.0:1777497442.842949:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.842967:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.842973:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.842978:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497442.842981:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.842988:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.842999:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f8fce00) 00010000:00010000:2.0:1777497442.843002:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497442.843005:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843011:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c18c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843026:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843031:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843037:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843041:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497442.843050:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843056:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843065:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f8fce00) 00010000:00010000:2.0:1777497442.843067:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497442.843070:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843075:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c1c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843121:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843128:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843134:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843138:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497442.843141:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843147:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843154:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff923f83b83100) 00010000:00010000:2.0:1777497442.843156:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497442.843165:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.843171:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c211 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497442.865687:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497442.869383:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272768 00000100:00100000:0.0:1777497442.869399:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272768 00000100:00100000:2.0:1777497442.870445:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1096 00000100:00100000:2.0:1777497442.870460:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:65767:x1863837546272768:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:2.0:1777497442.870581:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.870599:0:63727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.870609:0:63727:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.870645:0:63727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497442.870659:0:63727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 9 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497442.870674:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63727:1863837564844160:192.168.202.4@tcp:104: 00000100:00100000:2.0:1777497442.870767:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497442.877802:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497442.877878:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272896 00000100:00100000:1.0:1777497442.877887:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272896 00010000:00010000:1.0:1777497442.877923:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497442.877966:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2534 00000100:00100000:1.0:1777497442.877976:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2414:x1863837546272896:12345-192.168.202.4@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1777497442.877994:0:6500:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 5/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878007:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878027:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878036:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff923f83b83000) 00010000:00010000:1.0:1777497442.878040:0:6500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1777497442.878043:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878060:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878066:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497442.878090:0:6500:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497442.878177:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2414:x1863837546272896:12345-192.168.202.4@tcp:102:ldlm_bl.0 Request processed in 202us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497442.878184:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2534 00000100:00100000:0.0:1777497442.881390:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:63727:1863837564844160:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497442.881418:0:63727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497442.881437:0:63727:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497442.881443:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497442.881568:0:63727:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:0.0:1777497442.881571:0:63727:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb mtime from disk: 1777497442 -> 1777497442 00000004:00010000:0.0:1777497442.881574:0:63727:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb atime from disk: 1777497442 -> 1777497442 00000004:00010000:0.0:1777497442.881576:0:63727:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb ctime from disk: 1777497442 -> 1777497442 00000004:00010000:0.0:1777497442.881578:0:63727:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x5:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:0.0:1777497442.881585:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000290a4e1e reply state 000000003caeee87 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497442.881601:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497442.881609:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff923f83b83000) 00010000:00010000:0.0:1777497442.881612:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497442.881616:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:0.0:1777497442.881664:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d80000 x1863837546272768/t98784247816(0) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:198/0 lens 488/456 e 0 to 0 dl 1777497453 ref 1 fl Interpret:/200/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497442.881742:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65767:x1863837546272768:12345-192.168.202.4@tcp:36:touch.0 Request processed in 11286us (16063us total) trans 98784247816 rc 0/0 00000100:00100000:0.0:1777497442.881750:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1096 00000100:00100000:0.0:1777497442.894468:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497442.894717:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273152 00000100:00100000:2.0:1777497442.894727:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273152 00000100:00100000:2.0:1777497442.894788:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:2.0:1777497442.894798:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:65767:x1863837546273152:12345-192.168.202.4@tcp:35:touch.0 00010000:00000080:2.0:1777497442.894973:0:63731:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50bf480 x1863837546273152/t98784247817(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:198/0 lens 392/456 e 0 to 0 dl 1777497453 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497442.895036:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:65767:x1863837546273152:12345-192.168.202.4@tcp:35:touch.0 Request processed in 239us (590us total) trans 98784247817 rc 0/0 00000100:00100000:2.0:1777497442.895044:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 221 00000100:00100000:3.0:1777497443.362895:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564844416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497443.362965:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497443.363017:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497443.363023:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564844288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497443.363046:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497443.363299:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844416 00000100:00100000:0.0:1777497443.363319:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844416 00000100:00100000:0.0:1777497443.363375:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844288 00000100:00100000:0.0:1777497443.363378:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844288 00000100:00100000:0.0:1777497443.363399:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:0.0:1777497443.363409:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564844416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497443.363436:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497443.363477:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564844416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497443.363483:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:0.0:1777497443.363498:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:0.0:1777497443.363504:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564844288:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497443.363518:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497443.363542:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564844288:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497443.363548:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00080000:3.0:1777497443.363609:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497443.363614:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497443.363660:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564844288:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497443.363686:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564844416:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777497443.492073:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497444.516354:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497444.900809:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564844928:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.900874:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.900916:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564845440:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.900940:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.900956:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564845952:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.900975:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.900997:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777497444.901003:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564844800:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901025:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.901042:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564845312:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901061:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.901085:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564845824:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901127:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497444.901158:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844928 00000100:00100000:3.0:1777497444.901166:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844928 00000100:00100000:3.0:1777497444.901215:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844800 00000100:00100000:3.0:1777497444.901218:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844800 00000100:00100000:3.0:1777497444.901239:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1777497444.901248:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564844928:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497444.901271:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82cb0a80 x1863837564844928/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:200/0 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497444.901308:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564844928:12345-0@lo:400:kworker.0 Request processed in 62us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901314:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:3.0:1777497444.901329:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1777497444.901334:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564844800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901356:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564844800:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901368:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1777497444.901384:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845440 00000100:00100000:3.0:1777497444.901388:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845440 00000100:00100000:3.0:1777497444.901407:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845952 00000100:00100000:3.0:1777497444.901410:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845952 00000100:00100000:3.0:1777497444.901425:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845312 00000100:00100000:3.0:1777497444.901428:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845312 00000100:00100000:3.0:1777497444.901440:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845824 00000100:00100000:3.0:1777497444.901442:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845824 00000100:00100000:3.0:1777497444.901460:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1777497444.901466:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564845440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901495:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564845440:12345-0@lo:400:kworker.0 Request processed in 29us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901500:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1777497444.901511:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:3.0:1777497444.901517:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564845952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901543:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564845952:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901548:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:3.0:1777497444.901558:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1777497444.901563:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564845312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901586:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564845312:12345-0@lo:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901590:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1777497444.901599:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:3.0:1777497444.901605:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564845824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901639:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564845824:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.901645:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00080000:3.0:1777497444.901674:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497444.901677:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497444.901680:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497444.901682:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497444.901723:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564844800:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901733:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564845312:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901742:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564845824:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901750:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564844928:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901759:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564845440:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.901767:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564845952:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.901870:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564844544:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.901902:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.901936:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564845056:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.901957:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.901975:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564845568:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.901993:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.902018:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564846080:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902038:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.902056:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1777497444.902061:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564844672:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902091:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.902131:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564845184:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902151:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.902166:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564845696:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902180:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.902207:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845056 00000100:00100000:1.0:1777497444.902212:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845056 00000100:00100000:1.0:1777497444.902244:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845568 00000100:00100000:1.0:1777497444.902246:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845568 00000100:00100000:1.0:1777497444.902262:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846080 00000100:00100000:1.0:1777497444.902264:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846080 00000100:00100000:1.0:1777497444.902275:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844672 00000100:00100000:1.0:1777497444.902277:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844672 00000100:00100000:1.0:1777497444.902290:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1777497444.902295:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564845056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902327:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564845056:12345-0@lo:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902332:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1777497444.902342:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1777497444.902348:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564845568:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497444.902356:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b8b480 x1863837564845568/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:200/0 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497444.902379:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564845568:12345-0@lo:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902390:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1777497444.902402:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1777497444.902406:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564846080:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497444.902415:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b89c00 x1863837564846080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:200/0 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497444.902438:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564846080:12345-0@lo:400:kworker.0 Request processed in 32us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902443:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1777497444.902455:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1777497444.902461:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564844672:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497444.902470:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b8aa00 x1863837564844672/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:200/0 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497444.902493:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564844672:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902498:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:1.0:1777497444.902520:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845184 00000100:00100000:1.0:1777497444.902523:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845184 00000100:00100000:1.0:1777497444.902546:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564845696 00000100:00100000:1.0:1777497444.902549:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564845696 00000100:00100000:1.0:1777497444.902564:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1777497444.902569:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564845184:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497444.902579:0:8407:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b88000 x1863837564845184/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:200/0 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497444.902603:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564845184:12345-0@lo:400:kworker.0 Request processed in 34us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902617:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3852 00000100:00100000:1.0:1777497444.902631:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3853 00000100:00100000:1.0:1777497444.902636:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564845696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902662:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564845696:12345-0@lo:400:kworker.0 Request processed in 26us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.902668:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3853 00000100:00080000:1.0:1777497444.902698:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497444.902700:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497444.902722:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564844672:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902731:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564845184:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902738:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564845696:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902745:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564845056:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902753:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564845568:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.902760:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564846080:0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.904263:0:81818:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564844544 00000100:00100000:3.0:1777497444.904274:0:81818:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564844544 00000100:00100000:3.0:1777497444.904323:0:81818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1777497444.904333:0:81818:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564844544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497444.904403:0:81818:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564844544:12345-0@lo:400:kworker.0 Request processed in 73us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497444.904409:0:81818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1777497444.904577:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564844544:0@lo:400:kworker.0 00000100:00100000:1.0:1777497444.907224:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497444.907246:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564846208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497444.907305:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497444.907343:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846208 00000100:00100000:1.0:1777497444.907348:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846208 00000100:00100000:1.0:1777497444.907385:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1777497444.907392:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564846208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497444.907433:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497444.907473:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564846208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497444.907479:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3854 00000100:00100000:1.0:1777497444.907522:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564846208:0@lo:41:osp-pre-1-0.0 00000020:01000004:0.0:1777497445.044633:0:83016:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1777497445.044686:0:83016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497445.044700:0:83016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497445.044706:0:83016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497445.044714:0:83016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497445.044759:0:83016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777497445.044765:0:83016:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1777497445.044796:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497445.044801:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1777497445.044806:0:83016:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1777497445.044830:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b7800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1777497445.044961:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497445.044967:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.044974:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497445.044976:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.044984:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497445.044991:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497445.044996:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497445.044998:0:16604:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1777497445.045001:0:16604:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1777497445.045024:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.045030:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497445.045057:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.045071:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691bdaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdb1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.045091:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497445.045115:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497445.045117:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497445.045132:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564846336:0@lo:39:umount.0 00000100:00100000:2.0:1777497445.045196:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497445.046967:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497445.047027:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497445.047559:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846464 00000100:00100000:2.0:1777497445.047569:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846464 00000100:00100000:2.0:1777497445.047631:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1777497445.047641:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564846464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497445.047654:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497445.047671:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9000/0x3e357265691bdb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bdaa expref: 23 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.047688:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497445.047730:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3659:x1863837564846464:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497445.047736:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:2.0:1777497445.047779:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497445.052568:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846336 00000100:00100000:0.0:1777497445.052584:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846336 00000100:00100000:0.0:1777497445.052679:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1777497445.052689:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564846336:12345-0@lo:39:umount.0 00000020:00000080:0.0:1777497445.052722:0:64885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bec2 00000100:00080000:0.0:1777497445.052739:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f8275e800 : changing import state from FULL to CLOSED 00010000:00000080:0.0:1777497445.052767:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240865dad80 x1863837564846336/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:201/0 lens 224/224 e 0 to 0 dl 1777497456 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497445.052839:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837564846336:12345-0@lo:39:umount.0 Request processed in 152us (7643us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497445.052845:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000020:00000080:0.0:1777497445.052856:0:64885:0:(genops.c:906:class_export_put()) final put ffff923f8275c000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1777497445.052940:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497445.053140:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8275c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497445.053194:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f8275e800 for lustre-MDT0000 00000100:00080000:2.0:1777497445.053233:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b7800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497445.053247:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564846336:0@lo:39:umount.0 00000100:00080000:0.0:1777497445.053459:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497445.053463:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777497445.053468:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1777497445.057454:0:83016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057472:0:83016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057478:0:83016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057484:0:83016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057499:0:83016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497445.057505:0:83016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057510:0:83016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057516:0:83016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057522:0:83016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057582:0:83016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497445.057588:0:83016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057843:0:83016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057862:0:83016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.057867:0:83016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.057893:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497445.057900:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.057914:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497445.057917:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.057925:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497445.057931:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497445.057937:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1777497445.057939:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1777497445.057970:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.057976:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497445.058006:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058012:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5b400/0x3e357265691bcd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcdf expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058028:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497445.058031:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058037:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353a00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497445.058040:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058054:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497445.058059:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497445.058063:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1777497445.058065:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1777497445.058066:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1777497445.058087:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058246:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497445.058263:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058269:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f84353a00/0x3e357265691bde9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bdf0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058278:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497445.058280:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058286:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497445.058289:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058295:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497445.058310:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497445.058315:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1777497445.058317:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1777497445.058329:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058334:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497445.058340:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.058348:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497445.058349:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497445.058351:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497445.058360:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497445.058377:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497445.058885:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497445.058980:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564846848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497445.059006:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777497445.059053:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497445.059064:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564846720:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497445.059760:0:83016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497445.059768:0:83016:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f84352e00/0x3e357265691bd9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bda3 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497445.059781:0:83016:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1777497445.059792:0:83016:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.059799:0:83016:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.059805:0:83016:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.059810:0:83016:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.059825:0:83016:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1777497445.059828:0:83016:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1777497445.059831:0:83016:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1777497445.059863:0:83016:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1777497445.059867:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1777497445.059871:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1777497445.059885:0:83016:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1777497445.061607:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497445.061618:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.061629:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497445.061632:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.061641:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497445.061647:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497445.061653:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497445.061655:0:16604:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1777497445.061657:0:16604:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1777497445.061696:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.061702:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497445.061741:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.061748:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691bcca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691bcd1 expref: -99 pid: 81807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.061762:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497445.061764:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497445.061766:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497445.061790:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497445.061849:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497445.062141:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497445.062212:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846592 00000100:00100000:1.0:1777497445.062219:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846592 00000100:00100000:1.0:1777497445.062260:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846848 00000100:00100000:1.0:1777497445.062263:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846848 00000100:00100000:1.0:1777497445.062280:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846976 00000100:00100000:1.0:1777497445.062283:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846976 00000100:00100000:1.0:1777497445.062302:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1777497445.062310:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3659:x1863837564846592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497445.062324:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497445.062340:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691bcdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bcd8 expref: 24 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.062352:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497445.062389:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564846592:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (3953us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.062395:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1777497445.062414:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1777497445.062419:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837564846848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497445.062451:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497445.062460:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefc00/0x3e357265691bda3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bd9c expref: 22 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.062468:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497445.062495:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3658:x1863837564846848:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (3488us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.062501:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1777497445.062514:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1777497445.062520:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3659:x1863837564846976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497445.062526:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497445.062534:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f84353200/0x3e357265691bcd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bcca expref: 20 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.062543:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497445.062562:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3659:x1863837564846976:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.062567:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1777497445.062618:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497445.062628:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564846592:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1777497445.063286:0:83016:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1777497445.063781:0:81808:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:2.0:1777497445.064451:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064463:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064469:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064474:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497445.064479:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064486:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064502:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff923f83b83000) 00010000:00010000:2.0:1777497445.064505:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497445.064509:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497445.064514:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e94e00/0x3e357265691c226 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1777497445.064571:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1777497445.064578:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240888ef800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497445.064584:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240a6373800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497445.064588:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240a6375800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497445.064603:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240911d0000 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497445.064618:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240911d7000 6d03493e-1218-49f3-bdd0-b10716c402e0 192.168.202.4@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 98784247817 stale:0 00000020:00080000:2.0:1777497445.064623:0:83016:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff923f82aa8000) has exports, disconnecting them 00000020:00080000:2.0:1777497445.064627:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240888ef800), last request at 1777497414 00000020:00000080:2.0:1777497445.064634:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bebb 00000100:00080000:2.0:1777497445.064640:0:83016:0:(import.c:65:import_set_state_nolock()) ffff923f8275b000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497445.064662:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240888ef800): rc 0 00000020:00000080:2.0:1777497445.064664:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240888ef800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1777497445.064673:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240a6373800), last request at 1777497444 00000020:00000080:2.0:1777497445.064676:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691beb4 00000100:00080000:2.0:1777497445.064680:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240a6370800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497445.064686:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240a6373800): rc 0 00000020:00000080:2.0:1777497445.064688:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240a6373800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1777497445.064691:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240a6375800), last request at 1777497444 00000020:00000080:2.0:1777497445.064693:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bead 00000100:00080000:2.0:1777497445.064697:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240a6370000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497445.064704:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240a6375800): rc 0 00000020:00000080:2.0:1777497445.064705:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240a6375800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1777497445.064709:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240911d0000), last request at 1777497408 00000020:00000080:2.0:1777497445.064716:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd1e 00000100:00080000:2.0:1777497445.064725:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b0800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497445.064763:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240911d0000): rc 0 00000020:00000080:2.0:1777497445.064766:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240911d0000/lustre-MDT0001-mdtlov_UUID 00000020:00080000:2.0:1777497445.064770:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff9240911d7000), last request at 1777497442 00000020:00000080:2.0:1777497445.064774:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd17 00000020:00010000:2.0:1777497445.064778:0:83016:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240911d7000: total 4 00000100:00080000:2.0:1777497445.064782:0:83016:0:(import.c:65:import_set_state_nolock()) ffff923f8275f800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497445.064787:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff9240911d7000): rc 0 00000004:00000080:2.0:1777497445.064798:0:83016:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef017afae0 00000100:00080000:2.0:1777497445.064816:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1777497445.064819:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1777497445.065754:0:83016:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1777497445.065780:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240a68ce000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1777497445.065817:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847104:0@lo:39:umount.0 00000100:00100000:2.0:1777497445.065899:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00010000:1.0:1777497445.066819:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240911d7000: total 4 00010000:00010000:1.0:1777497445.066824:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497445.066882:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240911d7000, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1777497445.066917:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c1e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0d5 expref: 4 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.066968:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086e95600/0x3e357265691c218 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 3 pid: 65418 timeout: 3672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.066984:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691c1fc lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0dc expref: 2 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497445.066996:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240911d7000, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1777497445.068926:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497445.068981:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564846848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497445.069024:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497445.069660:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564846720 00000100:00100000:0.0:1777497445.070172:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564846720 00000100:00100000:0.0:1777497445.070241:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1777497445.070263:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409b411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3657:x1863837564846720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497445.070278:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497445.070296:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b800/0x3e357265691bdf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bde9 expref: 19 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497445.070313:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497445.070367:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409b411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3657:x1863837564846720:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497445.070373:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1777497445.070584:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564846720:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1777497445.071193:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240888ef800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497445.071241:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a6373800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497445.071264:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a6375800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497445.071286:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497445.071321:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f8275b000 for lustre-MDT0000 00000020:00000080:2.0:1777497445.071326:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a6370800 for lustre-MDT0000 00000020:00000080:2.0:1777497445.071329:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a6370000 for lustre-MDT0000 00000020:00000080:2.0:1777497445.071331:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b0800 for lustre-MDT0000 00010000:00010000:3.0:1777497445.071533:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497445.072281:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497445.072384:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497445.072389:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:2.0:1777497445.072407:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:2.0:1777497445.072474:0:83016:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1777497445.072500:0:83016:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1777497445.072524:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497445.072526:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 3 00000004:00080000:2.0:1777497445.072549:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497445.072778:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847232:0@lo:9:umount.0 00000100:00100000:0.0:1777497445.072838:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497445.072929:0:83016:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1777497445.072941:0:83016:0:(import.c:65:import_set_state_nolock()) ffff9240849d5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1777497445.072996:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff923f82aa8000) has no exports 00000100:00100000:0.0:1777497445.073055:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847360:0@lo:9:umount.0 00000100:00100000:0.0:1777497445.073091:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497445.073301:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847232 00000100:00100000:2.0:1777497445.073309:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847232 00000100:00100000:2.0:1777497445.073352:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847360 00000100:00100000:2.0:1777497445.073355:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847360 00000100:00100000:2.0:1777497445.073377:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5837 00000100:00100000:2.0:1777497445.073386:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564847232:12345-0@lo:9:umount.0 00000020:00000080:2.0:1777497445.073411:0:25491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd79 00000100:00080000:2.0:1777497445.073420:0:25491:0:(import.c:65:import_set_state_nolock()) ffff9240b543a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497445.073549:0:25491:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:2.0:1777497445.073785:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564847232:12345-0@lo:9:umount.0 Request processed in 400us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497445.073793:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5837 00000100:00100000:2.0:1777497445.073810:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5838 00000100:00100000:2.0:1777497445.073816:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564847360:12345-0@lo:9:umount.0 00000020:00000080:2.0:1777497445.073829:0:25491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd87 00000100:00080000:2.0:1777497445.073836:0:25491:0:(import.c:65:import_set_state_nolock()) ffff923f82758000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497445.074208:0:25491:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969447 00000100:00100000:2.0:1777497445.074299:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564847360:12345-0@lo:9:umount.0 Request processed in 483us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497445.074307:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5838 00010000:00010000:2.0:1777497445.074336:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497445.074381:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240849d5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497445.074392:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497445.074393:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.074396:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847360:0@lo:9:umount.0 00000100:00080000:2.0:1777497445.074419:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497445.074424:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497445.074425:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.074427:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847232:0@lo:9:umount.0 00010000:00010000:3.0:1777497445.074668:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497445.075184:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847104 00000100:00100000:0.0:1777497445.075191:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847104 00000100:00100000:0.0:1777497445.075232:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3855 00000100:00100000:0.0:1777497445.075240:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564847104:12345-0@lo:39:umount.0 00000020:00000080:0.0:1777497445.075261:0:8406:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd5d 00000100:00080000:0.0:1777497445.075267:0:8406:0:(import.c:65:import_set_state_nolock()) ffff923f82ab2800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777497445.075292:0:8406:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378731 00000100:00100000:0.0:1777497445.075411:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837564847104:12345-0@lo:39:umount.0 Request processed in 172us (9512us total) trans 81604378732 rc 0/0 00000100:00100000:0.0:1777497445.075417:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3855 00000100:00080000:2.0:1777497445.075618:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240a68ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497445.075624:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564847104:0@lo:39:umount.0 00010000:00010000:3.0:1777497445.075751:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1777497445.083259:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff923f82aa8000) has no exports 00000020:00000080:1.0:1777497445.110779:0:6502:0:(genops.c:906:class_export_put()) final put ffff9240911d7000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:0.0:1777497445.111025:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d7000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0000 00000020:00000080:0.0:1777497445.111134:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f8275f800 for lustre-MDT0000 00010000:00010000:0.0:1777497445.111144:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497445.111162:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497445.111165:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497445.165290:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd33 00000020:00000080:2.0:1777497445.165303:0:83016:0:(genops.c:906:class_export_put()) final put ffff923f826ca800/lustre-QMT0000_UUID 00000020:01000000:2.0:1777497445.165316:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1777497445.165523:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826ca800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1777497445.165552:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497445.165563:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1777497445.165568:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff923f84b08000) has no exports 00000020:00000080:3.0:1777497445.165918:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd2c 00000020:00000080:3.0:1777497445.165937:0:83016:0:(genops.c:906:class_export_put()) final put ffff923f818b1800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497445.165993:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.166000:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777497445.166002:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240bb6f7000/lustre-QMT0000_UUID 00000020:00000080:3.0:1777497445.166005:0:83016:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb6f7000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1777497445.166011:0:83016:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497445.167418:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f818b1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1777497445.167531:0:83016:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924092d68c60 - data ffff9240b6195870/ffff9240bcbd4800 00000020:01000000:3.0:1777497445.167689:0:83016:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924098aba060 - data ffff9240b61a7288/ffff9240bc2dc800 00000100:00100000:1.0:1777497445.182201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497445.182247:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497445.182277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497445.182301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497445.182324:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497445.182351:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273792 00000100:00100000:1.0:1777497445.182359:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273792 00000100:00100000:1.0:1777497445.182411:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273664 00000100:00100000:1.0:1777497445.182414:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273664 00000100:00100000:1.0:1777497445.182438:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2399 00000100:00100000:1.0:1777497445.182447:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546273792:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497445.182515:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546273792:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.182523:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2399 00000100:00100000:1.0:1777497445.182540:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2400 00000100:00100000:1.0:1777497445.182545:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546273664:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497445.182566:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546273664:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 21us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.182583:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2400 00000100:00100000:1.0:1777497445.182617:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273536 00000100:00100000:1.0:1777497445.182620:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273536 00000100:00100000:1.0:1777497445.182648:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273408 00000100:00100000:1.0:1777497445.182651:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273408 00000100:00100000:1.0:1777497445.182665:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00100000:1.0:1777497445.182671:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546273536:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497445.182699:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546273536:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497445.182705:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00100000:1.0:1777497445.182715:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1098 00000100:00100000:1.0:1777497445.182719:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2414:x1863837546273408:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:1.0:1777497445.182724:0:63728:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:1.0:1777497445.182744:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2414:x1863837546273408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497445.182749:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1098 00000100:00080000:1.0:1777497445.182766:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497445.182770:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497445.182772:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497445.182939:0:81812:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273280 00000100:00100000:0.0:1777497445.182944:0:81812:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273280 00000100:00100000:0.0:1777497445.182980:0:81812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:0.0:1777497445.182987:0:81812:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546273280:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497445.183026:0:81812:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6f0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546273280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 40us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497445.183032:0:81812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:1.0:1777497445.190508:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497445.190858:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273920 00000100:00100000:3.0:1777497445.190869:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273920 00000100:00100000:3.0:1777497445.190926:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1099 00000100:00100000:3.0:1777497445.190934:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546273920:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 00010000:02000000:3.0:1777497445.190953:0:64885:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 192.168.202.4@tcp (stopping) 00000100:00100000:3.0:1777497445.195984:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546273920:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 Request processed in 5038us (5474us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497445.195997:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1099 00000100:00080000:2.0:1777497445.265221:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1777497445.265229:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1777497445.265243:0:83016:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240865d9880 x1863837564847104/t81604378732(81604378732) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497455 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497445.265268:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1777497445.267153:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497445.267160:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:2.0:1777497445.267173:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.267176:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1777497445.268394:0:81826:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1777497445.268409:0:81826:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5c:0x0] index 1 count 1 00000040:00080000:0.0:1777497445.268421:0:81826:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 23 count 2 00000100:00080000:2.0:1777497445.269202:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497445.269209:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 4 00000004:00080000:2.0:1777497445.269222:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.269225:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1777497445.273570:0:81828:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1777497445.273582:0:81828:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x5e:0x0] index 1 count 1 00000040:00080000:3.0:1777497445.273603:0:81828:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 23 count 2 00000020:00000080:2.0:1777497445.275275:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bced 00000020:00000080:2.0:1777497445.275285:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c5d9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777497445.275909:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd02 00000020:00000080:2.0:1777497445.275914:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240911d0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497445.275919:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1777497445.275937:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497445.275947:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497445.275950:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff923f82aab380) has no exports 00000004:01000000:2.0:1777497445.276272:0:83016:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1777497445.276280:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd80 00000020:00000080:2.0:1777497445.276285:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c46f800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497445.276289:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777497445.276293:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497445.276298:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497445.276300:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9240a62e99c0) has no exports 00000020:00000080:2.0:1777497445.276305:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd72 00000020:00000080:2.0:1777497445.276308:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c12a800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1777497445.276619:0:83016:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777497445.276624:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497445.276629:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969447 gen 5 00000004:00080000:2.0:1777497445.276635:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.276637:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497445.276674:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497445.276680:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497445.276685:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd64 00000020:00000080:2.0:1777497445.276689:0:83016:0:(genops.c:906:class_export_put()) final put ffff923f826ce000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497445.276693:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777497445.276696:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497445.276699:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497445.276701:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff923f84b099c0) has no exports 00000020:00000080:2.0:1777497445.276705:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd56 00000020:00000080:2.0:1777497445.276708:0:83016:0:(genops.c:906:class_export_put()) final put ffff923f818b4800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497445.276986:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497445.276995:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1777497445.277000:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1777497445.277004:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c12a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497445.277008:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240849d5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1777497445.277013:0:82203:0:(genops.c:906:class_export_put()) final put ffff923f826c9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497445.277015:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826c9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1777497445.277018:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497445.277120:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826ce000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777497445.277132:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f818b4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1777497445.277578:0:83016:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777497445.277581:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497445.277583:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:2.0:1777497445.277588:0:83016:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497445.277589:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497445.277643:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497445.277650:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1777497445.277660:0:83016:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1777497445.277667:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd48 00000020:00000080:2.0:1777497445.277671:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c12c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497445.277675:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1777497445.277678:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497445.277681:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497445.277684:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240aecd8000) has no exports 00000020:00000080:2.0:1777497445.277688:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd41 00000020:00000080:2.0:1777497445.277690:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c5dd000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497445.278444:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f818b3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777497445.278452:0:82203:0:(genops.c:906:class_export_put()) final put ffff92409c12a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497445.278454:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c12a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1777497445.278459:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497445.278514:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c12c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777497445.278519:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5dd000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1777497445.278545:0:83016:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1777497445.278549:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497445.278551:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777497445.278556:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497445.278589:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.278596:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497445.278618:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.278622:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497445.278625:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c5d8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497445.278627:0:83016:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5d8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1777497445.278631:0:83016:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497445.278686:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd09 00000020:00000080:3.0:1777497445.278691:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240911d1000/lustre-MDD0000_UUID 00000020:01000000:3.0:1777497445.278696:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1777497445.278699:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497445.278703:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777497445.278705:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff923f82aacd40) has no exports 00000020:00000080:3.0:1777497445.278721:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.278724:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1777497445.278726:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bd10 00000020:00000080:3.0:1777497445.278729:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240911d5800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1777497445.278735:0:83016:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a6837800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1777497445.278738:0:83016:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a6837800 3 00000020:01000004:3.0:1777497445.278749:0:83016:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a6837800 from lustre-MDT0000 00000020:00000080:3.0:1777497445.278764:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.278767:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1777497445.278770:0:83016:0:(genops.c:906:class_export_put()) final put ffff92409c5db800/lustre-MDT0000_UUID 00000020:00000080:3.0:1777497445.278772:0:83016:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5db800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1777497445.278778:0:83016:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1777497445.278807:0:83016:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1777497445.278810:0:83016:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1777497445.278813:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1777497445.278816:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497445.278818:0:83016:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1777497445.278825:0:83016:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff92408a0a1800 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497445.278832:0:83016:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff92408a0a3800 95f1b493-372d-4153-ad35-48e1115be1b1 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497445.278836:0:83016:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9240a695b380) has exports, disconnecting them 00000020:00080000:3.0:1777497445.278840:0:83016:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff92408a0a1800), last request at 1777497408 00000020:00000080:3.0:1777497445.278857:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bcae 00000020:00010000:3.0:1777497445.278861:0:83016:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92408a0a1800: total 2 00000100:00080000:3.0:1777497445.278864:0:83016:0:(import.c:65:import_set_state_nolock()) ffff924098a6b800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497445.278875:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92408a0a1800): rc 0 00000020:00080000:3.0:1777497445.278878:0:83016:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff92408a0a3800), last request at 1777497408 00000020:00000080:3.0:1777497445.278914:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bca7 00000020:00010000:3.0:1777497445.278917:0:83016:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92408a0a3800: total 2 00000100:00080000:3.0:1777497445.278920:0:83016:0:(import.c:65:import_set_state_nolock()) ffff92408a0a7800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497445.278929:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff92408a0a3800): rc 0 00000020:00080000:3.0:1777497445.278933:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9240a695b380) has no exports 00000020:00010000:3.0:1777497445.278942:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92408a0a1800: total 2 00010000:00010000:3.0:1777497445.278964:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff92408a0a1800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1777497445.278990:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeee00/0x3e357265691be36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be2f expref: 14 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279015:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef600/0x3e357265691be98 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be91 expref: 13 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279027:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefe00/0x3e357265691be28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be21 expref: 12 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279037:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8000/0x3e357265691bea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be9f expref: 11 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279046:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f84352200/0x3e357265691be44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be3d expref: 10 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279055:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeea00/0x3e357265691be52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be4b expref: 9 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279065:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a600/0x3e357265691be60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be59 expref: 8 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279089:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a200/0x3e357265691be6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be67 expref: 7 pid: 81814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279123:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9600/0x3e357265691bdfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691bdf7 expref: 6 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279132:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a800/0x3e357265691be8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be83 expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279141:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b000/0x3e357265691be1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be13 expref: 4 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279163:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a400/0x3e357265691be7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be75 expref: 3 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279173:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f84352a00/0x3e357265691be0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691be05 expref: 2 pid: 81818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279182:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff92408a0a1800, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1777497445.279201:0:6503:0:(genops.c:906:class_export_put()) final put ffff92408a0a1800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00000020:00010000:3.0:1777497445.279206:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92408a0a3800: total 3 00010000:00010000:3.0:1777497445.279222:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff92408a0a3800, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1777497445.279237:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f84353800/0x3e357265691bdd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c088 expref: 5 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279250:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b600/0x3e357265691bde2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c096 expref: 4 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279262:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5ae00/0x3e357265691bdcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c081 expref: 3 pid: 81815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279275:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5be00/0x3e357265691bddb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c08f expref: 2 pid: 81812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497445.279284:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff92408a0a3800, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1777497445.279296:0:6503:0:(genops.c:906:class_export_put()) final put ffff92408a0a3800/95f1b493-372d-4153-ad35-48e1115be1b1 00010000:00010000:3.0:1777497445.279301:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497445.279302:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497445.279304:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497445.279369:0:81818:0:(service.c:3164:ptlrpc_main()) ll_mgs_0003: service thread [ffff923f8122f600:81818] 3 exiting: rc = 0 00010000:00010000:3.0:1777497445.279458:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497445.279642:0:81814:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff923f8417b600:81814] 1 exiting: rc = 0 00000100:00100000:0.0:1777497445.279704:0:81812:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff923f8417a000:81812] 0 exiting: rc = 1 00000020:00000080:0.0:1777497445.279742:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a68ce000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1777497445.279748:0:82203:0:(genops.c:906:class_export_put()) final put ffff9240a3af3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497445.279750:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1777497445.279754:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497445.279806:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1777497445.279809:0:82203:0:(genops.c:906:class_export_put()) final put ffff92409f60d800/lustre-MDD0000_UUID 00000020:00000080:0.0:1777497445.279811:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f60d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1777497445.279815:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1777497445.279842:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497445.279846:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:0.0:1777497445.279874:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a3800/95f1b493-372d-4153-ad35-48e1115be1b1 for MGS 00000020:00000080:0.0:1777497445.279885:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924098a6b800 for MGS 00000020:00000080:0.0:1777497445.279889:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92408a0a7800 for MGS 00000100:00100000:1.0:1777497445.280091:0:81815:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff923f84e3a200:81815] 2 exiting: rc = 0 00000100:00100000:3.0:1777497445.280429:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280446:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280454:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280459:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280464:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280469:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280473:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280479:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280484:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280489:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280494:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280500:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280505:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280511:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280516:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280522:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280527:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280533:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280539:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280544:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280549:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280554:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280559:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280564:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280569:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280574:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280580:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280585:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280590:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280595:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280600:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280605:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280611:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280616:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280621:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280635:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280641:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280646:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280652:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280657:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280662:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280668:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280673:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280679:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280684:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280689:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280695:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280700:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280706:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280711:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280716:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280721:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280726:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280731:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280737:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280742:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280761:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280767:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280773:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280778:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280783:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280789:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280795:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497445.280800:0:83016:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1777497445.282200:0:83016:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a6bb25a0 - data ffff9240a3353ca8/ffff9240bb704800 00000020:01000000:3.0:1777497445.282320:0:83016:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a6bb2840 - data ffff9240b6113798/ffff9240be1f8c00 00000020:00000080:3.0:1777497445.283625:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bca0 00000020:00000080:3.0:1777497445.283634:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240a68c8000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1777497445.283696:0:83016:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a6837800 from MGS, refs=2 00000020:01000004:3.0:1777497445.283713:0:83016:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a6837800 2 00000020:01000004:3.0:1777497445.283716:0:83016:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a6837800 from MGS 00000020:00000080:3.0:1777497445.283739:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497445.283801:0:83016:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1777497445.283805:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240a68cc800/MGS 00000020:00000080:3.0:1777497445.283808:0:83016:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68cc800/MGS for MGS 00000020:01000000:3.0:1777497445.283814:0:83016:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1777497445.283881:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1777497445.283886:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497445.283891:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1777497445.283897:0:83016:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9240ae4b2800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497445.283902:0:83016:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9240a695cd40) has exports, disconnecting them 00000020:00080000:3.0:1777497445.283907:0:83016:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9240ae4b2800), last request at 1777497408 00000020:00000080:3.0:1777497445.283910:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bdbf 00000020:00080000:3.0:1777497445.283920:0:83016:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240ae4b2800): rc 0 00000020:00000080:3.0:1777497445.283923:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240ae4b2800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1777497445.287489:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68c8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497445.288576:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b2800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1777497445.383188:0:83016:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1777497445.383196:0:83016:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497445.383200:0:83016:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777497445.383209:0:83016:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497445.383371:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497445.383380:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1777497445.383387:0:83016:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a6837800 1 00000020:00000080:2.0:1777497445.383394:0:83016:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691bc92 00000020:00000080:2.0:1777497445.383403:0:83016:0:(genops.c:906:class_export_put()) final put ffff9240a68c9000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1777497445.383408:0:83016:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1777497445.383414:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497445.383418:0:83016:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497445.383421:0:83016:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9240a62eb380) has no exports 00000020:00000080:0.0:1777497445.384182:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b7800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1777497445.384191:0:38121:0:(genops.c:906:class_export_put()) final put ffff9240ae4b3800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1777497445.384194:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b3800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1777497445.384205:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1777497445.384278:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1777497445.410847:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497445.410869:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564847488:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497445.410936:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497445.410984:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847488 00000100:00100000:2.0:1777497445.410990:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847488 00000100:00100000:2.0:1777497445.411028:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3856 00000100:00100000:2.0:1777497445.411035:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564847488:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1777497445.411056:0:8407:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777497445.411183:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564847488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (246us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497445.411190:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3856 00000100:02020000:2.0:1777497445.411230:0:3659:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1777497445.411235:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777497445.411240:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777497445.411244:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777497445.411249:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497445.411253:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00080000:2.0:1777497445.411259:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497445.411280:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de3480 x1863837564847616/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497445.411308:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564847616:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777497445.411333:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497445.418289:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847616 00000100:00100000:0.0:1777497445.418305:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847616 00000100:00100000:0.0:1777497445.418395:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3857 00000100:00100000:0.0:1777497445.418403:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564847616:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1777497445.418428:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497445.418556:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564847616:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 152us (7221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497445.418562:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3857 00000100:00080000:3.0:1777497445.423010:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497445.423022:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497445.423027:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564847616:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1777497445.541359:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497445.552603:0:83016:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497445.552616:0:83016:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1777497445.552622:0:83016:0:(genops.c:906:class_export_put()) final put ffff923f88a8a800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777497445.552627:0:83016:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a8a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777497445.552639:0:83016:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1777497445.553317:0:83016:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff923f88a8f000 00000020:02000400:2.0:1777497445.553382:0:83016:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1777497446.571686:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497447.590520:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497448.482625:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564847872:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497448.482701:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497448.482792:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497448.482799:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564847744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497448.482837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497448.483885:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847872 00000100:00100000:0.0:1777497448.483897:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847872 00000100:00100000:0.0:1777497448.483963:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847744 00000100:00100000:0.0:1777497448.483965:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847744 00000100:00100000:0.0:1777497448.483991:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1777497448.484000:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564847872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497448.484031:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497448.484109:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564847872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497448.484115:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1777497448.484131:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:0.0:1777497448.484137:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564847744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497448.484158:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497448.484183:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564847744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497448.484188:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:0.0:1777497448.484239:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564847744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497448.484255:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564847872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497448.486769:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497448.486779:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497448.610707:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497449.634440:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497450.019710:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497450.019716:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497450.019720:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497450.019729:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3574 00000100:00100000:0.0:1777497450.019730:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564848256:0@lo:400:kworker.0 00000100:00080000:1.0:1777497450.019735:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1777497450.019741:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497450.019762:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a4000 x1863837564848640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497450.019796:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497450.019811:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564848384:0@lo:400:kworker.0 00000100:00100000:0.0:1777497450.019837:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564848896:0@lo:400:kworker.0 00000100:00100000:1.0:1777497450.019838:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497450.019856:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564849024:0@lo:400:kworker.0 00000100:00100000:0.0:1777497450.019860:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497450.019873:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497450.019889:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848256 00000100:00100000:1.0:1777497450.019895:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848384 00000100:00100000:0.0:1777497450.019897:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848256 00000100:00100000:1.0:1777497450.019898:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848384 00000100:00100000:1.0:1777497450.019927:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849024 00000100:00100000:1.0:1777497450.019929:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849024 00000100:00100000:0.0:1777497450.019932:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:0.0:1777497450.019940:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564848256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497450.019942:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1777497450.019947:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3658:x1863837564848384:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497450.019951:0:73210:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497450.019983:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3658:x1863837564848384:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497450.019983:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564848256:12345-0@lo:400:kworker.0 Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497450.019989:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1777497450.020055:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564848000:0@lo:400:kworker.0 00000400:00000100:2.0:1777497450.020080:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564848000 offset 0 length 224: 4 00000100:00100000:2.0:1777497450.020153:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564848512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497450.020190:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497450.020206:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1777497450.020212:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564848128:0@lo:400:kworker.0 00000100:00100000:2.0:1777497450.020232:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497450.020241:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564848768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497450.020259:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497450.020286:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848512 00000100:00100000:2.0:1777497450.020290:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848512 00000100:00100000:1.0:1777497450.020351:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848128 00000100:00100000:1.0:1777497450.020360:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848128 00000100:00100000:0.0:1777497450.020401:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1777497450.020417:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564848640:0@lo:38:kworker.0 00000100:00100000:0.0:1777497450.020418:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1777497450.020422:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1863837564849024:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497450.020427:0:63728:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497450.020450:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1863837564849024:12345-0@lo:400:kworker.0 Request processed in 27us (575us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497450.020456:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:3.0:1777497450.020460:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497450.020489:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848896 00000100:00100000:3.0:1777497450.020492:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848896 00000100:00100000:0.0:1777497450.020493:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564848256:0@lo:400:kworker.0 00000100:00100000:3.0:1777497450.020520:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848768 00000100:00100000:3.0:1777497450.020523:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848768 00000100:00080000:0.0:1777497450.020539:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1777497450.020541:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00080000:0.0:1777497450.020543:0:3658:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:3.0:1777497450.020546:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564848896:12345-0@lo:400:kworker.0 00000100:02000400:0.0:1777497450.020548:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1777497450.020591:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564848896:12345-0@lo:400:kworker.0 Request processed in 44us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497450.020597:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:3.0:1777497450.020610:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:3.0:1777497450.020616:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564848768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497450.020644:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564848768:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497450.020649:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00080000:0.0:1777497450.020655:0:3658:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497450.020659:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3543 00000100:00080000:0.0:1777497450.020664:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497450.020681:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bdf80 x1863837564849152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497450.020685:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564848896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497450.020698:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564848384:0@lo:400:kworker.0 00000100:00100000:3.0:1777497450.020701:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564849152:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1777497450.020708:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777497450.020711:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1777497450.020714:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1777497450.020716:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497450.020719:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3543 00000100:00100000:3.0:1777497450.020721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497450.020722:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497450.020733:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bd180 x1863837564849280/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497450.020741:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849152 00000100:00100000:3.0:1777497450.020744:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849152 00000100:00100000:0.0:1777497450.020747:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564849024:0@lo:400:kworker.0 00000100:00100000:3.0:1777497450.020758:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1777497450.020762:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564849152:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1777497450.020775:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564848640 00010000:00020000:3.0:1777497450.020779:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497450.020779:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564848640 00000100:00100000:0.0:1777497450.020798:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3858 00000100:00100000:3.0:1777497450.020802:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564849152:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 39us (81us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497450.020802:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564848640:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497450.020808:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00010000:00020000:0.0:1777497450.020811:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497450.020824:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564849280:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1777497450.020840:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564848640:12345-0@lo:38:kworker.0 Request processed in 37us (380us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497450.020843:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497450.020847:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3858 00000100:00080000:3.0:1777497450.020861:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497450.020865:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497450.020866:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849280 00000100:00100000:3.0:1777497450.020869:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564849152:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1777497450.020869:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849280 00000100:00100000:0.0:1777497450.020886:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00080000:3.0:1777497450.020887:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:0.0:1777497450.020889:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564849280:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1777497450.020890:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497450.020892:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564848640:0@lo:38:kworker.0 00010000:00020000:0.0:1777497450.020898:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497450.020924:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564849280:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 33us (80us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497450.020928:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564848768:0@lo:400:kworker.0 00000100:00100000:0.0:1777497450.020931:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:0.0:1777497450.020945:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497450.020949:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497450.020951:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497450.020962:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497450.020966:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497450.020968:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564849280:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497450.028949:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1777497450.028974:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564848512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497450.029079:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564848512:12345-0@lo:400:kworker.0 Request processed in 119us (8887us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497450.029087:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:0.0:1777497450.029328:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564848512:0@lo:400:kworker.0 00000100:00100000:1.0:1777497450.035709:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1777497450.035720:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3659:x1863837564848128:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497450.035730:0:73210:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497450.035819:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3659:x1863837564848128:12345-0@lo:400:kworker.0 Request processed in 99us (15585us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497450.035826:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00080000:0.0:1777497450.036082:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777497450.036088:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1777497450.036092:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1777497450.036121:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497450.036127:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3543 00000100:00080000:0.0:1777497450.036134:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497450.036165:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bd180 x1863837564849408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497450.036219:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564848128:0@lo:400:kworker.0 00000100:00100000:3.0:1777497450.036318:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564849408:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777497450.036359:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497450.036634:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849408 00000100:00100000:0.0:1777497450.036643:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849408 00000100:00100000:0.0:1777497450.036680:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1777497450.036685:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564849408:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:0.0:1777497450.036706:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497450.036752:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564849408:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 66us (393us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497450.036759:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00080000:1.0:1777497450.036868:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497450.036873:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497450.036876:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564849408:0@lo:38:ptlrpcd_00_02.0 00000400:00000100:3.0:1777497450.304400:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546274048 offset 0 length 224: 4 00000100:00100000:3.0:1777497450.304448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497450.304496:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497450.304528:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497450.304573:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497450.304604:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274432 00000100:00100000:3.0:1777497450.304613:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274432 00000100:00100000:3.0:1777497450.304671:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274560 00000100:00100000:3.0:1777497450.304674:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274560 00000100:00100000:3.0:1777497450.304701:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2403 00000100:00100000:3.0:1777497450.304711:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546274432:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497450.304780:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546274432:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 71us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497450.304788:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2403 00000100:00100000:3.0:1777497450.304805:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2404 00000100:00100000:3.0:1777497450.304812:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546274560:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497450.304838:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546274560:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497450.304861:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2404 00000100:00100000:3.0:1777497450.304887:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274304 00000100:00100000:3.0:1777497450.304891:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274304 00000100:00100000:3.0:1777497450.305326:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274176 00000100:00100000:3.0:1777497450.305330:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274176 00000100:00100000:3.0:1777497450.305350:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00100000:3.0:1777497450.305357:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546274304:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497450.305394:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546274304:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497450.305400:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00100000:3.0:1777497450.305413:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1106 00000100:00100000:3.0:1777497450.305418:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546274176:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497450.305438:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497450.305464:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546274176:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 45us (891us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497450.305471:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1106 00000100:00080000:0.0:1777497450.305574:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497450.305579:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497450.305581:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1777497450.534554:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497450.534567:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378732 is committed 00000020:00000080:0.0:1777497450.534580:0:72699:0:(genops.c:906:class_export_put()) final put ffff923f82ab1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1777497450.541623:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497450.541632:0:9460:0:(genops.c:906:class_export_put()) final put ffff923f82ab0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497450.541766:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1777497450.541833:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82ab2800 for lustre-MDT0001 00000001:00100000:3.0:1777497450.542393:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497450.542397:0:8391:0:(genops.c:906:class_export_put()) final put ffff924086e24800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497450.542470:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1777497450.542511:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240b543a000 for lustre-OST0000 00000020:00000080:1.0:1777497450.544389:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1777497450.544444:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82758000 for lustre-OST0001 00010000:00010000:0.0:1777497450.658403:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497451.682385:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497452.707575:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497453.608568:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1777497453.611357:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564849664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497453.611483:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497453.611535:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849664 00000100:00100000:0.0:1777497453.611544:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849664 00000100:00100000:0.0:1777497453.611626:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:0.0:1777497453.611636:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564849664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497453.611666:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497453.611753:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564849536:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497453.611779:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497453.612065:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849536 00000100:00100000:3.0:1777497453.612070:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849536 00000100:00100000:3.0:1777497453.612133:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:3.0:1777497453.612141:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564849536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497453.612158:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497453.612210:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564849536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497453.612217:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00080000:2.0:1777497453.614633:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497453.614642:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497453.621600:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564849664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9957us (10108us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497453.621615:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1777497453.625145:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564849664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497453.625169:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564849536:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777497453.731951:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497454.754267:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497455.138294:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497455.138300:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497455.138305:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497455.138313:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3579 00000100:00080000:3.0:1777497455.138319:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497455.138324:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497455.138358:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de3480 x1863837564849920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497455.138404:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497455.138408:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497455.138410:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497455.138413:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3579 00000100:00080000:3.0:1777497455.138416:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497455.138419:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497455.138430:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844cd880 x1863837564850176/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497455.138444:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497455.138447:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497455.138449:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497455.138466:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3579 00000100:00080000:3.0:1777497455.138469:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497455.138473:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497455.138485:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844cc700 x1863837564850432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497455.138517:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497455.138520:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497455.138522:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497455.138525:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3579 00000100:00080000:3.0:1777497455.138527:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497455.138530:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497455.138539:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844cea00 x1863837564850816/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497455.138578:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564850048:0@lo:400:kworker.0 00000100:00100000:3.0:1777497455.138641:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497455.138689:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497455.138695:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564850304:0@lo:400:kworker.0 00000100:00100000:3.0:1777497455.138718:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497455.138754:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850048 00000100:00100000:3.0:1777497455.138760:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850048 00000100:00100000:3.0:1777497455.138807:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850304 00000100:00100000:3.0:1777497455.138810:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850304 00000100:00100000:3.0:1777497455.138833:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1777497455.138841:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564850048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497455.138887:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564850048:12345-0@lo:400:kworker.0 Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497455.138904:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1777497455.138920:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1777497455.138926:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564850304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497455.138954:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564850304:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497455.138960:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:3.0:1777497455.139228:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564850304:0@lo:400:kworker.0 00000100:00100000:3.0:1777497455.139239:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564850048:0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.139802:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564849792:0@lo:400:kworker.0 00000400:00000100:1.0:1777497455.139833:0:3660:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564849792 offset 0 length 224: 4 00000100:00100000:1.0:1777497455.139860:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564850688:0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.139883:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497455.139905:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497455.139911:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564850560:0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.139941:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497455.139970:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850688 00000100:00100000:1.0:1777497455.139974:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850688 00000100:00100000:1.0:1777497455.140026:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850560 00000100:00100000:1.0:1777497455.140029:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850560 00000100:00100000:1.0:1777497455.140047:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1777497455.140055:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564850688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.140116:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564850688:12345-0@lo:400:kworker.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497455.140123:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1777497455.140139:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1777497455.140146:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564850560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.140171:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564850560:12345-0@lo:400:kworker.0 Request processed in 27us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497455.140177:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:1.0:1777497455.140204:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564850560:0@lo:400:kworker.0 00000100:00100000:1.0:1777497455.140214:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564850688:0@lo:400:kworker.0 00000100:00100000:2.0:1777497455.141179:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564849920:0@lo:38:kworker.0 00000100:00100000:2.0:1777497455.141223:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497455.141256:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564850176:0@lo:38:kworker.0 00000100:00100000:2.0:1777497455.141275:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497455.141295:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564850432:0@lo:38:kworker.0 00000100:00100000:2.0:1777497455.141315:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497455.141345:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564850816:0@lo:38:kworker.0 00000100:00100000:2.0:1777497455.141364:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497455.141411:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497455.141415:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497455.141418:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497455.141700:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564849920 00000100:00100000:1.0:1777497455.141709:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564849920 00000100:00100000:1.0:1777497455.141739:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850176 00000100:00100000:1.0:1777497455.141741:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850176 00000100:00100000:1.0:1777497455.141753:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850816 00000100:00100000:1.0:1777497455.141755:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850816 00000100:00100000:1.0:1777497455.141767:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1777497455.141772:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564849920:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497455.141791:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497455.141843:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564849920:12345-0@lo:38:kworker.0 Request processed in 69us (619us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497455.141849:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1777497455.141866:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1777497455.141869:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564850176:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497455.141880:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497455.141902:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564850176:12345-0@lo:38:kworker.0 Request processed in 31us (626us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497455.141908:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1777497455.141918:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1777497455.141922:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564850816:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497455.141930:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497455.141949:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564850816:12345-0@lo:38:kworker.0 Request processed in 26us (584us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497455.141955:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00080000:1.0:1777497455.142042:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497455.142047:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497455.142051:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564849920:0@lo:38:kworker.0 00000100:00080000:1.0:1777497455.142059:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497455.142062:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497455.142065:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564850176:0@lo:38:kworker.0 00000100:00080000:1.0:1777497455.142071:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497455.142074:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497455.142077:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564850816:0@lo:38:kworker.0 00000100:00100000:0.0:1777497455.142441:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850432 00000100:00100000:0.0:1777497455.142447:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850432 00000100:00100000:0.0:1777497455.142478:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3859 00000100:00100000:0.0:1777497455.142484:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564850432:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497455.142494:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497455.142545:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564850432:12345-0@lo:38:kworker.0 Request processed in 60us (1228us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497455.142551:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3859 00000100:00080000:0.0:1777497455.142581:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497455.142584:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497455.142586:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564850432:0@lo:38:kworker.0 00000100:00100000:1.0:1777497455.422727:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:1.0:1777497455.422780:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546274688 offset 0 length 224: 4 00000100:00100000:1.0:1777497455.422801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497455.422834:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497455.422873:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497455.422962:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274816 00000100:00100000:3.0:1777497455.422963:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275072 00000100:00100000:3.0:1777497455.422973:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275072 00000100:00100000:0.0:1777497455.422973:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274816 00000100:00100000:0.0:1777497455.423030:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546274944 00000100:00100000:0.0:1777497455.423034:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546274944 00000100:00100000:3.0:1777497455.423047:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275200 00000100:00100000:3.0:1777497455.423051:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275200 00000100:00100000:0.0:1777497455.423071:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00100000:0.0:1777497455.423084:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546274944:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497455.423089:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2407 00000100:00100000:3.0:1777497455.423144:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546275072:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497455.423219:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546275072:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497455.423238:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2407 00000100:00100000:3.0:1777497455.423254:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2408 00000100:00100000:3.0:1777497455.423261:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546275200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497455.423289:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546275200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497455.423294:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2408 00000100:00100000:3.0:1777497455.423345:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1110 00000100:00100000:3.0:1777497455.423350:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546274816:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497455.423386:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497455.423416:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546274944:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 335us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497455.423423:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546274816:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 68us (705us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497455.423429:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00100000:3.0:1777497455.423436:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1110 00000100:00080000:1.0:1777497455.424466:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497455.424474:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497455.424477:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497455.779065:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497456.803468:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497457.826423:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497458.722846:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564850944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497458.722938:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497458.723004:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497458.723009:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564851072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497458.723028:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497458.723473:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564850944 00000100:00100000:0.0:1777497458.723486:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564850944 00000100:00100000:0.0:1777497458.723694:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851072 00000100:00100000:0.0:1777497458.723697:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851072 00000100:00100000:0.0:1777497458.723718:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1777497458.723727:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564850944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497458.723776:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497458.723840:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564850944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497458.723846:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:0.0:1777497458.723863:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:0.0:1777497458.723867:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564851072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497458.723880:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8652352 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497458.723909:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564851072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497458.723913:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00080000:3.0:1777497458.727183:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497458.727195:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497458.727293:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564851072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497458.727329:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564850944:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777497458.852029:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497459.882427:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497460.271796:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497460.271803:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497460.271808:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497460.271818:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3584 00000100:00080000:1.0:1777497460.271825:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497460.271832:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497460.271857:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839ff100 x1863837564851328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497460.271884:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497460.271888:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497460.271890:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497460.271894:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3584 00000100:00080000:1.0:1777497460.271896:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497460.271900:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497460.271909:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839ffb80 x1863837564851584/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497460.271948:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497460.271969:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497460.271971:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497460.271975:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3584 00000100:00080000:1.0:1777497460.271978:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1777497460.271983:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497460.271997:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de3480 x1863837564851840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497460.272023:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497460.272026:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497460.272028:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497460.272031:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3584 00000100:00080000:1.0:1777497460.272034:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497460.272037:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497460.272046:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408938ad80 x1863837564852224/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497460.272400:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564851200:0@lo:400:kworker.0 00000400:00000100:2.0:1777497460.272471:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564851200 offset 0 length 224: 4 00000100:00100000:2.0:1777497460.272514:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564852096:0@lo:400:kworker.0 00000100:00100000:2.0:1777497460.272555:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497460.272746:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564851456:0@lo:400:kworker.0 00000100:00100000:1.0:1777497460.272781:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497460.272866:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564851328:0@lo:38:kworker.0 00000100:00100000:1.0:1777497460.272900:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497460.273259:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564851968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497460.273298:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497460.273326:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497460.273333:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564851712:0@lo:400:kworker.0 00000100:00100000:1.0:1777497460.278034:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564851584:0@lo:38:kworker.0 00000100:00100000:1.0:1777497460.278451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497460.278677:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851456 00000100:00100000:2.0:1777497460.278691:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851456 00000100:00100000:0.0:1777497460.283988:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851328 00000100:00100000:0.0:1777497460.284009:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851328 00000100:00100000:0.0:1777497460.284064:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1777497460.284083:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564851456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497460.284254:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564851456:12345-0@lo:400:kworker.0 Request processed in 179us (11470us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497460.284262:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1777497460.284293:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1777497460.284297:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564851328:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497460.284324:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497460.284371:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564851328:12345-0@lo:38:kworker.0 Request processed in 71us (11470us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497460.284378:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1777497460.285446:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852096 00000100:00100000:0.0:1777497460.285458:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852096 00000100:00100000:0.0:1777497460.285516:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851968 00000100:00100000:0.0:1777497460.285520:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851968 00000100:00100000:0.0:1777497460.285552:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:0.0:1777497460.285561:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497460.285654:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564852096:12345-0@lo:400:kworker.0 Request processed in 95us (13100us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497460.285661:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:0.0:1777497460.285679:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:0.0:1777497460.285685:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497460.285716:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564851968:12345-0@lo:400:kworker.0 Request processed in 32us (12418us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497460.285722:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:1.0:1777497460.286409:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564851456:0@lo:400:kworker.0 00000100:00100000:1.0:1777497460.286464:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497460.286511:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564851968:0@lo:400:kworker.0 00000100:00100000:1.0:1777497460.286550:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851584 00000100:00100000:1.0:1777497460.286555:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851584 00000100:00100000:1.0:1777497460.286584:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851712 00000100:00100000:1.0:1777497460.286587:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851712 00000100:00100000:1.0:1777497460.286620:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1777497460.286627:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564851712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497460.286674:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564851712:12345-0@lo:400:kworker.0 Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497460.286680:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1777497460.286697:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1777497460.286701:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564851584:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497460.286723:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497460.286752:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564851584:12345-0@lo:38:kworker.0 Request processed in 50us (8303us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497460.286758:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:1.0:1777497460.286788:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564851712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497460.287539:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564852096:0@lo:400:kworker.0 00000100:00080000:2.0:1777497460.287573:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497460.287578:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497460.287582:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497460.288008:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497460.288015:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497460.288020:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564851584:0@lo:38:kworker.0 00000100:00100000:1.0:1777497460.288031:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564851840:0@lo:38:kworker.0 00000100:00100000:1.0:1777497460.288082:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497460.288917:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564852224:0@lo:38:kworker.0 00000100:00100000:1.0:1777497460.288970:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497460.289037:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497460.289043:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497460.289055:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564851328:0@lo:38:kworker.0 00000100:00100000:0.0:1777497460.289743:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852224 00000100:00100000:0.0:1777497460.289751:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852224 00000100:00100000:0.0:1777497460.289790:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1777497460.289799:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564852224:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497460.289841:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497460.289915:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564852224:12345-0@lo:38:kworker.0 Request processed in 116us (943us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497460.289923:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00080000:1.0:1777497460.291019:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497460.291030:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497460.291036:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564852224:0@lo:38:kworker.0 00000100:00100000:2.0:1777497460.293143:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564851840 00000100:00100000:2.0:1777497460.293161:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564851840 00000100:00100000:2.0:1777497460.293287:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3860 00000100:00100000:2.0:1777497460.293299:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564851840:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497460.293337:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497460.293449:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564851840:12345-0@lo:38:kworker.0 Request processed in 150us (5365us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497460.293456:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3860 00000100:00080000:3.0:1777497460.293541:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497460.293549:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497460.293553:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564851840:0@lo:38:kworker.0 00000100:00100000:3.0:1777497460.545309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:3.0:1777497460.545493:0:3652:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546275328 offset 0 length 224: 4 00000100:00100000:0.0:1777497460.545493:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275456 00000100:00100000:0.0:1777497460.545508:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275456 00000100:00100000:3.0:1777497460.545517:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497460.545544:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497460.545570:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497460.545587:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275584 00000100:00100000:0.0:1777497460.545591:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275584 00000100:00100000:3.0:1777497460.545605:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275712 00000100:00100000:3.0:1777497460.545608:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275712 00000100:00100000:3.0:1777497460.545639:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546275840 00000100:00100000:3.0:1777497460.545642:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546275840 00000100:00100000:0.0:1777497460.545654:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00100000:3.0:1777497460.545664:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5839 00000100:00100000:0.0:1777497460.545666:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546275584:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497460.545669:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546275712:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:3.0:1777497460.545709:0:25493:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c0e4 00000100:00080000:3.0:1777497460.545720:0:25493:0:(import.c:65:import_set_state_nolock()) ffff923f839d1000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1777497460.545778:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546275584:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 113us (205us total) trans 0 rc 0/0 00000001:00000004:3.0:1777497460.545785:0:25493:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:0.0:1777497460.545786:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00100000:0.0:1777497460.545808:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1114 00000100:00100000:0.0:1777497460.545813:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546275456:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497460.545851:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497460.545882:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546275456:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 68us (603us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497460.545888:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1114 00000100:00080000:0.0:1777497460.545919:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497460.545923:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497460.545925:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497460.545948:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5840 00000100:00100000:0.0:1777497460.545956:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546275840:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:0.0:1777497460.545971:0:25485:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c0eb 00000100:00080000:0.0:1777497460.545977:0:25485:0:(import.c:65:import_set_state_nolock()) ffff924086e28800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777497460.546017:0:25485:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969447 00000100:00100000:0.0:1777497460.546517:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546275840:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 560us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497460.546526:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5840 00000100:00100000:3.0:1777497460.546555:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546275712:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 886us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497460.546562:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5839 00010000:00010000:3.0:1777497460.546593:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497460.548340:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497460.900018:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497461.924613:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497462.946356:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497463.844379:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497463.844400:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564852352:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497463.844470:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497463.844519:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852352 00000100:00100000:3.0:1777497463.844526:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852352 00000100:00100000:3.0:1777497463.844581:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1777497463.844589:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564852352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497463.844620:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497463.844660:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564852352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497463.844667:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00080000:3.0:1777497463.844685:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497463.844716:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564852352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497463.844840:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497463.844849:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564852480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497463.844874:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497463.844907:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852480 00000100:00100000:1.0:1777497463.844911:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852480 00000100:00100000:1.0:1777497463.844939:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1777497463.844945:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564852480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497463.844959:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497463.844986:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564852480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497463.844991:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1777497463.845015:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564852480:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497463.845027:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777497463.970216:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497464.995380:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497465.378437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497465.378445:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497465.378449:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497465.378457:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3589 00000100:00080000:2.0:1777497465.378464:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497465.378471:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497465.378501:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bce2d880 x1863837564852736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497465.378539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497465.378542:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497465.378544:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497465.378548:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3589 00000100:00080000:2.0:1777497465.378551:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497465.378555:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497465.378566:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bce2df80 x1863837564852992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497465.378583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497465.378586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497465.378588:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497465.378591:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3589 00000100:00080000:2.0:1777497465.378593:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497465.378598:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497465.378609:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bce2c380 x1863837564853248/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497465.378629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497465.378632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497465.378634:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497465.378637:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3589 00000100:00080000:2.0:1777497465.378651:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497465.378656:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497465.378674:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bce2f480 x1863837564853632/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497465.378707:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564852864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497465.378770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497465.378814:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497465.378820:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564853120:0@lo:400:kworker.0 00000100:00100000:2.0:1777497465.379041:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497465.379125:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852864 00000100:00100000:2.0:1777497465.379132:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852864 00000100:00100000:2.0:1777497465.379180:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853120 00000100:00100000:2.0:1777497465.379184:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853120 00000100:00100000:2.0:1777497465.379206:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1777497465.379214:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564852864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497465.379265:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564852864:12345-0@lo:400:kworker.0 Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497465.379271:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1777497465.379287:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1777497465.379292:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564853120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497465.379321:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564853120:12345-0@lo:400:kworker.0 Request processed in 28us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497465.379326:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:2.0:1777497465.379347:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497465.379379:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564853120:0@lo:400:kworker.0 00000100:00100000:2.0:1777497465.379389:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564852864:0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.379475:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564853376:0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.379519:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379550:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777497465.379556:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564852608:0@lo:400:kworker.0 00000400:00000100:3.0:1777497465.379574:0:3657:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564852608 offset 0 length 224: 4 00000100:00100000:3.0:1777497465.379595:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564853504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.379612:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379637:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564852736:0@lo:38:kworker.0 00000100:00100000:3.0:1777497465.379673:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379690:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564852992:0@lo:38:kworker.0 00000100:00100000:3.0:1777497465.379707:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379722:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564853248:0@lo:38:kworker.0 00000100:00100000:3.0:1777497465.379743:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379760:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564853632:0@lo:38:kworker.0 00000100:00100000:3.0:1777497465.379782:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497465.379807:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853376 00000100:00100000:3.0:1777497465.379811:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853376 00000100:00100000:3.0:1777497465.379856:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853504 00000100:00100000:3.0:1777497465.379860:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853504 00000100:00100000:3.0:1777497465.379879:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:3.0:1777497465.379896:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.379930:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564853376:12345-0@lo:400:kworker.0 Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497465.379936:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:3.0:1777497465.379947:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:3.0:1777497465.379952:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564853504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.379985:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564853504:12345-0@lo:400:kworker.0 Request processed in 33us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497465.379991:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:3.0:1777497465.380008:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852736 00000100:00100000:3.0:1777497465.380011:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852736 00000100:00100000:3.0:1777497465.380025:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564852992 00000100:00100000:3.0:1777497465.380027:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564852992 00000100:00100000:3.0:1777497465.380035:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853632 00000100:00100000:3.0:1777497465.380037:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853632 00000100:00100000:3.0:1777497465.380047:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1777497465.380052:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564852736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497465.380068:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497465.380133:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564852736:12345-0@lo:38:kworker.0 Request processed in 80us (459us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497465.380138:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1777497465.380148:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1777497465.380152:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564852992:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497465.380161:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497465.380182:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564852992:12345-0@lo:38:kworker.0 Request processed in 29us (474us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497465.380187:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1777497465.380198:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1777497465.380201:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564853632:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497465.380209:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497465.380229:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564853632:12345-0@lo:38:kworker.0 Request processed in 27us (447us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497465.380243:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1777497465.380263:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853248 00000100:00100000:3.0:1777497465.380266:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853248 00000100:00100000:3.0:1777497465.380283:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3861 00000100:00100000:3.0:1777497465.380287:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564853248:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497465.380296:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497465.380321:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564853248:12345-0@lo:38:kworker.0 Request processed in 33us (577us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497465.380325:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3861 00000100:00080000:3.0:1777497465.380356:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497465.380360:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497465.380363:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564852736:0@lo:38:kworker.0 00000100:00080000:3.0:1777497465.380371:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497465.380373:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497465.380376:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564852992:0@lo:38:kworker.0 00000100:00080000:3.0:1777497465.380383:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497465.380385:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497465.380388:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564853248:0@lo:38:kworker.0 00000100:00080000:3.0:1777497465.380394:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497465.380396:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497465.380399:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564853632:0@lo:38:kworker.0 00000100:00100000:3.0:1777497465.380429:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564853504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497465.380439:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564853376:0@lo:400:kworker.0 00000100:00080000:2.0:1777497465.380969:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497465.380979:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497465.662576:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:2.0:1777497465.662611:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546275968 offset 0 length 224: 4 00000100:00100000:3.0:1777497465.664480:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276096 00000100:00100000:3.0:1777497465.664493:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276096 00000100:00100000:3.0:1777497465.664547:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1118 00000100:00100000:3.0:1777497465.664555:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546276096:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497465.664577:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497465.664650:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546276096:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 96us (2083us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497465.664657:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1118 00000100:00100000:0.0:1777497465.669543:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497465.669645:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276224 00000100:00100000:2.0:1777497465.669656:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276224 00000100:00100000:2.0:1777497465.669734:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1089 00000100:00100000:2.0:1777497465.669745:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546276224:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497465.669827:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546276224:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497465.670378:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1089 00000100:00080000:0.0:1777497465.670944:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1777497466.019184:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1777497466.403235:0:3659:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497450/real 1777497450] req@ffff923f841a5880 x1863837564848000/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497466 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497466.403269:0:3659:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff923f841a5880 x1863837564848000/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497466.403279:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1777497466.403283:0:3659:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1777497466.403286:0:3659:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1777497466.403288:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1777497466.403292:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f841a5880 x1863837564848000/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497466 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497466.403301:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f8606aa00 x1863837564849792/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497471 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497466.403317:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f839fdf80 x1863837564851200/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497476 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497466.403325:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240bce2ca80 x1863837564852608/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497481 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1777497466.403347:0:3659:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1777497466.403349:0:3659:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1777497466.403350:0:3659:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1777497466.403352:0:3659:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1777497466.403381:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564851200:0@lo:400:kworker.0 00000100:00100000:2.0:1777497466.403387:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564848000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497466.403437:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8606aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564849792:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.403608:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564852608:0@lo:400:kworker.0 00000100:00080000:0.0:1777497466.403627:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497466.403632:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1777497466.403635:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497466.403639:0:38121:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3537 00000100:00080000:0.0:1777497466.403646:0:38121:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497466.403676:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bdf80 x1863837564853760/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497466.403705:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497466.403709:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497466.403711:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497466.403714:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3594 00000100:00080000:0.0:1777497466.403717:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497466.403721:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497466.403735:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bd180 x1863837564853888/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497466.403760:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497466.403763:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497466.403765:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497466.403768:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3594 00000100:00080000:0.0:1777497466.403771:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497466.403774:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497466.403792:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a5500 x1863837564854144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497466.403805:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497466.403808:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497466.403810:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497466.403813:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3594 00000100:00080000:0.0:1777497466.403815:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497466.403818:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497466.403828:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a6a00 x1863837564854400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497466.403863:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497466.403866:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497466.403868:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497466.403871:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3594 00000100:00080000:0.0:1777497466.403883:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497466.403886:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497466.403895:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a7480 x1863837564854784/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497466.403917:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564854656:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.403975:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497466.404006:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497466.404012:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564854528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404035:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497466.404063:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854656 00000100:00100000:0.0:1777497466.404069:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854656 00000100:00100000:0.0:1777497466.404135:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854528 00000100:00100000:0.0:1777497466.404139:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854528 00000100:00100000:0.0:1777497466.404162:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:0.0:1777497466.404171:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564854656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404220:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564854656:12345-0@lo:400:kworker.0 Request processed in 50us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497466.404226:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:0.0:1777497466.404242:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:0.0:1777497466.404248:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564854528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404273:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564854528:12345-0@lo:400:kworker.0 Request processed in 26us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497466.404279:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:0.0:1777497466.404307:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564854272:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404334:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497466.404355:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497466.404361:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564854016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404382:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497466.404408:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854272 00000100:00100000:0.0:1777497466.404412:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854272 00000100:00100000:0.0:1777497466.404436:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854016 00000100:00100000:0.0:1777497466.404438:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854016 00000100:00100000:0.0:1777497466.404455:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1777497466.404461:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564854272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404493:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564854272:12345-0@lo:400:kworker.0 Request processed in 32us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497466.404499:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1777497466.404510:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1777497466.404523:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564854016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404550:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564854016:12345-0@lo:400:kworker.0 Request processed in 28us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497466.404555:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1777497466.404599:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564854016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404608:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564854272:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404634:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564854528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497466.404642:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564854656:0@lo:400:kworker.0 00000100:00100000:2.0:1777497466.404724:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564853760:0@lo:250:kworker.0 00000400:00000100:2.0:1777497466.404746:0:3656:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564853760 offset 0 length 520: 4 00000100:00100000:2.0:1777497466.404767:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564853888:0@lo:38:kworker.0 00000100:00100000:2.0:1777497466.404786:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497466.404810:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564854144:0@lo:38:kworker.0 00000100:00100000:2.0:1777497466.404828:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497466.404842:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564854400:0@lo:38:kworker.0 00000100:00100000:2.0:1777497466.404862:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497466.404891:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564854784:0@lo:38:kworker.0 00000100:00100000:2.0:1777497466.404910:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497466.404933:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854400 00000100:00100000:2.0:1777497466.404937:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854400 00000100:00100000:2.0:1777497466.404957:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3862 00000100:00100000:2.0:1777497466.404961:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564854400:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497466.404977:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497466.405003:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564854400:12345-0@lo:38:kworker.0 Request processed in 42us (140us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497466.405015:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3862 00000100:00080000:2.0:1777497466.405039:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497466.405044:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497466.405047:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564854400:0@lo:38:kworker.0 00000100:00100000:3.0:1777497466.405387:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564853888 00000100:00100000:3.0:1777497466.405391:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564853888 00000100:00100000:3.0:1777497466.405411:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1777497466.405415:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564853888:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497466.405425:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497466.405454:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564853888:12345-0@lo:38:kworker.0 Request processed in 38us (667us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497466.405460:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1777497466.405469:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854144 00000100:00100000:3.0:1777497466.405471:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854144 00000100:00100000:3.0:1777497466.405482:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854784 00000100:00100000:3.0:1777497466.405484:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854784 00000100:00100000:3.0:1777497466.405492:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1777497466.405495:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564854144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497466.405503:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497466.405521:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564854144:12345-0@lo:38:kworker.0 Request processed in 25us (693us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497466.405536:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:3.0:1777497466.405545:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1777497466.405548:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564854784:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497466.405556:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497466.405573:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564854784:12345-0@lo:38:kworker.0 Request processed in 24us (662us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497466.405578:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00080000:3.0:1777497466.405629:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497466.405633:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497466.405636:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564853888:0@lo:38:kworker.0 00000100:00080000:3.0:1777497466.405642:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497466.405645:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497466.405647:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564854144:0@lo:38:kworker.0 00000100:00080000:3.0:1777497466.405653:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497466.405656:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497466.405658:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564854784:0@lo:38:kworker.0 00000001:00100000:2.0:1777497466.407185:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:2.0:1777497466.407192:0:9460:0:(genops.c:906:class_export_put()) final put ffff924086e2f800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497466.407281:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e2f800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0001 00000020:00000080:3.0:1777497466.407315:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e28800 for lustre-OST0001 00000001:00100000:2.0:1777497466.407482:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:2.0:1777497466.407486:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f839d7800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497466.408172:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d7800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0000 00000020:00000080:3.0:1777497466.408205:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d1000 for lustre-OST0000 00000100:00100000:3.0:1777497466.685417:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497466.685752:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276608 00000100:00100000:0.0:1777497466.685762:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276608 00000100:00100000:0.0:1777497466.685824:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1092 00000100:00100000:0.0:1777497466.685844:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546276608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497466.685930:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546276608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 88us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497466.685938:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1092 00000400:00000100:0.0:1777497466.686391:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546276352 offset 0 length 520: 4 00000100:00100000:0.0:1777497466.686417:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497466.686479:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276480 00000100:00100000:3.0:1777497466.686484:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276480 00000100:00100000:3.0:1777497466.686517:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1122 00000100:00100000:3.0:1777497466.686535:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546276480:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497466.686559:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497466.686595:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546276480:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 60us (176us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497466.686601:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1122 00010000:00010000:1.0:1777497467.043536:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497468.067282:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497468.962430:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564854912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497468.962503:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497468.962755:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564854912 00000100:00100000:3.0:1777497468.962765:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564854912 00000100:00080000:0.0:1777497468.962924:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497468.962980:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1777497468.962991:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564854912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497468.963023:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497468.963078:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564854912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497468.963085:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:0.0:1777497468.963208:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564854912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497468.963534:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564855040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497468.963568:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497468.963667:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855040 00000100:00100000:1.0:1777497468.963672:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855040 00000100:00100000:1.0:1777497468.963724:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1777497468.963732:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564855040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497468.963750:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497468.963792:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564855040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (223us total) trans 0 rc 0/0 00000100:00080000:0.0:1777497468.963913:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497468.963972:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1777497468.964030:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564855040:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777497469.103012:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1777497469.304514:0:83634:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:0.0:1777497469.304522:0:83634:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1777497469.304524:0:83634:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1777497469.311192:0:83634:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9240a68cf800 00000020:01000004:0.0:1777497469.311217:0:83634:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1777497469.311233:0:83634:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1777497469.311249:0:83634:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9240a695cd40) 00000020:00000080:0.0:1777497469.311267:0:83634:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1777497469.489441:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1777497469.491745:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1777497469.505638:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.507082:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.507482:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1777497469.508052:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1777497469.508675:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1777497469.509084:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1777497469.509808:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1777497469.510138:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1777497469.510515:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1777497469.510905:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1777497469.511436:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1777497469.512158:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1777497469.512648:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1777497469.519400:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.519758:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.520188:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.520497:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.520794:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.521137:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.521438:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.521780:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.522128:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.522626:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.523761:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.524520:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.525071:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.525536:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.526029:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.526263:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.526633:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.526913:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.527139:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.527486:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.527903:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.528458:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.528756:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.529231:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.529753:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.532168:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.532690:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.532993:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.533259:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1777497469.533682:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1777497469.533992:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1777497469.537639:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1777497469.540325:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.541047:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.541522:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.542516:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.543128:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1777497469.543470:0:83634:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1777497469.544895:0:83634:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1777497469.545203:0:83634:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1777497469.545211:0:83634:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:2.0:1777497469.545223:0:83634:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c234 00000020:01000004:2.0:1777497469.545230:0:83634:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1777497469.545242:0:83634:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1777497469.545247:0:83634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a68cf800 from MGS 00000020:01000004:2.0:1777497469.545250:0:83634:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1777497469.545260:0:83634:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff923f84b0cd40) 00000020:00000080:2.0:1777497469.545271:0:83634:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1777497469.545657:0:83634:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a68cf800 from MGS, refs=2 00080000:01000000:2.0:1777497469.545663:0:83634:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:2.0:1777497469.545670:0:83634:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c242 00010000:00010000:2.0:1777497469.546008:0:83634:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1777497469.553440:0:83634:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1777497469.555786:0:83639:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1777497469.556256:0:83634:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1777497469.556321:0:83634:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497469.557084:0:83634:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1777497469.558429:0:83634:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1777497469.558605:0:83634:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1777497469.558612:0:83634:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1777497469.563567:0:83634:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1777497469.563581:0:83634:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1777497469.570912:0:83634:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1777497469.570927:0:83634:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1777497469.571462:0:83634:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1777497469.571487:0:83634:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:0.0:1777497469.571488:0:83634:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:0.0:1777497469.571492:0:83634:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:0.0:1777497469.571498:0:83634:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 64, was 0): CONNECTING 00000100:00100000:0.0:1777497469.571504:0:83634:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:3.0:1777497470.114754:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497471.139181:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497471.522520:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497471.522528:0:38121:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1777497471.522531:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497471.522535:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497471.522539:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497471.522552:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1777497471.522557:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497471.522563:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497471.522885:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089389880 x1863837564855168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497471.522932:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497471.522936:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497471.522938:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497471.522942:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1777497471.522945:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497471.522949:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497471.522960:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089388e00 x1863837564855424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497471.522976:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497471.522980:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497471.522995:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497471.522999:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1777497471.523001:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497471.523005:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497471.523017:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408938a680 x1863837564855680/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497471.523044:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497471.523046:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497471.523048:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497471.523051:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3595 00000100:00080000:1.0:1777497471.523053:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497471.523056:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497471.523065:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408938b800 x1863837564856064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497471.523135:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564855808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497471.523202:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497471.523241:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497471.523246:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564855936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497471.523266:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497471.523649:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564855296:0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.523683:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497471.523713:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497471.523719:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564855552:0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.523739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497471.523779:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855296 00000100:00100000:2.0:1777497471.523792:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855296 00000100:00100000:2.0:1777497471.523850:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855552 00000100:00100000:2.0:1777497471.523853:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855552 00000100:00100000:2.0:1777497471.523873:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1777497471.523881:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564855296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.523942:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564855296:12345-0@lo:400:kworker.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497471.523949:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1777497471.523965:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1777497471.523972:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564855552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.523998:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564855552:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497471.524004:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00080000:2.0:1777497471.524022:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497471.524054:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564855552:0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.524065:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564855296:0@lo:400:kworker.0 00000100:00100000:0.0:1777497471.531789:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564855168:0@lo:38:kworker.0 00000100:00100000:0.0:1777497471.531875:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497471.531926:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564855424:0@lo:38:kworker.0 00000100:00100000:0.0:1777497471.531949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497471.531964:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564855680:0@lo:38:kworker.0 00000100:00100000:0.0:1777497471.531986:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497471.532001:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564856064:0@lo:38:kworker.0 00000100:00100000:0.0:1777497471.532019:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497471.533532:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855168 00000100:00100000:1.0:1777497471.533546:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855168 00000100:00100000:2.0:1777497471.533727:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855424 00000100:00100000:2.0:1777497471.533738:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855424 00000100:00100000:3.0:1777497471.533956:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855808 00000100:00100000:3.0:1777497471.533961:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855808 00000100:00100000:3.0:1777497471.534004:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855936 00000100:00100000:3.0:1777497471.534007:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855936 00000100:00100000:3.0:1777497471.534034:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:3.0:1777497471.534043:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497471.534158:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564855808:12345-0@lo:400:kworker.0 Request processed in 116us (10955us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497471.534165:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:3.0:1777497471.534184:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:3.0:1777497471.534189:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497471.534230:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564855936:12345-0@lo:400:kworker.0 Request processed in 41us (10963us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497471.534235:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:1.0:1777497471.534291:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856064 00000100:00100000:1.0:1777497471.534295:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856064 00000100:00100000:2.0:1777497471.545079:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1777497471.545091:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564855168:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497471.545133:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497471.545228:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564855168:12345-0@lo:38:kworker.0 Request processed in 136us (13352us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497471.545236:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1777497471.545256:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1777497471.545261:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564855424:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497471.545272:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497471.545297:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564855424:12345-0@lo:38:kworker.0 Request processed in 35us (13347us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497471.545321:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1777497471.545335:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1777497471.545340:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564856064:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497471.545350:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497471.545376:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564856064:12345-0@lo:38:kworker.0 Request processed in 35us (13355us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497471.545382:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:2.0:1777497471.545439:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497471.545445:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497471.545449:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564855168:0@lo:38:kworker.0 00000100:00080000:2.0:1777497471.545461:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497471.545465:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497471.545468:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564855424:0@lo:38:kworker.0 00000100:00080000:2.0:1777497471.545478:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497471.545482:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497471.545485:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564856064:0@lo:38:kworker.0 00000100:00080000:2.0:1777497471.545618:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497471.545624:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497471.545639:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564855680 00000100:00100000:2.0:1777497471.545646:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564855680 00000100:00100000:2.0:1777497471.545673:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3863 00000100:00100000:2.0:1777497471.545678:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564855680:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497471.545688:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497471.545720:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564855680:12345-0@lo:38:kworker.0 Request processed in 41us (13732us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497471.545743:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3863 00000100:00080000:2.0:1777497471.545774:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497471.545778:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497471.545782:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564855680:0@lo:38:kworker.0 00000100:00100000:2.0:1777497471.545843:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564855936:0@lo:400:kworker.0 00000100:00100000:2.0:1777497471.545858:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564855808:0@lo:400:kworker.0 00000100:00100000:0.0:1777497471.815237:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497471.815290:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497471.816146:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276864 00000100:00100000:1.0:1777497471.816158:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276864 00000100:00100000:1.0:1777497471.816243:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276736 00000100:00100000:1.0:1777497471.816246:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276736 00000100:00100000:1.0:1777497471.816285:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1095 00000100:00100000:1.0:1777497471.816295:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546276864:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:3.0:1777497471.816526:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497471.816546:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1126 00000100:00100000:3.0:1777497471.816553:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546276736:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497471.816580:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497471.816661:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546276736:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 107us (1370us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497471.816668:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1126 00000100:00100000:1.0:1777497471.817217:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546276864:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 922us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497471.817226:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1095 00010000:00010000:0.0:1777497472.165340:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497473.187475:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497474.082543:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564856192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497474.082637:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497474.082796:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856192 00000100:00100000:0.0:1777497474.082813:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856192 00000100:00100000:0.0:1777497474.082896:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:0.0:1777497474.082906:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564856192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497474.082956:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497474.083024:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564856192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497474.083032:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00080000:2.0:1777497474.083233:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497474.083269:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564856192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497474.083714:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497474.083724:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564856320:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497474.083768:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497474.083919:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856320 00000100:00100000:1.0:1777497474.083925:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856320 00000100:00100000:1.0:1777497474.083985:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1777497474.083993:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564856320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497474.084034:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497474.084072:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564856320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497474.084078:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00080000:2.0:1777497474.084211:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497474.084236:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564856320:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497474.210373:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497475.234530:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497476.262265:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497476.642244:0:3656:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497466/real 1777497466] req@ffff9240b50bdf80 x1863837564853760/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497476 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497476.642279:0:3656:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9240b50bdf80 x1863837564853760/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497476 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497476.642301:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497476.642323:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1777497476.642340:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564853760:0@lo:250:kworker.0 10000000:01000000:0.0:1777497476.642445:0:83634:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:0.0:1777497476.642462:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642472:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642479:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1777497476.642500:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642509:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9800/0x3e357265691be91 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be98 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642528:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642534:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642540:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642543:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642547:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5bc00/0x3e357265691bdf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691bdfe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642556:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642561:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642584:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642587:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642591:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691be13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642600:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642607:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642612:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642615:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642618:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9e00/0x3e357265691be3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be44 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642640:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642647:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642652:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642655:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642659:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691be4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be52 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642667:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642694:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642700:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642704:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642708:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f84353c00/0x3e357265691be67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be6e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642717:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642724:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642729:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642732:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642735:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee400/0x3e357265691be75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.642742:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.642747:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.642752:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.642755:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.642758:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5b200/0x3e357265691be9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691bea6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.643226:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.643235:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.643240:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.643244:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.643248:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8200/0x3e357265691be05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.643259:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.643265:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.643270:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497476.643273:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.643275:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8600/0x3e357265691be21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.643284:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.643290:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.643295:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777497476.643305:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.643309:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8e00/0x3e357265691be2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be36 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.643331:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.643338:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.643343:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777497476.643346:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.643350:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5ba00/0x3e357265691be59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be60 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.643357:0:83634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497476.643363:0:83634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.643367:0:83634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1777497476.643370:0:83634:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:0.0:1777497476.643373:0:83634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691be83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691be8a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497476.643389:0:83634:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 64, was 0): DISCONN 00000100:00080000:0.0:1777497476.643394:0:83634:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497476.643400:0:83634:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3595 00000100:00080000:0.0:1777497476.643405:0:83634:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497476.643411:0:83634:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497476.643445:0:83634:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd35c00 x1863837564856448/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497476.643900:0:83634:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1777497476.645870:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564856448:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1777497476.645950:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497476.646236:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497476.646241:0:38121:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1777497476.646243:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497476.646247:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497476.646252:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497476.646259:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3600 00000100:00080000:1.0:1777497476.646263:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497476.646269:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497476.646302:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408938a680 x1863837564856576/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497476.646358:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497476.646361:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497476.646363:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497476.646366:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3600 00000100:00080000:1.0:1777497476.646369:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497476.646372:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497476.646382:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089388e00 x1863837564856832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497476.646414:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497476.646417:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497476.646419:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497476.646422:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:1.0:1777497476.646425:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497476.646439:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497476.646451:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089388380 x1863837564857088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497476.646643:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497476.646646:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497476.646648:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497476.646652:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3600 00000100:00080000:1.0:1777497476.646654:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497476.646658:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497476.646669:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089388000 x1863837564857472/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497476.646825:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564856704:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.646866:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.646894:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497476.646899:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564856960:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.646921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.646967:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856704 00000100:00100000:2.0:1777497476.646974:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856704 00000100:00100000:2.0:1777497476.647023:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856960 00000100:00100000:2.0:1777497476.647027:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856960 00000100:00100000:2.0:1777497476.647065:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1777497476.647073:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564856704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647152:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564856704:12345-0@lo:400:kworker.0 Request processed in 80us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.647160:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1777497476.647177:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1777497476.647183:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564856960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647210:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564856960:12345-0@lo:400:kworker.0 Request processed in 27us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.647215:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:2.0:1777497476.647233:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497476.647260:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564856960:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647270:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564856704:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647296:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564857216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647338:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.647356:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497476.647362:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564857344:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.647380:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.648169:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856448 00000100:00100000:0.0:1777497476.648175:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856448 00000100:00100000:0.0:1777497476.648199:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1777497476.648205:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3656:x1863837564856448:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1777497476.648227:0:83640:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3605 last 0 00000020:00000080:0.0:1777497476.648251:0:83640:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691c249 00000100:00080000:0.0:1777497476.648361:0:83640:0:(import.c:65:import_set_state_nolock()) ffff9240a68cb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497476.648412:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837564856448:12345-0@lo:250:mount.lustre.0 Request processed in 206us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.648418:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1777497476.648454:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857216 00000100:00100000:0.0:1777497476.648458:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857216 00000100:00100000:0.0:1777497476.648553:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857344 00000100:00100000:0.0:1777497476.648556:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857344 00000100:00100000:0.0:1777497476.648573:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1777497476.648578:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564857216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497476.648611:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564857216:12345-0@lo:400:kworker.0 Request processed in 33us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.648617:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:0.0:1777497476.648626:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:0.0:1777497476.648631:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564857344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497476.648653:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564857344:12345-0@lo:400:kworker.0 Request processed in 22us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.648658:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00080000:0.0:1777497476.648688:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497476.648691:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497476.648851:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564856576:0@lo:38:kworker.0 00000100:00100000:3.0:1777497476.648882:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.648903:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564856832:0@lo:38:kworker.0 00000100:00100000:3.0:1777497476.648919:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.648931:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564857088:0@lo:38:kworker.0 00000100:00100000:3.0:1777497476.648949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.648986:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564857472:0@lo:38:kworker.0 00000100:00100000:3.0:1777497476.649003:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.649025:0:3656:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 24 00000100:00080000:3.0:1777497476.649033:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1777497476.649040:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1777497476.649044:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1777497476.649048:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1777497476.649050:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1777497476.649064:0:3656:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1777497476.649120:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564856448:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1777497476.649152:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856576 00000100:00100000:3.0:1777497476.649155:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856576 00000100:00100000:3.0:1777497476.649173:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564856832 00000100:00100000:3.0:1777497476.649175:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564856832 00000100:00100000:3.0:1777497476.649186:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857472 00000100:00100000:3.0:1777497476.649188:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857472 00000100:00100000:3.0:1777497476.649198:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1777497476.649202:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564856576:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497476.649217:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497476.649250:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564856576:12345-0@lo:38:kworker.0 Request processed in 47us (367us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497476.649256:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1777497476.649269:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1777497476.649273:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564856832:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497476.649283:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497476.649304:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564856832:12345-0@lo:38:kworker.0 Request processed in 29us (383us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497476.649309:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1777497476.649319:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1777497476.649323:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564857472:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497476.649332:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497476.649352:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564857472:12345-0@lo:38:kworker.0 Request processed in 28us (348us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497476.649357:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1777497476.649375:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857088 00000100:00100000:3.0:1777497476.649383:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857088 00000100:00100000:3.0:1777497476.650146:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3864 00000100:00100000:3.0:1777497476.650152:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564857088:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497476.650164:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497476.650196:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564857088:12345-0@lo:38:kworker.0 Request processed in 43us (1245us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497476.650201:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3864 00000020:01000000:2.0:1777497476.651063:0:82203:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:2.0:1777497476.651080:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1777497476.651083:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497476.651085:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497476.651086:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497476.651087:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497476.651089:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497476.651090:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497476.651091:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497476.651112:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497476.651117:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497476.651151:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1777497476.651158:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1777497476.651159:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497476.651161:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1777497476.651162:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497476.651163:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497476.651164:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497476.651165:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497476.651166:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497476.651167:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497476.651168:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497476.651177:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1777497476.651181:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1777497476.651182:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497476.651183:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777497476.651184:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497476.651185:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497476.651186:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497476.651187:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497476.651188:0:82203:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497476.651189:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497476.651190:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497476.651204:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1777497476.651302:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564857600:0@lo:253:kworker.0 00000100:00100000:2.0:1777497476.651355:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.651395:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497476.651401:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564857728:0@lo:253:kworker.0 00000100:00100000:2.0:1777497476.651425:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497476.652386:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497476.652394:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497476.652398:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564856576:0@lo:38:kworker.0 00000100:00080000:3.0:1777497476.652411:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497476.652414:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497476.652417:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564856832:0@lo:38:kworker.0 00000100:00080000:3.0:1777497476.652426:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497476.652429:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497476.652431:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564857088:0@lo:38:kworker.0 00000100:00080000:3.0:1777497476.652440:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497476.652443:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497476.652445:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564857472:0@lo:38:kworker.0 00000100:00080000:1.0:1777497476.662284:0:83634:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:1.0:1777497476.662303:0:83634:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1777497476.662349:0:83634:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1777497476.662355:0:83634:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000100:00100000:2.0:1777497476.662619:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497476.662639:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564857856:0@lo:253:kworker.0 00000100:00100000:2.0:1777497476.663047:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1777497476.663274:0:83634:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:1.0:1777497476.663315:0:83634:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1777497476.663321:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1777497476.663322:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497476.663323:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497476.663324:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497476.663325:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497476.663326:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497476.663328:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497476.663329:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497476.663330:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497476.663331:0:83634:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777497476.663334:0:83634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1777497476.663336:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777497476.663338:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497476.663338:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497476.663339:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497476.663340:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497476.663341:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497476.663342:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497476.663343:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497476.663344:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497476.663345:0:83634:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1777497476.663370:0:83634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1777497476.663383:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564857984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1777497476.663414:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.668018:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857600 00000100:00100000:3.0:1777497476.668033:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857600 00000100:00100000:3.0:1777497476.668090:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857728 00000100:00100000:3.0:1777497476.668105:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857728 00000100:00100000:3.0:1777497476.668116:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857856 00000100:00100000:3.0:1777497476.668119:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857856 00000100:00100000:3.0:1777497476.668135:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1777497476.668159:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837564857600:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497476.668194:0:83643:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 10000000:01000000:3.0:1777497476.668354:0:83645:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1777497476.668507:0:83643:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 104 20000000:01000000:3.0:1777497476.673341:0:83646:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1777497476.673348:0:83646:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1777497476.673351:0:83646:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1777497476.673354:0:83646:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1777497476.673545:0:83646:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1777497476.673664:0:83643:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777497476.673677:0:83643:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497476.674929:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240992db000 going to sleep for 11 seconds 00000100:00100000:1.0:1777497476.675249:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564857344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497476.675263:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564857216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.675582:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564857984 00000100:00100000:2.0:1777497476.675590:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564857984 00000100:00100000:2.0:1777497476.675636:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1777497476.675654:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564857728:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1777497476.675687:0:83642:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1777497476.679478:0:83642:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777497476.679676:0:83643:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497476.680031:0:83645:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497476.680036:0:83645:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497476.680061:0:83645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680077:0:83645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497476.680086:0:83645:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050834s 00010000:00010000:0.0:1777497476.680089:0:83645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497476.680198:0:83643:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1777497476.680297:0:83645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680305:0:83645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680312:0:83645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680317:0:83645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497476.680322:0:83645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680330:0:83645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680342:0:83645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680368:0:83645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.680375:0:83645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dc200/0x3e357265691c250 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497476.696478:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564857600:12345-0@lo:253:kworker.0 Request processed in 28311us (45112us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.696493:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1777497476.696538:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1777497476.696550:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3658:x1863837564857856:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1777497476.696599:0:83643:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1777497476.696818:0:83642:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777497476.696829:0:83642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000020:01000004:3.0:1777497476.701366:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497476.701373:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497476.701375:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497476.701376:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497476.701377:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497476.701381:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497476.701382:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497476.701384:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497476.701385:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497476.701392:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564857600:0@lo:253:kworker.0 00000100:00100000:2.0:1777497476.701690:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837564857728:12345-0@lo:253:kworker.0 Request processed in 26038us (50262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.701702:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1777497476.701759:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1777497476.701771:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:83634:x1863837564857984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1777497476.701825:0:83642:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497476.701828:0:83642:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1777497476.701830:0:83642:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000020:01000004:3.0:1777497476.702353:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497476.702356:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497476.702357:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497476.702358:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497476.702359:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497476.702361:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497476.702362:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497476.702364:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497476.702365:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497476.702369:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564857728:0@lo:253:kworker.0 20000000:01000000:2.0:1777497476.702490:0:83645:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497476.702495:0:83645:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497476.702519:0:83645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702536:0:83645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497476.702546:0:83645:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000052658s 00010000:00010000:2.0:1777497476.702551:0:83645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702558:0:83645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702565:0:83645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702606:0:83645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702613:0:83645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497476.702617:0:83645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702625:0:83645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702638:0:83645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702647:0:83645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.702653:0:83645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e94a00/0x3e357265691c257 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497476.703071:0:83642:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1777497476.703460:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:83634:x1863837564857984:12345-0@lo:253:mount.lustre.0 Request processed in 1692us (40042us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497476.703477:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:0.0:1777497476.703575:0:83643:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1777497476.704025:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564857984:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497476.704038:0:83634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497476.704041:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497476.704043:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497476.704044:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497476.704045:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497476.704046:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497476.704047:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497476.704048:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497476.704050:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497476.704051:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497476.704052:0:83634:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1777497476.704076:0:83634:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a68cf800 from lustre-MDT0000 10000000:01000000:2.0:1777497476.704138:0:83634:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1777497476.704142:0:83634:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497476.704152:0:83634:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9240a68cf800 10000000:01000000:2.0:1777497476.704156:0:83634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777497476.704161:0:83634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9240a68cf800 10000000:01000000:2.0:1777497476.704164:0:83634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777497476.704167:0:83634:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240a68cf800 from 1 10000000:01000000:2.0:1777497476.704170:0:83634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497476.704201:0:83634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704211:0:83634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704221:0:83634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497476.704241:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497476.704280:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.704315:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82c52d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.704488:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858112 00000100:00100000:0.0:1777497476.704494:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858112 00000100:00100000:0.0:1777497476.704575:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1777497476.704601:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:83634:x1863837564858112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497476.704616:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497476.704628:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd200/0x3e357265691c265 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c25e expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.704649:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd200/0x3e357265691c265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c25e expref: 6 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.704658:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd200/0x3e357265691c265 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c25e expref: 6 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.704666:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd200, rc 0) 00000100:00100000:0.0:1777497476.704716:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:83634:x1863837564858112:12345-0@lo:101:mount.lustre.0 Request processed in 132us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.704722:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1777497476.704804:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858112:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497476.704816:0:83634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704824:0:83634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497476.704852:0:83634:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1777497476.704870:0:83634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704883:0:83634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497476.704889:0:83634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497476.704892:0:83634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777497476.704896:0:83634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9240a68cf800 10000000:01000000:2.0:1777497476.704899:0:83634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1777497476.704901:0:83634:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1777497476.704903:0:83634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1777497476.704919:0:83634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704926:0:83634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.704932:0:83634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497476.704949:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858240:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497476.704974:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.707362:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82c52d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497476.707403:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858240 00000100:00100000:3.0:1777497476.707413:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858240 00000100:00100000:3.0:1777497476.707459:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1777497476.707468:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:83634:x1863837564858240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497476.707484:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497476.707506:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefe00/0x3e357265691c273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c26c expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.707532:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefe00/0x3e357265691c273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c26c expref: 7 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.707543:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefe00/0x3e357265691c273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c26c expref: 7 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.707551:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefe00, rc 0) 00000100:00100000:3.0:1777497476.707973:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83634:x1863837564858240:12345-0@lo:101:mount.lustre.0 Request processed in 504us (2996us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497476.707980:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1777497476.710143:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497476.710170:0:83634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.710184:0:83634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497476.710299:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497476.710352:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.710388:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82c52d80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497476.710426:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858368 00000100:00100000:2.0:1777497476.710432:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858368 00000100:00100000:2.0:1777497476.710463:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497476.710471:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83634:x1863837564858368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497476.710972:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564858368:12345-0@lo:501:mount.lustre.0 Request processed in 500us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.710980:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497476.711024:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497476.711053:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497476.711090:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.711124:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82c52d80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497476.711137:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858496 00000100:00100000:2.0:1777497476.711140:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858496 00000100:00100000:2.0:1777497476.711156:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1777497476.711162:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564858496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497476.712558:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564858496:12345-0@lo:503:mount.lustre.0 Request processed in 1390us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.712568:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 20000000:01000000:3.0:1777497476.714134:0:83643:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777497476.714146:0:83643:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1777497476.714315:0:83645:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497476.714320:0:83645:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497476.714341:0:83645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714374:0:83645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497476.714384:0:83645:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000065689s 00010000:00010000:2.0:1777497476.714388:0:83645:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714395:0:83645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714401:0:83645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714407:0:83645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714412:0:83645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497476.714417:0:83645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714424:0:83645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714436:0:83645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714444:0:83645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.714451:0:83645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e94400/0x3e357265691c27a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497476.714954:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564857856:12345-0@lo:253:kworker.0 Request processed in 18404us (51904us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497476.714964:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1777497476.715134:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1777497476.715137:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777497476.715138:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497476.715140:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497476.715141:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497476.715142:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497476.715144:0:3658:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497476.715145:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497476.715147:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1777497476.715150:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564857856:0@lo:253:kworker.0 00000100:00100000:0.0:1777497476.715287:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564858496:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497476.716028:0:83647:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83647:1863837564858624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497476.716089:0:83647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.716265:0:83647:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497476.716343:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858624 00000100:00100000:2.0:1777497476.716350:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858624 00000100:00100000:2.0:1777497476.716431:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1777497476.716441:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83647:x1863837564858624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497476.717416:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83647:x1863837564858624:12345-0@lo:502:llog_process_th.0 Request processed in 973us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.717425:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777497476.717511:0:83647:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83647:1863837564858624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497476.717542:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497476.717554:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.717561:0:83647:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1777497476.717566:0:83647:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1777497476.717569:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497476.717581:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9240a62e99c0) 00000020:00000080:3.0:1777497476.717616:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1777497476.717622:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1777497476.717708:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:3.0:1777497476.717715:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c288 00000020:00000080:3.0:1777497476.717956:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1777497476.717961:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497476.717964:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.717966:0:83647:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1777497476.717968:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497476.717972:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.717973:0:83647:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1777497476.717976:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497476.717982:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9240a62e8000) 00000020:00000080:3.0:1777497476.717994:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1777497476.717998:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1777497476.718000:0:83647:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1777497476.718003:0:83647:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1777497476.718008:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1777497476.718050:0:83647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a68cf800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1777497476.718060:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9240a62ecd40) 00000020:00000080:3.0:1777497476.718070:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1777497476.718158:0:83647:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:3.0:1777497476.718164:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c29d 00000020:00000080:3.0:1777497476.718262:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1777497476.718269:0:83647:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1777497476.718273:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691c2a4 00080000:01000000:3.0:1777497476.718278:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:3.0:1777497476.718281:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c2ab 00010000:00010000:2.0:1777497476.842734:0:83647:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1777497476.842878:0:83647:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6d03493e-1218-49f3-bdd0-b10716c402e0 idx: 0 lr: 94489280519 srv lr: 98784247808 lx: 0 gen 22 00000001:00080000:2.0:1777497476.842920:0:83647:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 98784247808 lx: 0 gen 21 00000001:00000004:2.0:1777497476.842944:0:83647:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 98784247808 00000001:00080000:2.0:1777497476.843041:0:83647:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1777497476.844360:0:83647:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff923f82c52c00: xid 1863837546270080, transno 98784247812, client gen 22, slot idx 0 00000001:00080000:2.0:1777497476.844399:0:83647:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff923f82c52780: xid 1863837546269824, transno 98784247811, client gen 22, slot idx 1 00000020:00000080:2.0:1777497476.844885:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff923f84b099c0) 00000020:00000080:2.0:1777497476.844909:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1777497476.844980:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:2.0:1777497476.844997:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c2c7 00000020:00000080:0.0:1777497476.847250:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1777497476.852001:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691c2ce 00000020:00000080:1.0:1777497476.859216:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777497476.859233:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497476.859244:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.859246:0:83647:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777497476.859250:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497476.859253:0:83647:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777497476.859255:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497476.859256:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497476.859258:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497476.859261:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.859262:0:83647:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497476.859264:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497476.859270:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.859271:0:83647:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777497476.859277:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777497476.860184:0:83647:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777497476.860219:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497476.860224:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.860226:0:83647:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777497476.860229:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497476.860234:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.860236:0:83647:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777497476.860238:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497476.860244:0:83647:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:1.0:1777497476.860270:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497476.860285:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240aecd8000) 00000020:00000080:1.0:1777497476.861654:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1777497476.861674:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497476.861760:0:83647:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777497476.861766:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777497476.862648:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c2dc 00010000:00080000:1.0:1777497476.862699:0:83647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92409c761000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497476.869976:0:83647:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777497476.872137:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497476.872154:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777497476.872202:0:83647:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777497476.872223:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c2e3 00000100:00080000:3.0:1777497476.872234:0:83647:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777497476.872241:0:83647:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92409c761000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497476.872277:0:83647:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b2d80 x1863837564858752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497476.872311:0:83647:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1777497476.875277:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497476.875287:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497476.875292:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497476.875300:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3605 00000100:00080000:3.0:1777497476.875304:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497476.875310:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497476.875360:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b3480 x1863837564858880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497476.875415:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497476.875419:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497476.875420:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497476.875424:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3605 00000100:00080000:3.0:1777497476.875426:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497476.875430:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497476.875441:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bd180 x1863837564859136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497476.875468:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497476.875471:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497476.875483:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497476.875486:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:3.0:1777497476.875500:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497476.875504:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497476.875519:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f45180 x1863837564859392/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497476.875541:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497476.875544:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497476.875546:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497476.875549:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3605 00000100:00080000:3.0:1777497476.875551:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497476.875554:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497476.875563:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f44a80 x1863837564859776/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497476.875603:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564859648:0@lo:400:kworker.0 00000100:00100000:3.0:1777497476.875670:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.875707:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497476.875713:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564859008:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.875899:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564858752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497476.878618:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564859520:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.884818:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.884889:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564858880:0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.884934:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.884959:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564859136:0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.884983:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.885001:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564859392:0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.885024:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.885044:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564859776:0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.885063:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.885131:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858752 00000100:00100000:2.0:1777497476.885139:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858752 00000100:00100000:2.0:1777497476.885170:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859392 00000100:00100000:2.0:1777497476.885172:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859392 00000100:00100000:2.0:1777497476.885189:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1777497476.885195:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564858752:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1777497476.885226:0:8407:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3606 last 0 00000020:00000080:2.0:1777497476.885261:0:8407:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c2ea 00000004:00100000:2.0:1777497476.885276:0:8407:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497476.887573:0:8407:0:(import.c:65:import_set_state_nolock()) ffff924086e22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497476.887666:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564858752:12345-0@lo:38:llog_process_th.0 Request processed in 2468us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.887677:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3865 00000100:00100000:2.0:1777497476.887713:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1777497476.887719:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564859392:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.887789:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564859392:12345-0@lo:38:kworker.0 Request processed in 57us (2751us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497476.887796:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3866 00000100:00100000:2.0:1777497476.887843:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497476.887854:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1777497476.887863:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1777497476.887869:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1777497476.887872:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c761000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1777497476.887879:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564858752:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1777497476.887894:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497476.887899:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777497476.887903:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564859392:0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.887975:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564859904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497476.888012:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.888047:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859904 00000100:00100000:2.0:1777497476.888053:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859904 00000100:00100000:2.0:1777497476.888079:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1777497476.888084:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564859904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497476.888128:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497476.888163:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564859904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.888170:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3867 00000100:00100000:2.0:1777497476.888199:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564859904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497476.890212:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564859264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.890352:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564858880 00000100:00100000:2.0:1777497476.890360:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564858880 00000100:00100000:2.0:1777497476.890404:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859136 00000100:00100000:2.0:1777497476.890408:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859136 00000100:00100000:2.0:1777497476.890422:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859776 00000100:00100000:2.0:1777497476.890425:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859776 00000100:00100000:2.0:1777497476.890444:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1777497476.890451:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564858880:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1777497476.890859:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.890985:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564858880:12345-0@lo:38:kworker.0 Request processed in 532us (6049us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497476.890993:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1777497476.891010:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859264 00000100:00100000:2.0:1777497476.891013:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859264 00000100:00100000:2.0:1777497476.891037:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1777497476.891043:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.891083:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564859264:12345-0@lo:400:kworker.0 Request processed in 40us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.891088:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1777497476.891132:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1777497476.891136:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564859136:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.891167:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564859136:12345-0@lo:38:kworker.0 Request processed in 30us (6183us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497476.891172:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:2.0:1777497476.891183:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1777497476.891186:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564859776:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497476.891210:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564859776:12345-0@lo:38:kworker.0 Request processed in 23us (6147us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497476.891216:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1777497476.891240:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859648 00000100:00100000:2.0:1777497476.891244:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859648 00000100:00100000:2.0:1777497476.891283:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:2.0:1777497476.891289:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564859648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497476.891321:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564859648:12345-0@lo:400:kworker.0 Request processed in 33us (15652us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.891325:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1777497476.891490:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564859264:0@lo:400:kworker.0 00000100:00080000:0.0:1777497476.891526:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497476.891530:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777497476.891533:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564858880:0@lo:38:kworker.0 00000100:00080000:0.0:1777497476.891543:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497476.891546:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777497476.891549:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564859136:0@lo:38:kworker.0 00000100:00080000:0.0:1777497476.891558:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497476.891561:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1777497476.891563:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564859776:0@lo:38:kworker.0 00000020:01000000:0.0:1777497476.892981:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497476.892990:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.892993:0:83647:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1777497476.892997:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777497476.893010:0:83647:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1777497476.893012:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497476.893014:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497476.893015:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777497476.893018:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.893019:0:83647:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1777497476.893022:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1777497476.893027:0:83647:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1777497476.893030:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.893032:0:83647:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1777497476.893034:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1777497476.893039:0:83647:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:0.0:1777497476.893063:0:83647:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1777497476.893066:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497476.893081:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9240a695b380) 00000020:00000080:0.0:1777497476.893120:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1777497476.893126:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1777497476.893205:0:83647:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1777497476.893211:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:0.0:1777497476.893217:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c2f8 00010000:00080000:0.0:1777497476.893248:0:83647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f81a05000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497476.893457:0:83647:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000040:01000000:0.0:1777497476.894246:0:83647:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1777497476.894272:0:83647:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1777497476.895585:0:83647:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 22, last_idx 23 00000100:00100000:3.0:1777497476.900380:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.900506:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564859648:0@lo:400:kworker.0 00000100:00100000:0.0:1777497476.901948:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859008 00000100:00100000:0.0:1777497476.901962:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859008 00000100:00100000:0.0:1777497476.902030:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1777497476.902041:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564859008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497476.902141:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564859008:12345-0@lo:400:kworker.0 Request processed in 102us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.902164:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1777497476.902971:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564859008:0@lo:400:kworker.0 00000040:00080000:0.0:1777497476.903287:0:83647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497476.903319:0:83647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].24, 64 off9728 00000040:00080000:0.0:1777497476.903464:0:83647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x60:0x0].1, 64 off8256 00000100:00100000:1.0:1777497476.904738:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.906056:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564859520 00000100:00100000:3.0:1777497476.906068:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564859520 00000100:00100000:3.0:1777497476.906162:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:3.0:1777497476.906174:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564859520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497476.906268:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564859520:12345-0@lo:400:kworker.0 Request processed in 98us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497476.906276:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:1.0:1777497476.906338:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564859520:0@lo:400:kworker.0 00000040:00080000:2.0:1777497476.906811:0:83653:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:2.0:1777497476.906817:0:83653:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1777497476.906995:0:83653:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:2.0:1777497476.907018:0:83653:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x5c:0x0] at index 23 of catalog [0x1:0x2:0x0] 00000040:00080000:2.0:1777497476.907164:0:83653:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:2.0:1777497476.907167:0:83653:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1777497476.908425:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497476.908438:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1777497476.908476:0:83647:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1777497476.909230:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c2ff 00000100:00080000:2.0:1777497476.909243:0:83647:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777497476.909250:0:83647:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff923f81a05000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497476.909290:0:83647:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408a0ef100 x1863837564860032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497476.909322:0:83647:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1777497476.909402:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497476.909407:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497476.909409:0:83647:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1777497476.909412:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497476.909416:0:83647:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1777497476.909417:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497476.909418:0:83647:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497476.909419:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497476.909422:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497476.909434:0:83647:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497476.909437:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1777497476.909442:0:83647:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1777497476.909445:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497476.909446:0:83647:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1777497476.909450:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1777497476.909453:0:83647:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1777497476.909475:0:83647:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1777497476.909478:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000100:00100000:0.0:1777497476.909606:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564860032:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497476.909687:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.909764:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860032 00000100:00100000:0.0:1777497476.909772:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860032 00000100:00100000:0.0:1777497476.909820:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5841 00000100:00100000:0.0:1777497476.909828:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:3656:x1863837564860032:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497476.909856:0:25494:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3606 last 0 00000020:00000080:0.0:1777497476.909883:0:25494:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c306 00002000:00100000:0.0:1777497476.909897:0:25494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff923f88a8f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777497476.909901:0:25494:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777497476.909904:0:25494:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497476.909979:0:25494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777497476.910000:0:25494:0:(import.c:65:import_set_state_nolock()) ffff923f88a89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497476.910056:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564860032:12345-0@lo:8:llog_process_th.0 Request processed in 228us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.910064:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5841 00000100:00100000:1.0:1777497476.910160:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497476.910168:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1777497476.910175:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1777497476.910179:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1777497476.910182:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81a05000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1777497476.910200:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:1.0:1777497476.910205:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564860032:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497476.910368:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497476.910378:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564860160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497476.910404:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.910433:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860160 00000100:00100000:0.0:1777497476.910437:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860160 00000100:00100000:0.0:1777497476.910472:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:0.0:1777497476.910478:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564860160:12345-0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1777497476.910657:0:83653:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1777497476.910711:0:83653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3606251615290ns, next at 0ns, rc = 0 00080000:00080000:3.0:1777497476.910716:0:83653:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000080:2.0:1777497476.910917:0:83647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff923f84b08000) 00000020:00000080:2.0:1777497476.910952:0:83647:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1777497476.910962:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1777497476.911042:0:83647:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1777497476.911047:0:83647:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:2.0:1777497476.911052:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c314 00010000:00080000:2.0:1777497476.911080:0:83647:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f818b1800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1777497476.911305:0:83647:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00002000:00000024:0.0:1777497476.911709:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497476.912476:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564860160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1992us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.912486:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00080000:0.0:1777497476.912532:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497476.912582:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564860160:0@lo:13:osp-pre-0-0.0 00000040:01000000:2.0:1777497476.913291:0:83647:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777497476.913309:0:83647:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1777497476.917500:0:83647:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 22, last_idx 23 00000004:00080000:0.0:1777497476.919556:0:83635:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:2.0:1777497476.919854:0:83647:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777497476.919882:0:83647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].24, 64 off9728 00000040:00080000:2.0:1777497476.919964:0:83647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x62:0x0].1, 64 off8256 00000040:00080000:1.0:1777497476.922442:0:83655:0:(llog.c:800:llog_process_thread()) index: 23, lh_last_idx: 24 synced_idx: 0 lgh_last_idx: 24 00000040:00080000:1.0:1777497476.922449:0:83655:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497476.922643:0:83655:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000040:00080000:1.0:1777497476.922665:0:83655:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x5e:0x0] at index 23 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497476.922795:0:83655:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 24 synced_idx: 24 lgh_last_idx: 24 00000040:00080000:1.0:1777497476.922798:0:83655:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1777497476.923314:0:83647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497476.923327:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1777497476.923366:0:83647:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1777497476.923384:0:83647:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c31b 00000100:00080000:0.0:1777497476.923395:0:83647:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497476.923401:0:83647:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff923f818b1800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497476.923435:0:83647:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd37b80 x1863837564860288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497476.923699:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564860288:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1777497476.923793:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497476.923839:0:83647:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1777497476.923904:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497476.923910:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.923912:0:83647:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1777497476.923914:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497476.923920:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.923921:0:83647:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1777497476.923924:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1777497476.923925:0:83647:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1777497476.923927:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497476.923929:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.923930:0:83647:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1777497476.923932:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497476.923934:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497476.923942:0:83647:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1777497476.923947:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1777497476.923976:0:83647:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83647:1863837564860416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497476.924018:0:83647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.924052:0:83647:0:(client.c:2691:ptlrpc_set_wait()) set ffff924089af2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497476.924299:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860416 00000100:00100000:3.0:1777497476.924306:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860416 00000100:00100000:3.0:1777497476.924349:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1777497476.924358:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83647:x1863837564860416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497476.924484:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83647:x1863837564860416:12345-0@lo:502:llog_process_th.0 Request processed in 126us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497476.924501:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1777497476.924632:0:83647:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83647:1863837564860416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497476.924657:0:83647:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497476.924661:0:83647:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497476.924663:0:83647:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1777497476.924667:0:83647:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1777497476.925475:0:83634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1777497476.925512:0:83634:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1777497476.925533:0:83634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.925546:0:83634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497476.925554:0:83634:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a68cf800 from 1 10000000:01000000:3.0:1777497476.925557:0:83634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777497476.925590:0:83634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.925598:0:83634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.925622:0:83634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497476.925643:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777497476.925687:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.925723:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.925890:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860544 00000100:00100000:0.0:1777497476.925896:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860544 00000100:00100000:0.0:1777497476.925936:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777497476.925944:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:83634:x1863837564860544:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497476.925957:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497476.925970:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c322 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.925993:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c322 expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.926002:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c322 expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.926009:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dce00, rc 0) 00000100:00100000:0.0:1777497476.926044:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564860544:12345-0@lo:101:mount.lustre.0 Request processed in 101us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.926050:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1777497476.927896:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497476.927921:0:83634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.927935:0:83634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497476.928500:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860672:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1777497476.928564:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.928605:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.928749:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497476.928870:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277248 00000100:00100000:0.0:1777497476.928877:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277248 00000100:00100000:0.0:1777497476.928942:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1100 00000100:00100000:0.0:1777497476.928951:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546277248:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497476.929011:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546277248:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.929028:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1100 00000100:00080000:0.0:1777497476.929050:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497476.929366:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860672 00000100:00100000:1.0:1777497476.929371:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860672 00000100:00100000:1.0:1777497476.929407:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777497476.929414:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564860672:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1777497476.929430:0:83642:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1777497476.929446:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1777497476.929450:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1777497476.929453:0:83642:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1777497476.929456:0:83642:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 107 00000100:00100000:1.0:1777497476.929544:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564860672:12345-0@lo:256:mount.lustre.0 Request processed in 130us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497476.929549:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777497476.930821:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860672:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1777497476.931486:0:83634:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777497476.931523:0:83634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.931534:0:83634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497476.931543:0:83634:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240a68cf800 from 1 10000000:01000000:3.0:1777497476.931545:0:83634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777497476.931591:0:83634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.931600:0:83634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.931610:0:83634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497476.931633:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777497476.931687:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.931724:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.933967:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860800 00000100:00100000:0.0:1777497476.933984:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860800 00000100:00100000:0.0:1777497476.934058:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777497476.934068:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:83634:x1863837564860800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497476.934084:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497476.934134:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd000/0x3e357265691c337 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c330 expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.934163:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd000/0x3e357265691c337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c330 expref: 9 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.934174:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd000/0x3e357265691c337 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c330 expref: 9 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.934183:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd000, rc 0) 00000100:00100000:0.0:1777497476.934253:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564860800:12345-0@lo:101:mount.lustre.0 Request processed in 188us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.934261:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1777497476.934542:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860288 00000100:00100000:2.0:1777497476.934548:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860288 00000100:00100000:2.0:1777497476.934581:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5842 00000100:00100000:2.0:1777497476.934586:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1863837564860288:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1777497476.934615:0:8396:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3606 last 0 00000020:00000080:2.0:1777497476.934648:0:8396:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c33e 00002000:00100000:2.0:1777497476.934663:0:8396:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9240aef6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1777497476.934680:0:8396:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1777497476.934683:0:8396:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1777497476.934772:0:8396:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1777497476.934816:0:8396:0:(import.c:65:import_set_state_nolock()) ffff9240aef68800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497476.934871:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564860288:12345-0@lo:8:llog_process_th.0 Request processed in 283us (11078us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.934878:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5842 00000100:00100000:1.0:1777497476.934969:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497476.934979:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1777497476.934987:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1777497476.934992:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1777497476.934995:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f818b1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1777497476.935022:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:1.0:1777497476.935028:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564860288:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1777497476.935058:0:83655:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1777497476.935145:0:83655:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3606276049387ns, next at 0ns, rc = 0 00080000:00080000:1.0:1777497476.935152:0:83655:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1777497476.936316:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497476.936334:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497476.936391:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.936449:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564860928 00000100:00100000:2.0:1777497476.936455:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564860928 00000100:00100000:2.0:1777497476.936511:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1777497476.936520:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564860928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497476.936546:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497476.936587:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564860928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.936594:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:2.0:1777497476.936636:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497476.936837:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564860800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497476.936859:0:83634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497476.936872:0:83634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497476.936936:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497476.936966:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.937002:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e240 going to sleep for 11 seconds 00000100:00080000:0.0:1777497476.937165:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497476.938360:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861056 00000100:00100000:2.0:1777497476.938370:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861056 00000100:00100000:2.0:1777497476.938413:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1777497476.938422:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564861056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497476.938604:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564861056:12345-0@lo:501:mount.lustre.0 Request processed in 182us (1636us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.938612:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1777497476.940500:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497476.940567:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497476.940647:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.940691:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e240 going to sleep for 11 seconds 00000100:00100000:2.0:1777497476.940992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497476.941024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497476.941140:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861184 00000100:00100000:0.0:1777497476.941147:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861184 00000100:00100000:0.0:1777497476.941196:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546276992 00000100:00100000:0.0:1777497476.941199:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546276992 00000100:00100000:0.0:1777497476.941212:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1777497476.941222:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564861184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497476.941344:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564861184:12345-0@lo:503:mount.lustre.0 Request processed in 124us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.941357:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1777497476.941393:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1777497476.941398:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2411:x1863837546276992:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:0.0:1777497476.941419:0:83642:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 95f1b493-372d-4153-ad35-48e1115be1b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 3606 last 0 00000020:00000080:0.0:1777497476.941449:0:83642:0:(genops.c:1406:class_connect()) connect: client 95f1b493-372d-4153-ad35-48e1115be1b1, cookie 0x3e357265691c345 00000100:00080000:0.0:1777497476.941591:0:83642:0:(import.c:65:import_set_state_nolock()) ffff923f818b2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497476.941643:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+4:2411:x1863837546276992:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 242us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.941650:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 16 00000100:00100000:0.0:1777497476.941678:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277120 00000100:00100000:0.0:1777497476.941682:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277120 00000100:00100000:0.0:1777497476.941705:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1133 00000100:00100000:0.0:1777497476.941709:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546277120:12345-192.168.202.4@tcp:38:kworker.0 00000100:00100000:0.0:1777497476.941746:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546277120:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 35us (721us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777497476.941752:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1133 00000100:00100000:0.0:1777497476.941899:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497476.943193:0:83657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83657:1863837564861312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497476.943273:0:83657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.943304:0:83657:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.943514:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861312 00000100:00100000:0.0:1777497476.943521:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861312 00000100:00100000:0.0:1777497476.943568:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1777497476.943577:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83657:x1863837564861312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497476.944580:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83657:x1863837564861312:12345-0@lo:502:llog_process_th.0 Request processed in 1001us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497476.944591:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1777497476.944694:0:83657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83657:1863837564861312:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497476.944727:0:83657:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497476.944747:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.944749:0:83657:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1777497476.944757:0:83657:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a68cf800 00000020:00000080:3.0:1777497476.944760:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777497476.944767:0:83657:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497476.944770:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.944771:0:83657:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1777497476.944773:0:83657:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497476.944783:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.944785:0:83657:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1777497476.944789:0:83657:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a68cf800 00000020:00000080:3.0:1777497476.944791:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777497476.944876:0:83657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83657:1863837564861440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497476.944917:0:83657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.944953:0:83657:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.945166:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861440 00000100:00100000:0.0:1777497476.945173:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861440 00000100:00100000:0.0:1777497476.945217:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1777497476.945226:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83657:x1863837564861440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497476.945321:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83657:x1863837564861440:12345-0@lo:502:llog_process_th.0 Request processed in 96us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.945327:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497476.951003:0:83657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83657:1863837564861440:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497476.951047:0:83657:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497476.951056:0:83657:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497476.951059:0:83657:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1777497476.951064:0:83657:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000004:00080000:2.0:1777497476.952931:0:83635:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:0.0:1777497476.953673:0:83634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1777497476.953709:0:83634:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497476.953728:0:83634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.953935:0:83634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497476.953999:0:83634:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1777497476.954002:0:83634:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9240a68cf800 10000000:01000000:0.0:1777497476.954005:0:83634:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9240a68cf800 10000000:01000000:0.0:1777497476.954010:0:83634:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1777497476.954016:0:83634:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240a68cf800 from 1 10000000:01000000:0.0:1777497476.954019:0:83634:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497476.954056:0:83634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.954065:0:83634:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.954075:0:83634:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497476.954252:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777497476.954320:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.954415:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497476.956244:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861568 00000100:00100000:1.0:1777497476.956258:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861568 00000100:00100000:0.0:1777497476.959948:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777497476.959963:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:83634:x1863837564861568:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497476.959982:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497476.960002:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dca00/0x3e357265691c353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c34c expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.960032:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dca00/0x3e357265691c353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c34c expref: 10 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.960043:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dca00/0x3e357265691c353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c34c expref: 10 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.960052:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dca00, rc 0) 00000100:00100000:0.0:1777497476.960158:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564861568:12345-0@lo:101:mount.lustre.0 Request processed in 200us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.960166:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1777497476.960279:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861568:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497476.960298:0:83634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497476.960307:0:83634:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497476.960390:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497476.960423:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497476.963357:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497476.963649:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861696 00000100:00100000:1.0:1777497476.963659:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861696 00000100:00100000:1.0:1777497476.963711:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497476.963721:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564861696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497476.964075:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564861696:12345-0@lo:501:mount.lustre.0 Request processed in 355us (3650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497476.964083:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1777497476.965062:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497476.965135:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497476.965189:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.965224:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.966413:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861824 00000100:00100000:0.0:1777497476.966424:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861824 00000100:00100000:0.0:1777497476.966475:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1777497476.966484:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564861824:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497476.966631:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564861824:12345-0@lo:503:mount.lustre.0 Request processed in 147us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.966639:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1777497476.966703:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564861824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497476.969034:0:83660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564861952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497476.969341:0:83660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.969383:0:83660:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.969447:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564861952 00000100:00100000:0.0:1777497476.969454:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564861952 00000100:00100000:0.0:1777497476.969511:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1777497476.969520:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564861952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497476.969657:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564861952:12345-0@lo:502:llog_process_th.0 Request processed in 137us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.969665:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1777497476.970635:0:83660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564861952:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1777497476.970706:0:83660:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1777497476.970721:0:83660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9240a62eb380) 00000020:00000080:3.0:1777497476.972674:0:83660:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1777497476.973075:0:83660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a68cf800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777497476.973081:0:83660:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a68cf800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1777497476.973084:0:83660:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a68cf800 4 00010000:00080000:3.0:1777497476.973142:0:83660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f8274d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497476.985111:0:83660:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1777497476.985222:0:83660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1777497476.985270:0:83660:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1777497476.985282:0:83660:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691c361 00000100:00080000:0.0:1777497476.985293:0:83660:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497476.985299:0:83660:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff923f8274d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497476.985334:0:83660:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd35f80 x1863837564862080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497476.985361:0:83660:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1777497476.985809:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564862080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497476.985880:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497476.986621:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862080 00000100:00100000:3.0:1777497476.986630:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862080 00000100:00100000:3.0:1777497476.986665:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1777497476.986672:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564862080:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777497476.986736:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564862080:12345-0@lo:38:llog_process_th.0 Request processed in 63us (856us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497476.986743:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1777497476.986851:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497476.986858:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8274d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497476.986863:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497476.986866:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564862080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497476.987244:0:83660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564862208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497476.987296:0:83660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497476.987323:0:83660:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83ed3180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497476.988377:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862208 00000100:00100000:0.0:1777497476.988385:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862208 00000100:00100000:0.0:1777497476.988462:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1777497476.988471:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564862208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497476.989311:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564862208:12345-0@lo:502:llog_process_th.0 Request processed in 839us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497476.989319:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777497476.989435:0:83660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564862208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497476.989647:0:83660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564862336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497476.989695:0:83660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497476.989763:0:83660:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408c265c00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497476.989803:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862336 00000100:00100000:2.0:1777497476.989808:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862336 00000100:00100000:2.0:1777497476.989872:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1777497476.989881:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564862336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497476.989996:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83660:x1863837564862336:12345-0@lo:502:llog_process_th.0 Request processed in 117us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497476.990003:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1777497476.990073:0:83660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83660:1863837564862336:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497476.998373:0:83660:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1777497476.999551:0:83634:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1777497476.999583:0:83634:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497476.999599:0:83634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497476.999611:0:83634:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1777497476.999694:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1777497476.999696:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497476.999698:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497476.999699:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497476.999700:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497476.999701:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497476.999702:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497476.999704:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497476.999705:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497476.999707:0:83634:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497476.999711:0:83634:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1777497476.999714:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777497476.999715:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497476.999716:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497476.999717:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497476.999718:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497476.999719:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497476.999720:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497476.999721:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497476.999722:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497476.999723:0:83634:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497476.999754:0:83634:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1777497476.999784:0:83634:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564862464:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777497476.999851:0:83634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497476.999890:0:83634:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3000 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.000320:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862464 00000100:00100000:1.0:1777497477.000328:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862464 00000100:00100000:1.0:1777497477.000378:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777497477.000386:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564862464:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777497477.000413:0:83640:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777497477.000434:0:83640:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1777497477.011526:0:83640:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777497477.011551:0:83640:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1777497477.011672:0:83645:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497477.011678:0:83645:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497477.011699:0:83645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.011719:0:83645:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.011727:0:83645:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.011788:0:83645:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.011802:0:83645:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.011817:0:83645:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83645:1863837564862592:0@lo:104: 00000100:00100000:0.0:1777497477.011889:0:83645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.011946:0:83645:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.012019:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:83634:x1863837564862464:12345-0@lo:253:mount.lustre.0 Request processed in 11625us (12160us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.012020:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862592 00000100:00100000:1.0:1777497477.012032:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862592 00000100:00100000:2.0:1777497477.012041:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777497477.012160:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1777497477.012174:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:83645:x1863837564862592:12345-0@lo:104: 00010000:00010000:1.0:1777497477.012186:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012257:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777497477.012264:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:83645:x1863837564862592:12345-0@lo:104: Request processed in 94us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.012270:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:1.0:1777497477.012293:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497477.012298:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012305:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeea00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497477.012309:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012317:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497477.012323:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497477.012329:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497477.012358:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012364:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497477.012390:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012397:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c322 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c329 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012412:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497477.012413:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497477.012415:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497477.012431:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497477.012442:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564862720:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497477.012471:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497477.012517:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862720 00000100:00100000:1.0:1777497477.012521:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862720 00010000:00010000:1.0:1777497477.012536:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.012556:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2535 00000100:00100000:1.0:1777497477.012562:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3658:x1863837564862720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497477.012571:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497477.012576:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012588:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691c322 expref: 10 pid: 83640 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012603:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012611:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497477.012629:0:6501:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000953133s 00010000:00010000:1.0:1777497477.012633:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012640:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012645:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012651:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012656:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497477.012660:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012668:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012675:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.012684:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497477.012714:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3658:x1863837564862720:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.012721:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2535 00010000:00010000:2.0:1777497477.012752:0:83645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dce00/0x3e357265691c329 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691c322 expref: 9 pid: 83640 timeout: 3706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.012761:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564862720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497477.012816:0:83645:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:83645:1863837564862592:0@lo:104: 00010000:00010000:2.0:1777497477.012843:0:83645:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.012854:0:83645:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.012861:0:83645:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.012868:0:83645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd800/0x3e357265691c368 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.012953:0:83634:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:83634:1863837564862464:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1777497477.012962:0:83634:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1777497477.012964:0:83634:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1777497477.012966:0:83634:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497477.012967:0:83634:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497477.012968:0:83634:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497477.012968:0:83634:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497477.012970:0:83634:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497477.012970:0:83634:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497477.012971:0:83634:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497477.012972:0:83634:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497477.012973:0:83634:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1777497477.012983:0:83634:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1777497477.031835:0:83634:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:3.0:1777497477.032736:0:83634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1777497477.032950:0:83665:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:1.0:1777497477.032970:0:83665:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:0.0:1777497477.033171:0:83634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:3.0:1777497477.033745:0:83666:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777497477.034004:0:83634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1777497477.034043:0:83634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1777497477.035136:0:83667:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564862848:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497477.035209:0:83667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.035247:0:83667:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240885a2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.035281:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862848 00000100:00100000:2.0:1777497477.035304:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862848 00000100:00100000:2.0:1777497477.035371:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1777497477.035388:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83667:x1863837564862848:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497477.035522:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83667:x1863837564862848:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 134us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.035530:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3868 00000100:00100000:2.0:1777497477.035583:0:83667:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564862848:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1777497477.035635:0:83667:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1777497477.035674:0:83667:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564862976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497477.035712:0:83667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.035814:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564862976 00000100:00100000:0.0:1777497477.035823:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564862976 00000100:00100000:0.0:1777497477.035872:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3869 00000100:00100000:0.0:1777497477.035881:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83667:x1863837564862976:12345-0@lo:1000:lod0000_rec0001.0 00000004:00000080:1.0:1777497477.036558:0:83634:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1777497477.036573:0:83634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000100:00100000:2.0:1777497477.036650:0:83667:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e40c0 going to sleep for 11 seconds 00000040:00080000:1.0:1777497477.036665:0:83634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1777497477.036683:0:83667:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564862976:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497477.037002:0:83667:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564863104:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497477.037045:0:83667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.037079:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863104 00000100:00100000:2.0:1777497477.037085:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863104 00000100:00100000:2.0:1777497477.037229:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1777497477.037239:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:83667:x1863837564863104:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497477.037461:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:83667:x1863837564863104:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.037469:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3870 00000100:00100000:2.0:1777497477.037494:0:83667:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e40c0 going to sleep for 11 seconds 00000040:00080000:1.0:1777497477.037814:0:83634:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1777497477.037822:0:83667:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:83667:1863837564863104:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1777497477.037906:0:83667:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497477.038638:0:83634:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1777497477.038680:0:83634:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000100:00100000:0.0:1777497477.038859:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:83667:x1863837564862976:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.038872:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3869 00000040:00080000:3.0:1777497477.038971:0:83666:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497477.039925:0:83634:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1777497477.040787:0:83634:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4b:0x0] (8/32) registered 00010000:00080000:0.0:1777497477.045727:0:83634:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 98784247812 00010000:00080000:1.0:1777497477.047050:0:83668:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 83668 00010000:02000000:1.0:1777497477.047133:0:83668:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1777497477.047137:0:83668:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1777497477.047141:0:83668:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1777497477.047296:0:83634:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1777497477.047314:0:83634:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1777497477.047332:0:83634:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1777497477.047357:0:83634:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1777497477.048381:0:83634:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1777497477.048682:0:83634:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1777497477.049004:0:83667:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1777497477.050237:0:83667:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1777497477.050862:0:83666:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777497477.050938:0:83666:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1777497477.050942:0:83666:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00080000:0.0:1777497477.052621:0:83668:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00010000:0.0:1777497477.283756:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1777497477.731053:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777497477.731060:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a68cf800 from 108 10000000:01000000:3.0:1777497477.731065:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1777497477.731141:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.731153:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.731164:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.731191:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.731258:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.731300:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.731393:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863232 00000100:00100000:0.0:1777497477.731401:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863232 00000100:00100000:0.0:1777497477.731455:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1777497477.731466:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837564863232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.731480:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.731494:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dc000/0x3e357265691c376 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c36f expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.731518:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dc000/0x3e357265691c376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c36f expref: 10 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.731529:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dc000/0x3e357265691c376 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c36f expref: 10 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.731537:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc000, rc 0) 00000100:00100000:0.0:1777497477.731588:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564863232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.731603:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1777497477.731644:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.731661:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.731670:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.731717:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.735211:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.735261:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.735274:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863360 00000100:00100000:1.0:1777497477.735283:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863360 00000100:00100000:1.0:1777497477.735332:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777497477.735342:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564863360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497477.735368:0:83640:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777497477.735385:0:83640:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497477.735389:0:83640:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 108 00000100:00100000:1.0:1777497477.735494:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564863360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 153us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.735502:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1777497477.736394:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1777497477.736462:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1777497477.736473:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.736485:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.736503:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497477.736506:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:3.0:1777497477.736509:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497477.736544:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.736552:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.736562:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.736582:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.736623:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.736661:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.743996:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863488 00000100:00100000:0.0:1777497477.744010:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863488 00000100:00100000:0.0:1777497477.744079:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1777497477.744089:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564863488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.744124:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.744141:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dc600/0x3e357265691c384 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c37d expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.744169:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dc600/0x3e357265691c384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c37d expref: 11 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.744180:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dc600/0x3e357265691c384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c37d expref: 11 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.744188:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc600, rc 0) 00000100:00100000:0.0:1777497477.744258:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (7635us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.744265:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1777497477.745186:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.745214:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.745227:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.745321:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.745364:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.745399:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.748235:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863616 00000100:00100000:1.0:1777497477.748251:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863616 00000100:00100000:1.0:1777497477.748334:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777497477.748346:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.749553:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1207us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.749570:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1777497477.751529:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.751593:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.751654:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.751693:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.754743:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863744 00000100:00100000:1.0:1777497477.754756:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863744 00000100:00100000:1.0:1777497477.754828:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1777497477.754839:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.755017:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (3362us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.755024:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777497477.755169:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497477.758421:0:83695:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1777497477.758805:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1777497477.758834:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497477.758846:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.758858:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497477.758877:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777497477.758880:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 105 10000000:01000000:1.0:1777497477.758883:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497477.758924:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.758932:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.758943:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.758967:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.759058:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.759248:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564863872 00000100:00100000:0.0:1777497477.759256:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564863872 00000100:00100000:0.0:1777497477.759313:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777497477.759322:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564863872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.759337:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.759348:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd400/0x3e357265691c392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c38b expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.759382:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd400/0x3e357265691c392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c38b expref: 12 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.759392:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd400/0x3e357265691c392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c38b expref: 12 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.759400:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd400, rc 0) 00000100:00100000:0.0:1777497477.759431:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564863872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.759438:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1777497477.759659:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.759683:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564863872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497477.759698:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.759707:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.759756:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864000:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.759794:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497477.759818:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.759834:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864000 00000100:00100000:2.0:1777497477.759840:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864000 00000100:00100000:2.0:1777497477.759875:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1777497477.759883:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564864000:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1777497477.759898:0:83640:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1777497477.759917:0:83640:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1777497477.759921:0:83640:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1777497477.759924:0:83640:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1777497477.759927:0:83640:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1777497477.759929:0:83640:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:2.0:1777497477.760027:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564864000:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 144us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.760041:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1777497477.760139:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864000:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497477.760218:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497477.760224:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.760233:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497477.760241:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1777497477.760243:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1777497477.760245:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497477.760263:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.760269:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.760287:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.760300:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.760325:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497477.760351:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.760450:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864128 00000100:00100000:0.0:1777497477.760455:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864128 00000100:00100000:0.0:1777497477.760482:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1777497477.760489:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924093b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564864128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.760497:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.760505:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866ddc00/0x3e357265691c3a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c399 expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.760521:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866ddc00/0x3e357265691c3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c399 expref: 13 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.760529:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866ddc00/0x3e357265691c3a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c399 expref: 13 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.760546:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866ddc00, rc 0) 00000100:00100000:0.0:1777497477.760583:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924093b57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.760589:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1777497477.760651:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497477.760662:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.760669:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.760724:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.760746:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497477.760777:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.760816:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864256 00000100:00100000:0.0:1777497477.760820:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864256 00000100:00100000:0.0:1777497477.760848:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1777497477.760854:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924093b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.760999:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924093b54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.761006:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1777497477.761149:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.761178:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.761215:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.761246:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.761300:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864384 00000100:00100000:1.0:1777497477.761305:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864384 00000100:00100000:1.0:1777497477.761337:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1777497477.761343:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.765124:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3749us (3876us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.765136:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1777497477.765443:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497477.770807:0:83696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:3.0:1777497477.771176:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:3.0:1777497477.771206:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1777497477.771225:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.771237:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.771247:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1777497477.771250:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:3.0:1777497477.771253:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1777497477.771294:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.771303:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.771315:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.771343:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.771428:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.771468:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.771598:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864512 00000100:00100000:2.0:1777497477.771605:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864512 00000100:00100000:2.0:1777497477.771660:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1777497477.771669:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564864512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.771683:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497477.771696:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086e94e00/0x3e357265691c3ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3a7 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.771720:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e94e00/0x3e357265691c3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3a7 expref: 14 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.771730:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086e94e00/0x3e357265691c3ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3a7 expref: 14 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.771738:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086e94e00, rc 0) 00000100:00100000:2.0:1777497477.771794:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564864512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.771801:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777497477.771952:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.771966:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.771974:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.771992:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1777497477.771996:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.772011:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.772018:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777497477.772020:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:3.0:1777497477.772022:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777497477.772036:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.772042:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.772048:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.772060:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.772083:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.772128:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.772181:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864640 00000100:00100000:2.0:1777497477.772190:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864640 00000100:00100000:2.0:1777497477.772221:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1777497477.772227:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564864640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.772233:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497477.772240:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086e95600/0x3e357265691c3bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3b5 expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.772252:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e95600/0x3e357265691c3bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3b5 expref: 15 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.772260:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086e95600/0x3e357265691c3bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3b5 expref: 15 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.772266:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086e95600, rc 0) 00000100:00100000:2.0:1777497477.772292:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564864640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.772298:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777497477.772371:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.772382:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.772389:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.772439:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.772463:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.772501:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.772508:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864768 00000100:00100000:0.0:1777497477.772513:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864768 00000100:00100000:0.0:1777497477.772550:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1777497477.772557:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564864768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.772674:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564864768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.772680:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777497477.772730:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.772756:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.772805:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.772826:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.772867:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564864896 00000100:00100000:2.0:1777497477.772871:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564864896 00000100:00100000:2.0:1777497477.772902:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1777497477.772909:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924083116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564864896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.772989:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924083116450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564864896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.772996:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1777497477.773067:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564864896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497477.786464:0:83698:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497477.786582:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497477.786606:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497477.786617:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.786640:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497477.786651:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497477.786654:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:2.0:1777497477.786657:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497477.786697:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.786704:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.786716:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497477.786741:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.786820:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.786867:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.786949:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865024 00000100:00100000:1.0:1777497477.786956:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865024 00000100:00100000:1.0:1777497477.787023:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1777497477.787032:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924083117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564865024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497477.787048:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497477.787064:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38000/0x3e357265691c3ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3c3 expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.787090:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38000/0x3e357265691c3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3c3 expref: 16 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.787166:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38000/0x3e357265691c3ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3c3 expref: 16 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.787175:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38000, rc 0) 00000100:00100000:1.0:1777497477.787226:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924083117850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.787234:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777497477.792746:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.792784:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.792797:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.792888:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.792944:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.792986:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.793021:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865152 00000100:00100000:0.0:1777497477.793028:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865152 00000100:00100000:0.0:1777497477.793078:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1777497477.793086:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924083115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.793228:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924083115850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.793235:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777497477.793987:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.794023:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.794063:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.794091:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.794138:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865280 00000100:00100000:0.0:1777497477.794144:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865280 00000100:00100000:0.0:1777497477.794222:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1777497477.794231:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924083114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.794323:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924083114450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.794330:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1777497477.794416:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497477.795303:0:83700:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1777497477.795373:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1777497477.795398:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497477.795408:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.795419:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497477.795428:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1777497477.795430:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1777497477.795432:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497477.795471:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.795478:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.795486:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497477.795503:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.795546:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497477.798064:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.798778:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865408 00000100:00100000:3.0:1777497477.798789:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865408 00000100:00100000:3.0:1777497477.798839:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1777497477.798848:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564865408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.798864:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497477.798887:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee200/0x3e357265691c3d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3d1 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.798993:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee200/0x3e357265691c3d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3d1 expref: 17 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.799004:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee200/0x3e357265691c3d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3d1 expref: 17 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.799013:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee200, rc 0) 00000100:00100000:3.0:1777497477.799605:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 756us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.799613:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777497477.799738:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.799756:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.799776:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497477.799855:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.799891:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.799947:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.800073:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865536 00000100:00100000:3.0:1777497477.800078:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865536 00000100:00100000:3.0:1777497477.800128:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777497477.800137:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924092da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.800276:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924092da5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.800284:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1777497477.800533:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.800567:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.800607:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.800627:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.800692:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865664 00000100:00100000:3.0:1777497477.800697:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865664 00000100:00100000:3.0:1777497477.800715:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777497477.800721:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.802962:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2232us (2344us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.802975:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1777497477.804554:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497477.805845:0:83701:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:0.0:1777497477.806006:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1777497477.806032:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1777497477.806043:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.806055:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497477.806065:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777497477.806068:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:0.0:1777497477.806071:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497477.806127:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.806135:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.806145:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.806169:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.806236:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.806294:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906db40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.806671:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865792 00000100:00100000:1.0:1777497477.806678:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865792 00000100:00100000:1.0:1777497477.806736:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1777497477.806746:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564865792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497477.806761:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497477.806782:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38600/0x3e357265691c3e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3df expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.806808:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38600/0x3e357265691c3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3df expref: 18 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.806819:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38600/0x3e357265691c3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3df expref: 18 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.807080:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38600, rc 0) 00000100:00100000:1.0:1777497477.807158:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564865792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 414us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497477.807166:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1777497477.810428:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.810458:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.810471:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.810557:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.810609:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.810655:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.810785:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564865920 00000100:00100000:3.0:1777497477.810798:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564865920 00000100:00100000:3.0:1777497477.810850:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777497477.810859:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564865920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.810991:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564865920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.810998:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497477.811210:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564865920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.811242:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.811280:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.811301:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.811342:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866048 00000100:00100000:3.0:1777497477.811346:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866048 00000100:00100000:3.0:1777497477.811384:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1777497477.811391:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564866048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.811465:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564866048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.811471:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497477.811708:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497477.812709:0:83703:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1777497477.814571:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1777497477.814601:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777497477.814612:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.814624:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.814633:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497477.814636:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:3.0:1777497477.814640:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497477.814683:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.814690:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.815034:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.815073:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.815181:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.815226:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9480 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.815337:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866176 00000100:00100000:0.0:1777497477.815346:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866176 00000100:00100000:0.0:1777497477.815400:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777497477.815410:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564866176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.815425:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.815441:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dde00/0x3e357265691c3f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3ed expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.815466:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dde00/0x3e357265691c3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3ed expref: 19 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.815487:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dde00/0x3e357265691c3f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3ed expref: 19 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.815497:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dde00, rc 0) 00000100:00100000:0.0:1777497477.816197:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 785us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.816205:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1777497477.818408:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.818439:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.818451:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497477.818547:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.818599:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.818644:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.818723:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866304 00000100:00100000:0.0:1777497477.818731:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866304 00000100:00100000:0.0:1777497477.818793:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1777497477.818802:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.819351:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.819359:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1777497477.819429:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.819468:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.819514:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.819537:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.819581:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866432 00000100:00100000:0.0:1777497477.819585:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866432 00000100:00100000:0.0:1777497477.819616:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1777497477.819624:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.819699:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.819706:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1777497477.819777:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497477.820740:0:83704:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1777497477.823806:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1777497477.823853:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497477.823864:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.823876:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497477.823886:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1777497477.823890:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1777497477.823892:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497477.823944:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.823954:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.823972:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.824001:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.824067:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.824199:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.824997:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866560 00000100:00100000:0.0:1777497477.825007:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866560 00000100:00100000:0.0:1777497477.825063:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777497477.825071:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564866560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.825085:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.825128:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dcc00/0x3e357265691c402 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c3fb expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.825153:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dcc00/0x3e357265691c402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c3fb expref: 20 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.825165:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dcc00/0x3e357265691c402 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c3fb expref: 20 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.825174:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dcc00, rc 0) 00000100:00100000:0.0:1777497477.825221:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.825228:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1777497477.825374:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.825391:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.825401:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.825466:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.825492:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.825509:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.825522:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866688 00000100:00100000:3.0:1777497477.825526:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866688 00000100:00100000:3.0:1777497477.825547:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777497477.825554:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.825673:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.825679:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777497477.825706:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.825731:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.825787:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.825799:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.825809:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866816 00000100:00100000:3.0:1777497477.825812:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866816 00000100:00100000:3.0:1777497477.825829:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777497477.825834:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.832836:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6992us (7039us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.832851:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1777497477.833050:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497477.834194:0:83705:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1777497477.834336:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1777497477.834359:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1777497477.834369:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.834381:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497477.834391:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777497477.834394:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:0.0:1777497477.834397:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497477.834437:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.834445:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.834473:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.834496:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.834545:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.834583:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906db40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497477.834676:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564866944 00000100:00100000:2.0:1777497477.834684:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564866944 00000100:00100000:2.0:1777497477.834728:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1777497477.834736:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564866944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.834748:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497477.834759:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086e95200/0x3e357265691c410 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c409 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.834790:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e95200/0x3e357265691c410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c409 expref: 21 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.834806:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086e95200/0x3e357265691c410 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c409 expref: 21 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.834815:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086e95200, rc 0) 00000100:00100000:2.0:1777497477.834851:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564866944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497477.834858:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1777497477.834999:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564866944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.835014:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.835023:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497477.835073:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.835365:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.835382:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906db40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497477.835420:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867072 00000100:00100000:3.0:1777497477.835424:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867072 00000100:00100000:3.0:1777497477.835455:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1777497477.835461:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564867072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.835562:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564867072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497477.835568:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1777497477.835622:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.835655:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497477.835697:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497477.835786:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867200 00000100:00100000:0.0:1777497477.835790:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867200 00000100:00100000:0.0:1777497477.835817:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497477.835823:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564867200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.835887:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564867200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.835893:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497477.840079:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.841022:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089389880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497477.842560:0:83706:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497477.842775:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497477.842803:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497477.842813:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.842825:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497477.842834:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1777497477.842836:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497477.842839:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1777497477.842878:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.842886:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.842894:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497477.842928:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.843002:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.843044:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.843298:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867328 00000100:00100000:0.0:1777497477.843305:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867328 00000100:00100000:0.0:1777497477.843346:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777497477.843355:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564867328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.843368:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.843381:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd600/0x3e357265691c41e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c417 expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.843402:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd600/0x3e357265691c41e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c417 expref: 22 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.843413:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd600/0x3e357265691c41e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c417 expref: 22 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.843420:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd600, rc 0) 00000100:00100000:0.0:1777497477.843464:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564867328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.843470:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777497477.843613:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497477.843626:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.843635:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497477.843652:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1777497477.843656:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.843662:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497477.843669:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1777497477.843670:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497477.843672:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1777497477.843686:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.843693:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497477.843700:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497477.843713:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497477.843747:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497477.843791:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497477.844463:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867456 00000100:00100000:0.0:1777497477.844469:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867456 00000100:00100000:0.0:1777497477.844506:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1777497477.844515:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409b416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564867456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497477.844525:0:83643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497477.844537:0:83643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924099078000/0x3e357265691c42c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c425 expref: -99 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.844557:0:83643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924099078000/0x3e357265691c42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c425 expref: 23 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.844574:0:83643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924099078000/0x3e357265691c42c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c425 expref: 23 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497477.844580:0:83643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078000, rc 0) 00000100:00100000:0.0:1777497477.844629:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409b416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564867456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497477.844636:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1777497477.844797:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497477.844812:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497477.844820:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497477.844880:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497477.845004:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497477.845080:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497477.850072:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867584 00000100:00100000:1.0:1777497477.850088:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867584 00000100:00100000:0.0:1777497477.851137:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1777497477.851148:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564867584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497477.851281:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564867584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (6277us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497477.851288:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1777497477.851637:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564867584:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1777497477.851682:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1777497477.851692:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497477.851702:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497478.141684:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497478.141853:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277376 00000100:00100000:2.0:1777497478.141863:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277376 00000100:00100000:2.0:1777497478.141920:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:2.0:1777497478.141930:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+4:41987:x1863837546277376:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497478.141946:0:83642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497478.141962:0:83642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086e95c00/0x3e357265691c433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0ea expref: -99 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497478.141991:0:83642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086e95c00/0x3e357265691c433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ea expref: 5 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497478.142002:0:83642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086e95c00/0x3e357265691c433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ea expref: 5 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497478.142011:0:83642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086e95c00, rc 0) 00000100:00100000:2.0:1777497478.142065:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546277376:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 137us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497478.142072:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1777497478.145626:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497478.145739:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277504 00000100:00100000:1.0:1777497478.145750:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277504 00000100:00100000:1.0:1777497478.145820:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1777497478.145831:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546277504:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497478.145864:0:83643:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777497478.145891:0:83643:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497478.145895:0:83643:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497478.145898:0:83643:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497478.145901:0:83643:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777497478.145903:0:83643:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 108 00000100:00100000:1.0:1777497478.157398:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546277504:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 11558us (11770us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497478.157412:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:1.0:1777497478.165425:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497478.165852:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277632 00000100:00100000:2.0:1777497478.165863:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277632 00000100:00100000:2.0:1777497478.165915:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1135 00000100:00100000:2.0:1777497478.165924:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546277632:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 00010000:00080000:2.0:1777497478.165957:0:64885:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '6d03493e-1218-49f3-bdd0-b10716c402e0' at ffff92409c468800, cookie 0x3e357265691c2b2 00010000:00080000:2.0:1777497478.165962:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp recovering/t98784247813 exp ffff92409c468800 cur 3607 last 1777497476 00010000:02000400:2.0:1777497478.165971:0:64885:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1777497478.165982:0:64885:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1777497478.166003:0:64885:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1777497478.167395:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497478.167481:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546277632:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 Request processed in 1554us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497478.167490:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1135 00000100:00100000:1.0:1777497478.168319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497478.169187:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277760 00000100:00100000:3.0:1777497478.169197:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277760 00000100:00100000:3.0:1777497478.169259:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:3.0:1777497478.169268:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546277760:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497478.169283:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497478.169299:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee000/0x3e357265691c43a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0f1 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.169328:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee000/0x3e357265691c43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f1 expref: 6 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.169340:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee000/0x3e357265691c43a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f1 expref: 6 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.169350:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee000, rc 0) 00000100:00100000:3.0:1777497478.169400:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546277760:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 133us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497478.169406:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:1.0:1777497478.178563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497478.178640:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546277888 00000100:00100000:3.0:1777497478.178651:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546277888 00000100:00100000:3.0:1777497478.178713:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1777497478.178730:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546277888:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497478.178889:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546277888:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 160us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497478.178896:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1777497478.181318:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497478.181404:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546270848 00000100:00100000:1.0:1777497478.181415:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546270848 00000100:00100000:1.0:1777497478.181487:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1136 00000100:00100000:1.0:1777497478.181499:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546270848:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00080000:1.0:1777497478.181522:0:65418:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 98784247813, current: 98784247813, replaying 00000100:00100000:1.0:1777497478.181545:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546270848:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 50us (238us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497478.181552:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1136 00000100:00100000:1.0:1777497478.183136:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497478.183497:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278016 00000100:00100000:3.0:1777497478.183507:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278016 00000100:00100000:3.0:1777497478.183555:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1777497478.183565:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546278016:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497478.183706:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546278016:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 142us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497478.183713:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1777497478.189773:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497478.189876:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278144 00000100:00100000:1.0:1777497478.189887:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278144 00000100:00100000:1.0:1777497478.189945:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:1.0:1777497478.189956:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546278144:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497478.189973:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497478.189993:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38800/0x3e357265691c441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0f8 expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497478.190030:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38800/0x3e357265691c441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f8 expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497478.190042:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38800/0x3e357265691c441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f8 expref: 8 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497478.190052:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38800, rc 0) 00000100:00100000:1.0:1777497478.190153:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278144:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 199us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497478.190174:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00010000:00080000:1.0:1777497478.191448:0:83668:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1777497478.198396:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497478.198634:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278272 00000100:00100000:3.0:1777497478.198646:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278272 00000100:00100000:3.0:1777497478.198712:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1777497478.198730:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278272:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497478.198900:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278272:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 180us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497478.198907:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1777497478.203652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497478.205011:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278400 00000100:00100000:0.0:1777497478.205024:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278400 00000100:00100000:0.0:1777497478.205079:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1777497478.205088:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278400:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497478.205262:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278400:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 174us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497478.205271:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:0.0:1777497478.216274:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497478.216590:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278528 00000100:00100000:3.0:1777497478.216602:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278528 00000100:00100000:3.0:1777497478.216660:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1777497478.216670:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546278528:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497478.216687:0:83640:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497478.216706:0:83640:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee400/0x3e357265691c448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0ff expref: -99 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.216745:0:83640:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee400/0x3e357265691c448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ff expref: 9 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.216780:0:83640:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee400/0x3e357265691c448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ff expref: 9 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497478.216790:0:83640:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee400, rc 0) 00000100:00100000:3.0:1777497478.216858:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546278528:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 184us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497478.216864:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1777497478.241730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497478.245260:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278656 00000100:00100000:0.0:1777497478.245278:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278656 00000100:00100000:0.0:1777497478.245339:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:0.0:1777497478.245349:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546278656:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497478.245492:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546278656:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 143us (3784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497478.245500:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00010000:00010000:2.0:1777497478.306598:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497478.980969:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497478.981268:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278784 00000100:00100000:0.0:1777497478.981278:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278784 00000100:00100000:0.0:1777497478.981350:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1137 00000100:00100000:0.0:1777497478.981361:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546278784:12345-192.168.202.4@tcp:17:kworker.0 00000100:00100000:0.0:1777497478.981455:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546278784:12345-192.168.202.4@tcp:17:kworker.0 Request processed in 97us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497478.981463:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1137 00000100:00080000:2.0:1777497478.981893:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497479.205312:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564867712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497479.205384:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497479.205599:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867712 00000100:00100000:2.0:1777497479.205608:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867712 00000100:00100000:2.0:1777497479.205668:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:2.0:1777497479.205678:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564867712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497479.205708:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497479.205768:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564867712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497479.205776:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00080000:0.0:1777497479.205862:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497479.205907:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564867712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497479.213224:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564867840:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497479.213314:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497479.213467:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867840 00000100:00100000:3.0:1777497479.213476:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867840 00000100:00080000:2.0:1777497479.213529:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497479.213565:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1777497479.213574:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564867840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497479.213606:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 214592 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497479.213657:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564867840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497479.213664:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:2.0:1777497479.213705:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564867840:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777497479.330944:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497480.355476:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497481.380514:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497481.617899:0:83901:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1777497482.045849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497482.045888:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497482.045915:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279040 00000100:00100000:3.0:1777497482.045924:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279040 00000100:00100000:3.0:1777497482.046002:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1101 00000100:00100000:3.0:1777497482.046013:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546279040:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497482.046086:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546279040:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497482.046119:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1101 00000100:00080000:3.0:1777497482.046169:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497482.051502:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546278912 00000100:00100000:0.0:1777497482.051516:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546278912 00000100:00100000:0.0:1777497482.051693:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1777497482.051704:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546278912:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497482.051798:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546278912:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 97us (5909us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497482.051806:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:3.0:1777497482.279342:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497482.279357:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564867968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497482.279432:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.279510:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564867968 00000100:00100000:2.0:1777497482.279518:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564867968 00000100:00100000:2.0:1777497482.279574:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3871 00000100:00100000:2.0:1777497482.279583:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564867968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497482.279618:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497482.279668:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564867968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.279690:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3871 00000100:00100000:2.0:1777497482.279751:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564867968:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1777497482.279803:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497482.279807:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497482.279811:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497482.279819:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497482.279829:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564868096:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.279862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.279915:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd35f80 x1863837564868224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497482.279947:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497482.279951:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497482.279952:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497482.279957:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497482.279966:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564868352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280008:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.280040:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868352 00000100:00100000:2.0:1777497482.280044:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868352 00000100:00100000:2.0:1777497482.280154:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1777497482.280162:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564868352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280200:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564868352:12345-0@lo:400:kworker.0 Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.280206:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00080000:2.0:1777497482.280228:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497482.280254:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564868352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280279:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b2d80 x1863837564868480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497482.280299:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497482.280302:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497482.280304:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497482.280309:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497482.280317:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564868608:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280342:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.280370:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868608 00000100:00100000:2.0:1777497482.280374:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868608 00000100:00100000:2.0:1777497482.280403:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1777497482.280408:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280438:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564868608:12345-0@lo:400:kworker.0 Request processed in 30us (96us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.280443:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00080000:2.0:1777497482.280459:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497482.280475:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564868608:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280498:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af599f80 x1863837564868736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497482.280523:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497482.280530:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564868864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280556:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497482.280593:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497482.280603:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497482.280605:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497482.280611:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497482.280621:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564868992:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280647:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.280681:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924088f86300 x1863837564869120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497482.280707:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564869248:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.280775:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868864 00000100:00100000:2.0:1777497482.280779:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868864 00000100:00100000:2.0:1777497482.280807:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868992 00000100:00100000:2.0:1777497482.280810:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868992 00000100:00100000:2.0:1777497482.280826:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869248 00000100:00100000:2.0:1777497482.280829:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869248 00000100:00100000:2.0:1777497482.280848:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1777497482.280855:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564868864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280891:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564868864:12345-0@lo:400:kworker.0 Request processed in 37us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.280896:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:2.0:1777497482.280908:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1777497482.280914:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564868992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280940:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564868992:12345-0@lo:400:kworker.0 Request processed in 26us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.280945:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:2.0:1777497482.280956:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:2.0:1777497482.280969:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564869248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.280999:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564869248:12345-0@lo:400:kworker.0 Request processed in 31us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.281004:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00080000:2.0:1777497482.281020:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497482.281023:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497482.281038:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564868992:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.281056:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564869248:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.281072:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564868864:0@lo:400:kworker.0 00000100:00080000:2.0:1777497482.281113:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1777497482.281117:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497482.281119:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8274d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497482.281124:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff923f8274d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497482.281132:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564869376:0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.281166:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.281193:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869376 00000100:00100000:2.0:1777497482.281197:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869376 00000100:00100000:2.0:1777497482.281221:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:2.0:1777497482.281226:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564869376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497482.281256:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c97e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564869376:12345-0@lo:400:kworker.0 Request processed in 30us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.281261:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:3.0:1777497482.281690:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868096 00000100:00100000:3.0:1777497482.281695:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868096 00000100:00100000:3.0:1777497482.281743:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777497482.281750:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564868096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497482.281789:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564868096:12345-0@lo:400:kworker.0 Request processed in 40us (1926us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497482.281795:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777497482.281836:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564868096:0@lo:400:kworker.0 00000100:00080000:3.0:1777497482.284216:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497482.284266:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f44380 x1863837564869504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497482.288000:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564869376:0@lo:400:kworker.0 00000100:00100000:1.0:1777497482.291573:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564868224:0@lo:38:kworker.0 00000100:00100000:1.0:1777497482.291649:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.291692:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564868480:0@lo:38:kworker.0 00000100:00100000:1.0:1777497482.291714:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.291748:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564868736:0@lo:38:kworker.0 00000100:00100000:1.0:1777497482.291771:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.291788:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564869120:0@lo:38:kworker.0 00000100:00100000:1.0:1777497482.291806:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.291821:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564869504:0@lo:38:kworker.0 00000100:00100000:1.0:1777497482.291839:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.291886:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868224 00000100:00100000:1.0:1777497482.291893:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868224 00000100:00100000:1.0:1777497482.291918:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868480 00000100:00100000:1.0:1777497482.291920:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868480 00000100:00100000:1.0:1777497482.291928:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869120 00000100:00100000:1.0:1777497482.291930:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869120 00000100:00100000:1.0:1777497482.291936:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869504 00000100:00100000:1.0:1777497482.291937:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869504 00000100:00100000:1.0:1777497482.291950:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1777497482.291956:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564868224:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.292003:0:63729:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:1.0:1777497482.292037:0:63729:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691c44f 00000004:00100000:1.0:1777497482.292051:0:63729:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497482.292202:0:63729:0:(import.c:65:import_set_state_nolock()) ffff924086e2b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497482.292255:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837564868224:12345-0@lo:38:kworker.0 Request processed in 296us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497482.292263:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:1.0:1777497482.292282:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1777497482.292286:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564868480:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.292299:0:63729:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:1.0:1777497482.292320:0:63729:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691c456 00000004:00100000:1.0:1777497482.292326:0:63729:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497482.292343:0:63729:0:(import.c:65:import_set_state_nolock()) ffff92408a0a4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497482.292371:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837564868480:12345-0@lo:38:kworker.0 Request processed in 83us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497482.292377:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:1.0:1777497482.292391:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1777497482.292395:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564869120:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.292407:0:63729:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:1.0:1777497482.292427:0:63729:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691c45d 00000004:00100000:1.0:1777497482.292433:0:63729:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497482.292447:0:63729:0:(import.c:65:import_set_state_nolock()) ffff92408a0a3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497482.292472:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837564869120:12345-0@lo:38:kworker.0 Request processed in 76us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497482.292478:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:1.0:1777497482.292501:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:1.0:1777497482.292505:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564869504:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.292519:0:63729:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3611 last 0 00000020:00000080:1.0:1777497482.292542:0:63729:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691c464 00000004:00100000:1.0:1777497482.292548:0:63729:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497482.292562:0:63729:0:(import.c:65:import_set_state_nolock()) ffff9240a6375800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497482.292590:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564869504:12345-0@lo:38:kworker.0 Request processed in 83us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497482.292596:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00010000:00080000:1.0:1777497482.292636:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240bcd35f80 x1863837564868224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.292650:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 24 00000100:00080000:1.0:1777497482.293438:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9240bcd35f80 x1863837564868224/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.293447:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497482.293451:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497482.293455:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497482.293459:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564868224:0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.293479:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240865b2d80 x1863837564868480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.293488:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 24 00000100:00080000:1.0:1777497482.294289:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9240865b2d80 x1863837564868480/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.294298:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497482.294301:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497482.294321:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497482.294327:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564868480:0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.294350:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924088f86300 x1863837564869120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.294361:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 24 00000100:00100000:2.0:1777497482.297319:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564868736 00000100:00100000:2.0:1777497482.297348:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564868736 00000100:00100000:2.0:1777497482.297398:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3872 00000100:00100000:2.0:1777497482.297406:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564868736:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497482.297438:0:80394:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff92409c46b800, cookie 0x3e357265691c2b9 00010000:00080000:2.0:1777497482.297443:0:80394:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff92409c46b800 cur 3611 last 1777497476 00000004:00100000:2.0:1777497482.297467:0:80394:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497482.297504:0:80394:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497482.297587:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564868736:12345-0@lo:38:kworker.0 Request processed in 180us (5813us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.297594:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3872 00000100:00080000:1.0:1777497482.301863:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff924088f86300 x1863837564869120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497507 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.301877:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497482.301883:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497482.301888:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497482.301894:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564869120:0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.301932:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f82f44380 x1863837564869504/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497492 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497482.301948:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 24 00000100:00080000:1.0:1777497482.301956:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1777497482.301960:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1777497482.301962:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8274d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497482.301967:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564869504:0@lo:38:kworker.0 00000100:00080000:1.0:1777497482.302004:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 24 00000100:00080000:1.0:1777497482.302012:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1777497482.302015:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1777497482.302018:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1777497482.302021:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1777497482.302024:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1777497482.303121:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af599f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564868736:0@lo:38:kworker.0 00010000:00080000:1.0:1777497482.303156:0:83668:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1777497482.303161:0:83668:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 98784247813 00000020:00080000:1.0:1777497482.303167:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.303170:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 98784247813, next_transno: 98784247813 00010000:00080000:1.0:1777497482.303173:0:83668:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (98784247813) 00000020:00080000:1.0:1777497482.303175:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.303185:0:83668:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546270848 t98784247813 from 192.168.202.4@tcp req@ffff923f82f47480 x1863837546270848/t0(98784247813) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:234/0 lens 528/0 e 0 to 0 dl 1777497489 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777497482.308548:0:83937:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1777497482.308554:0:83937:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1777497482.308560:0:83937:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1777497482.309307:0:83937:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000004:00080000:1.0:1777497482.311994:0:83668:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 8743us 00000100:00100000:1.0:1777497482.312024:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564869632:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1777497482.312121:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497482.312174:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869632 00000100:00100000:1.0:1777497482.312182:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869632 00000100:00100000:1.0:1777497482.312230:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3873 00000100:00100000:1.0:1777497482.312240:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564869632:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:1.0:1777497482.312260:0:8407:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff924089389180 x1863837564869632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:238/0 lens 224/0 e 0 to 0 dl 1777497493 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497482.312270:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564869632:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 33us (151us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497482.312277:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3873 00010000:00010000:1.0:1777497482.336292:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336312:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336338:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336352:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336359:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336365:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336756:0:83668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336765:0:83668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336772:0:83668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336777:0:83668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497482.336781:0:83668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336788:0:83668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336799:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:1.0:1777497482.336802:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497482.336807:0:83668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336818:0:83668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c46b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497482.336834:0:83668:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000058bf9d75 reply state 0000000005ad8a32 transno 98784247813 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336845:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.336851:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d200) 00010000:00010000:1.0:1777497482.336853:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497482.336856:0:83668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497482.336959:0:83668:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1777497482.336977:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.336980:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000020:00080000:1.0:1777497482.336984:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.336986:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247814 00000001:00080000:3.0:1777497482.343035:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247813 is committed 00010000:00010000:1.0:1777497482.343087:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343144:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343152:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343159:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497482.343164:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343184:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343201:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d200) 00010000:00010000:1.0:1777497482.343204:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497482.343209:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.343216:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c472 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497482.346068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497482.346170:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546271360 00000100:00100000:1.0:1777497482.346180:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546271360 00000100:00100000:1.0:1777497482.346237:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1142 00000100:00100000:1.0:1777497482.346247:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546271360:12345-192.168.202.4@tcp:36:rm.0 00010000:00080000:1.0:1777497482.346266:0:63729:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 98784247814, current: 98784247814, replaying 00000100:00100000:1.0:1777497482.346280:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546271360:12345-192.168.202.4@tcp:36:rm.0 Request processed in 36us (221us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497482.346287:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1142 00000020:00080000:1.0:1777497482.346302:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.346306:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247814, next_transno: 98784247814 00010000:00080000:1.0:1777497482.346310:0:83668:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (98784247814) 00000020:00080000:1.0:1777497482.346313:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.346321:0:83668:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546271360 t98784247814 from 192.168.202.4@tcp req@ffff923f82f46300 x1863837546271360/t0(98784247814) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 512/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777497482.346403:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346428:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346440:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346452:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346458:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346464:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346555:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346562:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346568:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346778:0:83668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346785:0:83668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346791:0:83668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346806:0:83668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497482.346810:0:83668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346817:0:83668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346828:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x4:0x0].0x0 (ffff9240a3b5d900) 00010000:00010000:1.0:1777497482.346831:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497482.346836:0:83668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346841:0:83668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c487 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346865:0:83668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346872:0:83668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346878:0:83668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346884:0:83668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497482.346886:0:83668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346892:0:83668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346908:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5da00) 00010000:00010000:1.0:1777497482.346911:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497482.346914:0:83668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346920:0:83668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c479 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497482.346935:0:83668:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000057c956c3 reply state 000000006b82ab3f transno 98784247814 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346946:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.346952:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5df00) 00010000:00010000:1.0:1777497482.346955:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497482.346957:0:83668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497482.347028:0:83668:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497482.347044:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.347046:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000020:00080000:1.0:1777497482.347050:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.347052:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247815 00000100:00100000:1.0:1777497482.355009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497482.358250:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272512 00000100:00100000:2.0:1777497482.358265:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272512 00000100:00100000:2.0:1777497482.358331:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1143 00000100:00100000:2.0:1777497482.358342:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546272512:12345-192.168.202.4@tcp:101:touch.0 00010000:00080000:2.0:1777497482.358362:0:63728:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 98784247815, current: 98784247815, replaying 00000100:00100000:2.0:1777497482.358381:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546272512:12345-192.168.202.4@tcp:101:touch.0 Request processed in 43us (3382us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497482.358388:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1143 00000020:00080000:1.0:1777497482.358467:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.358472:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247815, next_transno: 98784247815 00010000:00080000:1.0:1777497482.358476:0:83668:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (98784247815) 00000020:00080000:1.0:1777497482.358479:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.358488:0:83668:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546272512 t98784247815 from 192.168.202.4@tcp req@ffff92408938bb80 x1863837546272512/t0(98784247815) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 752/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00010000:1.0:1777497482.358525:0:83668:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497482.358549:0:83668:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c48e lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c0e3 expref: -99 pid: 83668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358760:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,1 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358773:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358783:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358795:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358801:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.358807:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777497482.359163:0:83668:0:(mdt_open.c:504:mdt_mfd_open()) orphan mfd not found, fid = [0x20000a811:0x5:0x0], cookie = 0x3e357265691c21f 00000004:00080000:1.0:1777497482.359166:0:83668:0:(mdt_open.c:508:mdt_mfd_open()) Store old cookie 0x3e357265691c21f in new mfd 00010000:00010000:1.0:1777497482.359174:0:83668:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,1 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359181:0:83668:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 2/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359188:0:83668:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359199:0:83668:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497482.359203:0:83668:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 3/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359211:0:83668:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 4/0,0 mode: CW/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359222:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5da00) 00010000:00010000:1.0:1777497482.359225:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497482.359229:0:83668:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 2/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359235:0:83668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691c495 lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497482.359247:0:83668:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000058109ee0 reply state 00000000b46ee7a2 transno 98784247815 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359257:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359262:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9240a3b5d900) 00010000:00010000:1.0:1777497482.359265:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497482.359267:0:83668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1777497482.359288:0:83668:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c48e lrc: 1/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 83668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359297:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5da00) 00010000:00010000:1.0:1777497482.359299:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497482.359302:0:83668:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c48e lrc: 0/0,0 mode: --/CW res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0e3 expref: 10 pid: 83668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.359320:0:83668:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39c00, rc 0) 00010000:00080000:1.0:1777497482.359447:0:83668:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497482.359462:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.359465:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00000020:00080000:1.0:1777497482.359468:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.359471:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247816 00010000:00010000:2.0:1777497482.403159:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497482.407562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497482.407777:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546272768 00000100:00100000:2.0:1777497482.407789:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546272768 00000100:00100000:2.0:1777497482.407859:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1144 00000100:00100000:2.0:1777497482.407880:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546272768:12345-192.168.202.4@tcp:36:touch.0 00010000:00080000:2.0:1777497482.407900:0:63727:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 98784247816, current: 98784247816, replaying 00000100:00100000:2.0:1777497482.407915:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546272768:12345-192.168.202.4@tcp:36:touch.0 Request processed in 38us (362us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497482.407922:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1144 00000020:00080000:1.0:1777497482.407939:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.407943:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247816, next_transno: 98784247816 00010000:00080000:1.0:1777497482.407947:0:83668:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (98784247816) 00000020:00080000:1.0:1777497482.407950:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.407958:0:83668:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546272768 t98784247816 from 192.168.202.4@tcp req@ffff9240865b2d80 x1863837546272768/t0(98784247816) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 488/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777497482.408056:0:83668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.408221:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.408232:0:83668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497482.408425:0:83668:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f5c807bd reply state 000000007467e570 transno 98784247816 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.408439:0:83668:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.408457:0:83668:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9240a3b5da00) 00010000:00010000:1.0:1777497482.408461:0:83668:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497482.408464:0:83668:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497482.408653:0:83668:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497482.408665:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.408667:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000020:00080000:1.0:1777497482.408678:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.408679:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247817 00000100:00100000:2.0:1777497482.414447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497482.414680:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546273152 00000100:00100000:3.0:1777497482.414691:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546273152 00000100:00100000:3.0:1777497482.414762:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 222 00000100:00100000:3.0:1777497482.414772:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546273152:12345-192.168.202.4@tcp:35:touch.0 00010000:00080000:3.0:1777497482.414796:0:63731:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 98784247817, current: 98784247817, replaying 00000100:00100000:3.0:1777497482.414821:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546273152:12345-192.168.202.4@tcp:35:touch.0 Request processed in 52us (388us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497482.414829:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 222 00000020:00080000:1.0:1777497482.414938:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.414944:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 98784247817, next_transno: 98784247817 00010000:00080000:1.0:1777497482.414948:0:83668:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (98784247817) 00000020:00080000:1.0:1777497482.414950:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.414960:0:83668:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546273152 t98784247817 from 192.168.202.4@tcp req@ffff924088f85880 x1863837546273152/t0(98784247817) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 392/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'touch.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497482.415233:0:83668:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497482.415252:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.415255:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000020:00080000:1.0:1777497482.415259:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497482.415261:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 98784247818 00000100:00100000:3.0:1777497482.450005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497482.450123:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279168 00000100:00100000:0.0:1777497482.450134:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279168 00000100:00100000:0.0:1777497482.450193:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1104 00000100:00100000:0.0:1777497482.450210:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546279168:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1777497482.450234:0:63729:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff923f82f46d80 x1863837546279168/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 224/0 e 0 to 0 dl 1777497493 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497482.450262:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546279168:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 Request processed in 55us (268us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497482.450269:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1104 00000020:00080000:2.0:1777497482.450336:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497482.450340:0:83668:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 98784247818 00010000:00080000:2.0:1777497482.450343:0:83668:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1777497482.450346:0:83668:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497482.450353:0:83668:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497482.450356:0:83668:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:2.0:1777497482.450480:0:83668:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 24, last_transno is 103079215104 00000001:00100000:0.0:1777497482.459509:0:83635:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:0.0:1777497482.459520:0:83635:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1777497482.459543:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 98784247817 is committed 00010000:00010000:2.0:1777497482.459634:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459646:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459652:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459656:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497482.459659:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459665:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459690:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459707:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c480 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459741:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459747:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459753:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459759:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497482.459761:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459767:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459781:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459787:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c49c lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459802:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459807:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459823:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459828:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497482.459831:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459837:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.459844:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497482.459849:0:83668:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00010000:2.0:1777497482.459850:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c4aa lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 83668 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1777497482.459888:0:83668:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1777497482.459902:0:83668:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff924089389180 x1863837564869632/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:238/0 lens 224/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777497482.460030:0:83668:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff923f82f46d80 x1863837546279168/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:238/0 lens 224/0 e 0 to 0 dl 1777497493 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1777497482.460143:0:83668:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1777497482.463891:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1777497482.463908:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff924088f86a00 x1863837564869632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497498 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497482.463917:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff924088f86a00 x1863837564869632/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497498 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497482.463924:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497482.463936:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1777497482.463942:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000b372928b): req@ffff9240a6de2300 x1863837564847488/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497461 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497482.463967:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564869632:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1777497482.464518:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497482.464561:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497482.464570:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564869760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497482.464593:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.464652:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564847488 00000100:00100000:2.0:1777497482.464668:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564847488 00000100:00100000:2.0:1777497482.464719:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869760 00000100:00100000:2.0:1777497482.464732:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869760 00000100:00100000:2.0:1777497482.464755:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1777497482.464763:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837564847488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497482.466204:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1777497482.466281:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837564847488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1516us (1761us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.466290:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3874 00000100:00100000:2.0:1777497482.466319:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1777497482.466328:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564869760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497482.466342:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1777497482.466368:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564869760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.466632:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3875 00000100:00100000:2.0:1777497482.466690:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564869760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497482.466701:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564847488:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1777497482.520552:0:83668:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef04e93e10 00100000:10000000:0.0:1777497482.520568:0:83668:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:2.0:1777497482.539495:0:83654:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:2.0:1777497482.539551:0:83654:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83654:1863837564869888:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777497482.539619:0:83654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.539663:0:83654:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268540 going to sleep for 11 seconds 00000004:00080000:2.0:1777497482.539680:0:83656:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:2.0:1777497482.539698:0:83656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83656:1863837564870016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777497482.539720:0:83656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.539753:0:83656:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497482.540057:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564869888 00000100:00100000:1.0:1777497482.540076:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564869888 00000100:00100000:1.0:1777497482.540143:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870016 00000100:00100000:1.0:1777497482.540147:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870016 00000100:00100000:1.0:1777497482.540172:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5843 00000100:00100000:1.0:1777497482.540181:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+6:83654:x1863837564869888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777497482.540211:0:25492:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -95 00002000:02000040:1.0:1777497482.540216:0:25492:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:737) 00000100:00100000:3.0:1777497482.540251:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5844 00000100:00100000:3.0:1777497482.540261:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:83656:x1863837564870016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777497482.540277:0:25486:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 737 -> diff = -593 00002000:02000040:3.0:1777497482.540280:0:25486:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:737) 00002000:00010000:1.0:1777497482.558864:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497482.558881:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.558902:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497482.558905:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497482.558911:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.558930:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.558941:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.558949:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559007:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497482.559052:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.559071:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.559082:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.559088:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.559130:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.559152:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.559160:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037d7abe/0x3e357265691c4b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497482.559161:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497482.559171:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559180:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497482.559182:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497482.559185:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.559188:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.559191:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.559194:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.559196:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559205:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559212:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559227:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497482.559235:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497482.559239:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559246:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497482.559249:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559265:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559277:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559285:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006206ea0/0x3e357265691c4b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.559300:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.559302:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.559304:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497482.561367:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561377:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561394:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561396:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561401:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561428:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561438:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561446:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561466:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497482.561514:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561519:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561527:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561528:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561531:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561539:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561547:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561554:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561573:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1777497482.561605:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561609:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561617:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561618:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561621:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561629:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561637:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561643:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561654:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1777497482.561680:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561684:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561690:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561692:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561699:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561708:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561716:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561734:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561748:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1777497482.561781:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561785:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561792:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561794:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561796:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561804:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561812:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561829:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561837:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1777497482.561865:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561869:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561876:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561877:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561880:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561889:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561895:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561902:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561909:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1777497482.561932:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.561936:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561951:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561952:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.561955:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561964:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561971:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561978:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.561986:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:2.0:1777497482.562013:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562017:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562024:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562025:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562028:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562036:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562052:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562059:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562065:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:2.0:1777497482.562091:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562118:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562125:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562126:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562129:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562137:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562144:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562151:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562159:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:2.0:1777497482.562205:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562210:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562217:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562218:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562221:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562229:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562238:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562245:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562254:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:2.0:1777497482.562286:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562291:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562299:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562300:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562303:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562312:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562326:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562334:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562346:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:2.0:1777497482.562382:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562387:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562395:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562396:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562399:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562408:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562415:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562423:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562430:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:2.0:1777497482.562474:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562478:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562486:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562487:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562490:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562497:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562504:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562511:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562518:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:2.0:1777497482.562553:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562558:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562566:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562567:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562570:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562579:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562594:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562601:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562609:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:2.0:1777497482.562647:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562652:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562660:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562662:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562664:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562673:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562681:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562688:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562696:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:2.0:1777497482.562764:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562769:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562777:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562778:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562782:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562790:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562796:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562803:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562811:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:2.0:1777497482.562846:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562850:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562856:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562858:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562860:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562868:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562883:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562890:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562899:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:2.0:1777497482.562931:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.562935:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562942:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562944:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.562946:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562953:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562959:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562966:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.562973:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:2.0:1777497482.563012:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563017:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563026:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563027:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563031:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563040:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563047:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563054:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563063:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:2.0:1777497482.563125:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563130:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563138:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563140:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563142:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563151:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563165:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563171:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563179:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:2.0:1777497482.563215:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563220:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563227:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563228:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563231:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563239:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563247:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563254:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563262:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:2.0:1777497482.563302:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563307:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563315:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563317:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563319:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563328:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563336:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563343:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563351:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:2.0:1777497482.563383:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563388:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563395:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563397:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563399:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563408:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563423:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563430:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563439:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:2.0:1777497482.563474:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563479:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563487:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563489:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563492:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563502:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563510:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563518:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563526:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:2.0:1777497482.563571:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563576:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563584:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563585:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563588:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563596:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563604:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563611:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563620:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:2.0:1777497482.563653:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563659:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563667:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563669:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563672:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563680:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563694:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563701:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563709:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:2.0:1777497482.563769:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563774:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563782:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563783:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563786:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563795:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563803:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563810:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563818:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:2.0:1777497482.563862:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563867:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563875:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563877:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563879:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563888:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563896:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563903:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563914:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:2.0:1777497482.563948:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.563953:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563960:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563962:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.563964:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563973:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563985:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.563993:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564000:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00002000:00010000:2.0:1777497482.564035:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.564039:0:25492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564046:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.564047:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.564050:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564058:0:25492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564065:0:25492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564072:0:25492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564081:0:25492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/30 locks to regular blp list, 30 blwis in pool 00010000:00010000:2.0:1777497482.564148:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 29 total in blp. (29 blwis in pool) 00010000:00010000:2.0:1777497482.564155:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564162:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564167:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564175:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564192:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564200:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf1dd54d/0x3e357265691c4bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564221:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:2.0:1777497482.564225:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564232:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564235:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564243:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564265:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564272:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b2c16d3/0x3e357265691c4c6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564285:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:2.0:1777497482.564288:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564295:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564298:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564305:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564314:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564320:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24cf63c/0x3e357265691c4cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564336:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:2.0:1777497482.564340:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564352:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564355:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564363:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564373:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564381:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef1e5361/0x3e357265691c4d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564395:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:2.0:1777497482.564399:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564406:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564409:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564417:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564425:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564439:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe2b6cb0/0x3e357265691c4db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564452:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:2.0:1777497482.564455:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564461:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564464:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564471:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564481:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564488:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0f711b4/0x3e357265691c4e2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564500:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:2.0:1777497482.564503:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564510:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564519:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564527:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564538:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564545:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000678d896/0x3e357265691c4e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564560:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:2.0:1777497482.564564:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564570:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564573:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564581:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564591:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564598:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5048629/0x3e357265691c4f0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564617:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1777497482.564621:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564627:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564631:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564638:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564648:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564654:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f18e870d/0x3e357265691c4f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564664:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:2.0:1777497482.564667:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564672:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.564675:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564692:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564701:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.564708:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dabe7bdf/0x3e357265691c4fe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1777497482.565261:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1777497482.566241:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:2.0:1777497482.566252:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566264:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566269:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566278:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566298:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566306:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062dd7184/0x3e357265691c505 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566340:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:2.0:1777497482.566344:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566351:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566354:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566362:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566373:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566380:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007dc9de14/0x3e357265691c50c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566396:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:2.0:1777497482.566400:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566405:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566408:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566425:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566435:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566442:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007289533f/0x3e357265691c513 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566456:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:2.0:1777497482.566459:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566465:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566468:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566474:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566483:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566490:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087070c82/0x3e357265691c51a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566513:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:2.0:1777497482.566517:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566523:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566525:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566532:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566542:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566549:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000015a62e5/0x3e357265691c521 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566561:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:2.0:1777497482.566565:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566570:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566573:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566593:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566603:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566610:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012bd6d45/0x3e357265691c528 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566627:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1777497482.566631:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566636:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566639:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566645:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566654:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566661:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95352f0/0x3e357265691c52f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566684:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:2.0:1777497482.566688:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566694:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566697:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566705:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566716:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566732:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9b05406/0x3e357265691c536 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566746:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:2.0:1777497482.566749:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566755:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566758:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566777:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566789:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566795:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660b7256/0x3e357265691c53d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566809:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:2.0:1777497482.566813:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566818:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566821:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566828:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566836:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566843:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008033659d/0x3e357265691c544 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566867:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1777497482.566870:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566875:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84352800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566878:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566883:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566892:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566898:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098650485/0x3e357265691c54b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566907:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1777497482.566909:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566914:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84353600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566917:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566931:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566938:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566943:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e5fdf63/0x3e357265691c552 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566953:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1777497482.566956:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566962:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.566965:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566972:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566980:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.566985:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005fea1795/0x3e357265691c559 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567008:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1777497482.567011:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567017:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567019:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567026:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567036:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567043:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab16ab41/0x3e357265691c560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567144:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1777497482.567149:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567156:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567159:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567181:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567192:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567200:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001ff09f5/0x3e357265691c567 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567216:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777497482.567219:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567226:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080031c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567229:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567236:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567246:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567254:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc14aadc/0x3e357265691c56e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567280:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777497482.567285:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567291:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924080030600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567294:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567302:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567313:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567321:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187f3a92/0x3e357265691c575 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567333:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497482.567337:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567344:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567347:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567366:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567377:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567385:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd3c4df7/0x3e357265691c57c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567400:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497482.567404:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567411:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567414:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567422:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567432:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567440:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000083611d0/0x3e357265691c583 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567465:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.567469:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567476:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.567480:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567487:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567499:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567506:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f05bcca/0x3e357265691c58a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.567519:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.567521:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.567523:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.567534:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.567541:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.567564:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1777497482.567752:0:25492:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:0.0:1777497482.567862:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:83654:x1863837564869888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 27678us (28238us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497482.567873:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5843 00000100:00100000:2.0:1777497482.567932:0:83654:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83654:1863837564869888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1777497482.567949:0:83654:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x2e1:0x0] from OST, last_created [0x280000401:0x2e1:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:2.0:1777497482.568043:0:83654:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83654:1863837564870272:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777497482.568091:0:83654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.568136:0:83654:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497482.568158:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870272 00000100:00100000:2.0:1777497482.568164:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870272 00000100:00100000:2.0:1777497482.568201:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5845 00000100:00100000:2.0:1777497482.568211:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:83654:x1863837564870272:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1777497482.568251:0:25499:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 738 00000100:00100000:2.0:1777497482.569670:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+6:83654:x1863837564870272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1455us (1574us total) trans 4294969452 rc 0/0 00000100:00100000:2.0:1777497482.569679:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5845 00000100:00100000:2.0:1777497482.569745:0:83654:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:83654:1863837564870272:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1777497482.570119:0:83654:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x2e1:0x0]-[0x280000401:0x301:0x0] 00002000:00010000:2.0:1777497482.570177:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.570186:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570203:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570205:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570210:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570225:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570235:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570249:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570266:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497482.570278:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.570283:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570291:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.570296:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570304:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570319:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570326:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aba773b/0x3e357265691c591 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570345:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570347:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570348:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497482.570597:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.570608:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570617:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570619:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570622:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570631:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570638:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570645:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570657:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497482.570664:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.570669:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570675:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.570678:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570685:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570706:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570713:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ba4cd4b/0x3e357265691c598 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570735:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570737:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570739:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497482.570787:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2df:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.570793:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570799:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570801:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.570804:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570812:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570820:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570827:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570849:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497482.570858:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.570862:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570870:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34c00 already unused, calling callback (ffffffffc0d802e0) 00000100:00100000:0.0:1777497482.570870:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564870144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777497482.570874:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570884:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570895:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570902:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691c59f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.570914:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570916:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.570917:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497482.570937:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.570971:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870144 00000100:00100000:2.0:1777497482.570980:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870144 00000100:00100000:2.0:1777497482.571026:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1777497482.571037:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564870144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497482.571064:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497482.571184:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564870144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497482.571191:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:0.0:1777497482.571211:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564870144:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1777497482.571235:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2de:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.571241:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571250:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571252:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571254:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571262:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571270:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571276:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571302:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497482.571344:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.571349:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571367:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571369:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571372:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571381:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571389:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571395:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571409:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497482.571416:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497482.571419:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571426:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.571428:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571436:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571441:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.571448:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571458:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571474:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.571476:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000758c30f3/0x3e357265691c5a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571478:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571499:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571503:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.571506:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.571510:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.571516:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571525:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2400fdb/0x3e357265691c5ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.571545:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.571547:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.571549:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497482.571559:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2dc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497482.571565:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571573:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571574:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497482.571577:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571586:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571648:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571656:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571680:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497482.571688:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.571693:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571700:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.571703:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.571712:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497482.572376:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2db:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.572383:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572394:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572395:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572398:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572408:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572422:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572429:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572451:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497482.572491:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2da:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.572496:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572504:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572505:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572508:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572517:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572525:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572532:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572618:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777497482.572667:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.572672:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572680:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572681:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572684:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572693:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572701:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572707:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572719:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1777497482.572736:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777497482.572740:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572746:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.572749:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572756:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572776:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572783:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dcdfe167/0x3e357265691c5bb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572799:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497482.572802:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572808:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.572812:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572820:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572830:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572837:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918b28e3/0x3e357265691c5c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572850:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.572853:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572866:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.572869:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572876:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572885:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572892:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f34bcc4/0x3e357265691c5c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572902:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.572904:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.572906:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.572949:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.572968:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572976:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572978:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.572982:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.572990:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573006:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573012:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573051:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.573058:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.573061:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573068:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.573071:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573079:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573147:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573155:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d54fefd/0x3e357265691c5d0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573169:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573176:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573178:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1777497482.573219:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1777497482.573275:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.573281:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573289:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573290:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573293:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573301:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573307:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573314:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573326:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.573333:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.573336:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573343:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.573346:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573361:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573371:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573377:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005947ac74/0x3e357265691c5d7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573390:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573392:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573393:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.573434:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.573439:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573447:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573448:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573451:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573458:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573464:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573480:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573491:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.573498:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.573501:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573507:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.573510:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573517:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573527:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573534:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f0c6353/0x3e357265691c5de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573548:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573550:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573551:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.573591:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.573603:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573611:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573613:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573616:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573625:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573632:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573639:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573651:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.573658:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.573662:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573668:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.573671:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573678:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573699:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573706:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9de5f75/0x3e357265691c5e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573733:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573736:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573738:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.573781:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.573787:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573794:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573796:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573799:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573808:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573815:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573822:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573846:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.573854:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.573857:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573863:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.573867:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573873:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573884:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573890:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f27f7b7/0x3e357265691c5ec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573903:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573905:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.573906:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.573948:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.573953:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573961:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573969:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.573973:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573982:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573990:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.573997:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574010:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574017:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574021:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574027:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574030:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574037:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574048:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574066:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a590f888/0x3e357265691c5f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574081:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574083:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574084:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.574151:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.574156:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574164:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574165:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574168:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574177:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574184:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574191:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574204:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574209:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574219:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574226:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574228:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574236:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574246:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574252:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc2b77c/0x3e357265691c5fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574265:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574267:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574268:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.574307:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.574312:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574320:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574322:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574324:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574344:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574353:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574360:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574372:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574379:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574382:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574388:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574391:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574399:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574410:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574418:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b906b8c3/0x3e357265691c601 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574438:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574439:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574441:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.574482:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2d0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.574487:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574495:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574497:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574499:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574506:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574513:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574518:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574530:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574536:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574539:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574556:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574560:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574567:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574577:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574583:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e8bc85e/0x3e357265691c608 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574596:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574598:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574599:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.574642:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.574647:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574655:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574657:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574659:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574668:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574683:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574690:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574702:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574709:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574712:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574718:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574735:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574744:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574755:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574762:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee594e97/0x3e357265691c60f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574776:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574783:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574785:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.574829:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ce:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.574834:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574842:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574844:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.574846:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574855:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574862:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574869:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574882:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.574888:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.574892:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574898:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.574901:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574920:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574932:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574940:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027f5756c/0x3e357265691c616 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.574954:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574955:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.574957:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.575001:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.575006:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575013:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575015:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575017:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575026:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575033:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575050:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575062:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.575069:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.575073:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575079:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.575082:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575089:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575120:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575127:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a014a729/0x3e357265691c61d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575140:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575141:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575143:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.575182:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.575193:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575201:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575203:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575207:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575216:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575223:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575229:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575231:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575257:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007251ce6d/0x3e357265691c5b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575263:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.575271:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497482.575275:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575281:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575283:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.575284:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.575289:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575290:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575299:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575312:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575325:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575332:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006a512e9/0x3e357265691c624 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575347:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575349:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.575351:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.575395:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2cb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.575401:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575408:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575410:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575412:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575421:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575428:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575436:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575470:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497482.575508:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ca:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.575513:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575521:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575522:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575525:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575534:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575542:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575549:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575561:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777497482.575596:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.575601:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575609:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575610:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.575621:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575629:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575635:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575642:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575654:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1777497482.575661:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777497482.575665:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575672:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497482.575675:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575683:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575693:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.575713:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2faae45/0x3e357265691c62b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575757:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497482.575763:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575781:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.575784:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575792:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575803:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.575810:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000514994fb/0x3e357265691c632 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ca:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.575998:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497482.576005:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.576012:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497482.576015:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.576024:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.576035:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497482.576053:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000639cdfc1/0x3e357265691c639 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497482.576788:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.577228:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.577232:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497482.577234:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1777497482.577320:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.577328:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577343:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577345:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577349:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577363:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577371:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577379:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577402:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497482.577435:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497482.577442:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497482.577445:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497482.577452:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497482.577456:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577462:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497482.577469:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577475:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577479:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577483:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497482.577491:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577494:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497482.577510:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf3092cb/0x3e357265691c640 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577513:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577528:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577573:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497482.577581:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1777497482.577629:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.577634:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577642:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577643:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577645:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577653:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577668:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577674:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577682:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497482.577735:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.577741:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577748:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577750:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577753:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577761:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577769:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577776:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577785:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777497482.577828:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.577832:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577840:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577842:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577845:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577854:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577862:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577868:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577876:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1777497482.577910:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.577914:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577922:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577924:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.577926:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577935:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577949:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577955:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.577964:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1777497482.578001:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2c2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497482.578005:0:25486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.578012:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.578014:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497482.578017:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.578025:0:25486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.578032:0:25486:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.578039:0:25486:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497482.578047:0:25486:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1777497482.580280:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777497482.580290:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580305:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.580311:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580321:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580344:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580365:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000915d36e6/0x3e357265691c64e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580385:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777497482.580390:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580396:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.580399:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580406:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580418:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580425:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bbede3d/0x3e357265691c655 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580437:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497482.580441:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580447:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.580456:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580463:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580472:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580479:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd8b3295/0x3e357265691c65c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580491:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497482.580494:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580501:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.580503:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580510:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580519:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580526:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d265c0b/0x3e357265691c663 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580544:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497482.580547:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580553:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.580556:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580563:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580572:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580579:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027a14585/0x3e357265691c66a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.580590:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.580592:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.580594:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584148:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584162:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.584177:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497482.584196:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.584208:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.584229:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.584236:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dca4d64e/0x3e357265691c647 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497482.584263:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584265:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584268:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584273:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497482.584274:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497482.589076:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497482.589083:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497482.589086:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.590419:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.590423:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497482.590426:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1777497482.591767:0:25486:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:0.0:1777497482.591875:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:83656:x1863837564870016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51611us (52148us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497482.591886:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5844 00000100:00100000:2.0:1777497482.592151:0:83656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83656:1863837564870016:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497482.592170:0:83656:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x2e1:0x0] from OST, last_created [0x2c0000401:0x2e1:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:2.0:1777497482.592253:0:83656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83656:1863837564870528:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777497482.592256:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564870400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497482.592291:0:83656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497482.592292:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497482.592313:0:83656:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497482.592332:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870528 00000100:00100000:3.0:1777497482.592338:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870528 00000100:00100000:3.0:1777497482.593678:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5846 00000100:00100000:3.0:1777497482.593694:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:83656:x1863837564870528:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777497482.593744:0:25490:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 738 00000100:00100000:3.0:1777497482.596283:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:83656:x1863837564870528:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2587us (3984us total) trans 4294969448 rc 0/0 00000100:00100000:3.0:1777497482.596294:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5846 00000100:00100000:3.0:1777497482.596340:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870400 00000100:00100000:3.0:1777497482.596348:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870400 00000100:00100000:3.0:1777497482.596405:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:3.0:1777497482.596415:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564870400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497482.596437:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497482.596471:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564870400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497482.596477:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:3.0:1777497482.596529:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564870400:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497482.596885:0:83656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:83656:1863837564870528:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497482.596900:0:83656:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x2e1:0x0]-[0x2c0000401:0x301:0x0] 00000020:00000004:3.0:1777497482.637767:0:83966:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777497482.638002:0:83966:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:0.0:1777497482.790482:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1777497483.093231:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497483.093273:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497483.093360:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279296 00000100:00100000:0.0:1777497483.093371:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279296 00000100:00100000:0.0:1777497483.093445:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1777497483.093455:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408c9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546279296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497483.093529:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408c9e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546279296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497483.093536:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:2.0:1777497483.094378:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279424 00000100:00100000:2.0:1777497483.094386:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279424 00000100:00100000:2.0:1777497483.094471:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1105 00000100:00100000:2.0:1777497483.094480:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546279424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497483.094584:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546279424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 106us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497483.094590:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1105 00010000:00010000:2.0:1777497483.426367:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1777497483.551146:0:84016:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1777497483.551380:0:84016:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1777497484.324578:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564870656:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497484.324677:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497484.324738:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497484.324745:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564870784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497484.324768:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497484.324933:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870656 00000100:00100000:3.0:1777497484.324942:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870656 00000100:00100000:3.0:1777497484.325019:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870784 00000100:00100000:3.0:1777497484.325023:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870784 00000100:00100000:3.0:1777497484.325047:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1777497484.325056:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564870656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497484.325086:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497484.325161:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564870656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497484.325198:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1777497484.325215:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:3.0:1777497484.325221:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564870784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497484.325239:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497484.325268:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564870784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 47us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497484.325273:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00080000:0.0:1777497484.325735:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497484.325739:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497484.325781:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564870784:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497484.325797:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564870656:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497484.450509:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497485.474388:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497485.779978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497485.789854:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279552 00000100:00100000:2.0:1777497485.789871:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279552 00000100:00100000:2.0:1777497485.790016:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1145 00000100:00100000:2.0:1777497485.790028:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546279552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497485.790049:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497485.791364:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35e00/0x3e357265691c671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c106 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791461:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791476:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791490:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497485.791545:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497485.791549:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497485.791589:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791640:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35e00/0x3e357265691c671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c106 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791659:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c106 expref: 7 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497485.791667:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497485.791670:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497485.791673:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35600, rc 0) 00000100:00100000:2.0:1777497485.791760:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66092:x1863837546279552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1734us (11790us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497485.791769:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1145 00000100:00080000:3.0:1777497485.794826:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497485.800943:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497485.801187:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279680 00000100:00100000:0.0:1777497485.801199:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279680 00000100:00100000:0.0:1777497485.801271:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1146 00000100:00100000:0.0:1777497485.801280:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66092:x1863837546279680:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497485.801335:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1777497485.801632:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66092:x1863837546279680:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 352us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497485.801640:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1146 00000100:00100000:2.0:1777497485.804065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497485.804332:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279808 00000100:00100000:0.0:1777497485.804344:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279808 00000100:00080000:3.0:1777497485.804482:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497485.805215:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1147 00000100:00100000:0.0:1777497485.805230:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546279808:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497485.805272:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497485.805347:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546279808:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 123us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497485.805354:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1147 00000100:00100000:1.0:1777497485.820133:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497485.820381:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546279936 00000100:00100000:0.0:1777497485.820475:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546279936 00000100:00100000:0.0:1777497485.820583:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5847 00000100:00100000:0.0:1777497485.820591:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2411:x1863837546279936:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:0.0:1777497485.820625:0:25494:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3615 last 0 00000020:00000080:0.0:1777497485.820656:0:25494:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691c67f 00002000:00100000:0.0:1777497485.820667:0:25494:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff9240bcc6c000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1777497485.820684:0:25494:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1777497485.820762:0:25494:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777497485.820793:0:25494:0:(import.c:65:import_set_state_nolock()) ffff92409f60d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497485.820866:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546279936:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 275us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497485.820883:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5847 00000100:00100000:2.0:1777497485.825356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497485.828341:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280064 00000100:00100000:3.0:1777497485.828357:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280064 00000100:00100000:3.0:1777497485.828595:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1992 00000100:00100000:3.0:1777497485.828607:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546280064:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497485.828636:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497485.828741:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546280064:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 135us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497485.828748:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1992 00000100:00100000:3.0:1777497485.833164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497485.833269:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280192 00000100:00100000:1.0:1777497485.833279:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280192 00000100:00100000:1.0:1777497485.833325:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5848 00000100:00100000:1.0:1777497485.833334:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2411:x1863837546280192:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:1.0:1777497485.833370:0:23437:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3615 last 0 00000020:00000080:1.0:1777497485.833399:0:23437:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691c686 00002000:00100000:1.0:1777497485.833412:0:23437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff9240849d2800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1777497485.833429:0:23437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1777497485.833492:0:23437:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1777497485.833521:0:23437:0:(import.c:65:import_set_state_nolock()) ffff9240849d7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497485.833587:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546280192:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 253us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497485.833594:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5848 00000100:00080000:0.0:1777497485.834309:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497485.836640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497485.836750:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280320 00000100:00100000:3.0:1777497485.836761:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280320 00000100:00100000:3.0:1777497485.836840:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1993 00000100:00100000:3.0:1777497485.836850:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546280320:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497485.836876:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497485.836956:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66092:x1863837546280320:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 108us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497485.836980:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1993 00000100:00080000:0.0:1777497485.837401:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777497486.499904:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497487.396034:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564870912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497487.396178:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497487.396280:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564870912 00000100:00100000:2.0:1777497487.396290:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564870912 00000100:00100000:2.0:1777497487.396348:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3876 00000100:00100000:2.0:1777497487.396357:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564870912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497487.396394:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497487.396440:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564870912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497487.396447:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3876 00000100:00100000:0.0:1777497487.396527:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564870912:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497487.397455:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564871296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.397498:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.397523:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564871808:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.397544:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.397557:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872320:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.397574:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.397594:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777497487.397600:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564871168:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.397618:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.397921:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564871040:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.397968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.398008:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564871552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.398029:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.398045:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564872064:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.398065:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.398082:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497487.398087:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564871424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.398136:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.398153:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564871936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.398171:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.398186:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564872448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.398203:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497487.398304:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871040 00000100:00100000:2.0:1777497487.398311:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871040 00000100:00100000:2.0:1777497487.398365:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1777497487.398373:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564871040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497487.398421:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564871040:12345-0@lo:400:kworker.0 Request processed in 48us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497487.398427:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1777497487.398495:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564871680:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.398524:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.398552:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872192:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.398576:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.398599:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871296 00000100:00100000:3.0:1777497487.398603:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871296 00000100:00100000:3.0:1777497487.398742:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871168 00000100:00100000:3.0:1777497487.398746:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871168 00000100:00100000:3.0:1777497487.398761:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871552 00000100:00100000:3.0:1777497487.398763:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871552 00000100:00100000:3.0:1777497487.398775:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872064 00000100:00100000:3.0:1777497487.398778:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872064 00000100:00100000:3.0:1777497487.398787:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871424 00000100:00100000:3.0:1777497487.398789:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871424 00000100:00100000:3.0:1777497487.398799:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872448 00000100:00100000:3.0:1777497487.398802:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872448 00000100:00100000:3.0:1777497487.398824:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1777497487.398830:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564871296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.398869:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564871296:12345-0@lo:400:kworker.0 Request processed in 39us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.398875:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1777497487.398887:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1777497487.398893:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564871168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.398921:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564871168:12345-0@lo:400:kworker.0 Request processed in 28us (1301us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.398927:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1777497487.398937:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1777497487.398942:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564871552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.398967:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564871552:12345-0@lo:400:kworker.0 Request processed in 25us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.398972:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1777497487.398983:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1777497487.398988:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564872064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399011:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564872064:12345-0@lo:400:kworker.0 Request processed in 23us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399015:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1777497487.399026:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1777497487.399031:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564871424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399053:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564871424:12345-0@lo:400:kworker.0 Request processed in 22us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399058:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1777497487.399076:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1777497487.399081:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564872448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399137:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564872448:12345-0@lo:400:kworker.0 Request processed in 55us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399142:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1777497487.399162:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871808 00000100:00100000:3.0:1777497487.399166:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871808 00000100:00100000:3.0:1777497487.399187:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872320 00000100:00100000:3.0:1777497487.399190:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872320 00000100:00100000:3.0:1777497487.399210:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871936 00000100:00100000:3.0:1777497487.399212:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871936 00000100:00100000:3.0:1777497487.399228:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872192 00000100:00100000:3.0:1777497487.399231:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872192 00000100:00100000:3.0:1777497487.399247:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1777497487.399253:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564871808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399283:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564871808:12345-0@lo:400:kworker.0 Request processed in 30us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399289:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:3.0:1777497487.399299:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:3.0:1777497487.399305:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399329:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872320:12345-0@lo:400:kworker.0 Request processed in 25us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399334:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:3.0:1777497487.399343:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1777497487.399348:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564871936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399373:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564871936:12345-0@lo:400:kworker.0 Request processed in 25us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399387:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:3.0:1777497487.399397:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:3.0:1777497487.399403:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.399430:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872192:12345-0@lo:400:kworker.0 Request processed in 27us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.399435:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00080000:3.0:1777497487.399473:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497487.399476:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497487.399479:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497487.399481:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497487.399790:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564871680 00000100:00100000:2.0:1777497487.399795:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564871680 00000100:00100000:2.0:1777497487.399823:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3877 00000100:00100000:2.0:1777497487.399829:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564871680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497487.399864:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564871680:12345-0@lo:400:kworker.0 Request processed in 36us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497487.399870:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3877 00000100:00100000:1.0:1777497487.400826:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564871424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.400840:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564871936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.400853:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564872448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.400862:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564871040:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.400874:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564871552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497487.400885:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564872064:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405882:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564871168:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405926:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564871680:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405941:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872192:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405953:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564871296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405964:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564871808:0@lo:400:kworker.0 00000100:00100000:3.0:1777497487.405976:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872320:0@lo:400:kworker.0 00010000:00010000:1.0:1777497487.533665:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497487.906306:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497487.906328:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564872576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497487.906358:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497487.906367:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497487.908113:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497487.908140:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564872832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497487.908243:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497487.909811:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872704 00000100:00100000:1.0:1777497487.909825:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872704 00000100:00100000:1.0:1777497487.909892:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:1.0:1777497487.909902:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497487.909946:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497487.910012:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564872704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497487.910019:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1777497487.910315:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564872704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497487.916213:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497487.919150:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872576 00000100:00100000:3.0:1777497487.919168:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872576 00000100:00100000:3.0:1777497487.919262:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:3.0:1777497487.919286:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564872576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497487.919321:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497487.919414:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564872576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497487.919421:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:1.0:1777497487.919735:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564872576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497487.927389:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497487.929741:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872832 00000100:00100000:2.0:1777497487.929753:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872832 00000100:00100000:2.0:1777497487.929822:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3878 00000100:00100000:2.0:1777497487.929831:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564872832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497487.929874:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1777497487.929954:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564872832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (2571us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497487.929961:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3878 00000100:00100000:3.0:1777497487.930087:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564872832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497488.197976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497488.198028:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497488.198064:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497488.198137:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497488.198168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497488.198200:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280704 00000100:00100000:3.0:1777497488.198212:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280704 00000100:00100000:3.0:1777497488.198267:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280576 00000100:00100000:3.0:1777497488.198270:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280576 00000100:00100000:3.0:1777497488.198292:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1112 00000100:00100000:3.0:1777497488.198302:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497488.198381:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 80us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497488.198388:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1112 00000100:00100000:3.0:1777497488.198403:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1113 00000100:00100000:3.0:1777497488.198409:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546280576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497488.198431:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546280576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497488.198437:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1113 00000100:00080000:3.0:1777497488.198466:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497488.198470:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497488.198904:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280960 00000100:00100000:0.0:1777497488.198909:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280960 00000100:00100000:0.0:1777497488.198951:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280832 00000100:00100000:0.0:1777497488.198954:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280832 00000100:00100000:0.0:1777497488.198975:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2429 00000100:00100000:0.0:1777497488.198981:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280960:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497488.199011:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2430 00000100:00100000:0.0:1777497488.199014:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497488.199019:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497488.199019:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2429 00000100:00080000:0.0:1777497488.199056:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497488.199059:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497488.199132:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546280448 00000100:00100000:1.0:1777497488.199136:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546280448 00000100:00100000:1.0:1777497488.199179:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:1.0:1777497488.199186:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546280448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497488.199307:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546280832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 288us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497488.199324:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2430 00000100:00100000:1.0:1777497488.205614:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546280448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 6416us (7634us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497488.206005:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000001:00100000:0.0:1777497488.434650:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:0.0:1777497488.434684:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969452 is committed 00000001:00100000:0.0:1777497488.442376:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:0.0:1777497488.442391:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969448 is committed 00010000:00010000:2.0:1777497488.546412:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497489.442493:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564872960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497489.442569:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497489.442689:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564872960 00000100:00100000:3.0:1777497489.442697:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564872960 00000100:00100000:3.0:1777497489.442763:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:3.0:1777497489.442773:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564872960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497489.442800:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497489.442854:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564872960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497489.442860:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00080000:1.0:1777497489.442933:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497489.442972:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564872960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497489.443665:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497489.443677:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564873088:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497489.443710:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497489.445169:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873088 00000100:00100000:3.0:1777497489.445182:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873088 00000100:00100000:3.0:1777497489.445258:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:3.0:1777497489.445269:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564873088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497489.445291:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497489.445371:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564873088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497489.445377:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:2.0:1777497489.445486:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564873088:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497489.445612:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497489.570350:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497490.599924:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497490.808898:0:84113:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:3.0:1777497491.621008:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497492.514601:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564873344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.514678:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.514728:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564873856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.514778:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.514811:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564874368:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.514847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.514872:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1777497492.514879:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564873216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.514919:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.514946:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564873728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.514967:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.514985:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564874240:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515005:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515022:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564874752:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515039:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515062:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564873472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515084:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515131:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564873984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515176:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515195:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564874496:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515215:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515230:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1777497492.515236:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564873600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515257:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515274:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564874112:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515290:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515321:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564874624:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515349:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497492.515379:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873344 00000100:00100000:1.0:1777497492.515387:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873344 00000100:00100000:1.0:1777497492.515429:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873728 00000100:00100000:1.0:1777497492.515432:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873728 00000100:00100000:1.0:1777497492.515445:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874240 00000100:00100000:1.0:1777497492.515447:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874240 00000100:00100000:1.0:1777497492.515457:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874752 00000100:00100000:1.0:1777497492.515459:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874752 00000100:00100000:1.0:1777497492.515469:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873472 00000100:00100000:1.0:1777497492.515471:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873472 00000100:00100000:1.0:1777497492.515481:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873600 00000100:00100000:1.0:1777497492.515482:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873600 00000100:00100000:1.0:1777497492.515496:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1777497492.515504:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564873344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515559:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564873344:12345-0@lo:400:kworker.0 Request processed in 55us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515565:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:1.0:1777497492.515584:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1777497492.515591:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564873728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515618:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564873728:12345-0@lo:400:kworker.0 Request processed in 28us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515624:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1777497492.515648:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1777497492.515653:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564874240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515677:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564874240:12345-0@lo:400:kworker.0 Request processed in 25us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515683:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1777497492.515703:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1777497492.515708:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564874752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515735:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564874752:12345-0@lo:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515740:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1777497492.515751:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1777497492.515758:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564873472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515786:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564873472:12345-0@lo:400:kworker.0 Request processed in 29us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515791:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1777497492.515802:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1777497492.515807:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564873600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515832:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564873600:12345-0@lo:400:kworker.0 Request processed in 24us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515837:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1777497492.515855:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873856 00000100:00100000:1.0:1777497492.515859:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873856 00000100:00100000:1.0:1777497492.515883:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874368 00000100:00100000:1.0:1777497492.515886:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874368 00000100:00100000:1.0:1777497492.515901:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1777497492.515906:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564873856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515936:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564873856:12345-0@lo:400:kworker.0 Request processed in 30us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.515942:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3879 00000100:00100000:1.0:1777497492.515953:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1777497492.515957:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564874368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.515995:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564874368:12345-0@lo:400:kworker.0 Request processed in 37us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516000:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3880 00000100:00100000:1.0:1777497492.516022:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873216 00000100:00100000:1.0:1777497492.516025:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873216 00000100:00100000:1.0:1777497492.516048:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1777497492.516054:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564873216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516080:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564873216:12345-0@lo:400:kworker.0 Request processed in 27us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516085:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1777497492.516154:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564873984 00000100:00100000:1.0:1777497492.516158:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564873984 00000100:00100000:1.0:1777497492.516185:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874496 00000100:00100000:1.0:1777497492.516188:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874496 00000100:00100000:1.0:1777497492.516205:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874112 00000100:00100000:1.0:1777497492.516207:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874112 00000100:00100000:1.0:1777497492.516224:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874624 00000100:00100000:1.0:1777497492.516227:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874624 00000100:00100000:1.0:1777497492.516245:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1777497492.516251:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564873984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516279:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564873984:12345-0@lo:400:kworker.0 Request processed in 29us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516285:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1777497492.516295:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1777497492.516301:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564874496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516325:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564874496:12345-0@lo:400:kworker.0 Request processed in 25us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516340:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:1.0:1777497492.516351:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1777497492.516355:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564874112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516375:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564874112:12345-0@lo:400:kworker.0 Request processed in 21us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516378:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:1.0:1777497492.516384:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:1.0:1777497492.516387:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564874624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516402:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564874624:12345-0@lo:400:kworker.0 Request processed in 15us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497492.516405:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000100:00080000:1.0:1777497492.516414:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497492.516417:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497492.516419:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497492.516420:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497492.516446:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564873600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516453:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564874112:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516458:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 2 00000100:00100000:1.0:1777497492.516468:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564874624:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516474:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564873472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516479:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564873984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516483:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 2 00000100:00100000:1.0:1777497492.516488:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564874496:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516517:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564873216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516524:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564873728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516530:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564874240:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516536:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564874752:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516541:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564873344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516547:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564873856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497492.516552:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564874368:0@lo:400:kworker.0 00000100:00100000:0.0:1777497492.517877:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497492.517894:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564874880:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497492.517947:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497492.518024:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564874880 00000100:00100000:3.0:1777497492.518031:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564874880 00000100:00100000:3.0:1777497492.518077:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1777497492.518085:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564874880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497492.518149:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497492.518191:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564874880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497492.518196:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3881 00000100:00100000:3.0:1777497492.518236:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564874880:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1777497492.642683:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497493.000936:0:84162:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:1.0:1777497493.026434:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564875008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497493.026507:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497493.026591:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875008 00000100:00100000:3.0:1777497493.026598:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875008 00000100:00100000:3.0:1777497493.026665:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1777497493.026675:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564875008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497493.026702:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497493.036435:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564875008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9752us (9918us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497493.036450:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1777497493.036540:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564875136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497493.036598:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497493.036651:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875136 00000100:00100000:3.0:1777497493.036658:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875136 00000100:00100000:3.0:1777497493.036698:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:3.0:1777497493.036706:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564875136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497493.036734:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497493.036771:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564875136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497493.036776:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:3.0:1777497493.036826:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564875136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497493.042746:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497493.042775:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564875264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497493.042847:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497493.042905:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875264 00000100:00100000:2.0:1777497493.042912:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875264 00000100:00100000:2.0:1777497493.042959:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1777497493.042968:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564875264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497493.043013:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:2.0:1777497493.043056:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564875264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497493.043073:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3882 00000100:00100000:2.0:1777497493.043135:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564875264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497493.043517:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564875008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497493.313634:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497493.313680:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497493.313713:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497493.313747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497493.313775:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497493.313803:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281344 00000100:00100000:3.0:1777497493.313826:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281344 00000100:00100000:3.0:1777497493.313889:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281216 00000100:00100000:3.0:1777497493.313892:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281216 00000100:00100000:3.0:1777497493.313919:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1120 00000100:00100000:3.0:1777497493.313929:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546281344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497493.313999:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546281344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 72us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497493.314006:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1120 00000100:00100000:3.0:1777497493.314022:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1121 00000100:00100000:3.0:1777497493.314027:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546281216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497493.314049:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546281216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 22us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497493.314053:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1121 00000100:00100000:0.0:1777497493.314225:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281088 00000100:00100000:0.0:1777497493.314229:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281088 00000100:00100000:0.0:1777497493.314259:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1777497493.314265:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546281088:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497493.314289:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546281088:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497493.314294:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00080000:0.0:1777497493.314341:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497493.314344:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497493.314353:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281600 00000100:00100000:0.0:1777497493.314356:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281600 00000100:00100000:0.0:1777497493.314379:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281472 00000100:00100000:0.0:1777497493.314381:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281472 00000100:00100000:0.0:1777497493.314399:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2435 00000100:00100000:0.0:1777497493.314404:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546281600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497493.314427:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546281600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497493.314432:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2435 00000100:00100000:0.0:1777497493.314440:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2436 00000100:00100000:0.0:1777497493.314445:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546281472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497493.314463:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546281472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 18us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497493.314467:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2436 00000100:00080000:0.0:1777497493.314481:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497493.314483:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497493.666396:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497494.562695:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497494.562721:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564875392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497494.562796:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497494.563003:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564875520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497494.563046:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497494.563236:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875392 00000100:00100000:2.0:1777497494.563244:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875392 00000100:00100000:2.0:1777497494.563307:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875520 00000100:00100000:2.0:1777497494.563311:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875520 00000100:00100000:2.0:1777497494.563330:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1777497494.563339:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564875392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497494.563361:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497494.563410:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564875392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497494.563418:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:1.0:1777497494.563662:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:1.0:1777497494.563672:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564875520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497494.563683:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497494.563717:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564875520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497494.563723:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:1.0:1777497494.563767:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564875392:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777497494.563833:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497494.563837:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497494.563858:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564875520:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497494.690456:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497495.410132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497495.410275:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281728 00000100:00100000:1.0:1777497495.410295:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281728 00000100:00100000:1.0:1777497495.410416:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1148 00000100:00100000:1.0:1777497495.410425:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66539:x1863837546281728:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:1.0:1777497495.410467:0:73210:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:1.0:1777497495.410558:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66539:x1863837546281728:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 134us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497495.410573:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1148 00000100:00100000:3.0:1777497495.415020:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497495.415354:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281856 00000100:00100000:1.0:1777497495.415363:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281856 00000100:00080000:0.0:1777497495.415455:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497495.415459:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497495.416343:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1149 00000100:00100000:1.0:1777497495.416356:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66539:x1863837546281856:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:1.0:1777497495.416395:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497495.416472:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:66539:x1863837546281856:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 119us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497495.416479:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1149 00000100:00100000:3.0:1777497495.420321:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497495.420438:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546281984 00000100:00100000:2.0:1777497495.420448:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546281984 00000100:00100000:2.0:1777497495.420516:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2002 00000100:00100000:2.0:1777497495.420526:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:66539:x1863837546281984:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497495.420574:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497495.420645:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:66539:x1863837546281984:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497495.420652:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2002 00000100:00080000:3.0:1777497495.421251:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497495.424737:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497495.425731:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546282112 00000100:00100000:3.0:1777497495.425744:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546282112 00000100:00100000:3.0:1777497495.425817:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2003 00000100:00100000:3.0:1777497495.425828:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:66539:x1863837546282112:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497495.425863:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497495.425940:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:66539:x1863837546282112:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 114us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497495.425947:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2003 00000100:00080000:3.0:1777497495.425986:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497495.485344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497495.492157:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546282240 00000100:00100000:1.0:1777497495.492173:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546282240 00000100:00100000:1.0:1777497495.492238:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1150 00000100:00100000:1.0:1777497495.492248:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+7:66556:x1863837546282240:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497495.492270:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497495.492293:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691c68d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c10d expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492358:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492373:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492398:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492413:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492419:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492424:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492504:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492513:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.492520:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497495.493065:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1777497495.493071:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497495.493211:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493225:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493231:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493247:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493252:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493258:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497495.493262:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493268:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493280:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497495.493282:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497495.493286:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493292:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493305:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493311:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493315:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493320:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497495.493328:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493334:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493341:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xef7738bc (ffff9240a3b5d300) 00010000:00010000:1.0:1777497495.493343:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497495.493345:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493350:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c69b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xef7738bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493383:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691c68d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c10d expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493394:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c10d expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.493401:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5d700) 00010000:00010000:1.0:1777497495.493403:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497495.493404:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39c00, rc 0) 00000100:00100000:2.0:1777497495.502328:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:66556:x1863837546282240:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 10068us (16980us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497495.502342:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1150 00000100:00100000:3.0:1777497495.518175:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497495.519130:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546282496 00000100:00100000:1.0:1777497495.519141:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546282496 00000100:00100000:1.0:1777497495.519209:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1151 00000100:00100000:1.0:1777497495.519218:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:66556:x1863837546282496:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497495.519240:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497495.519262:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691c6a9 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c114 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519358:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519372:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519382:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519396:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519402:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519408:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519476:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519483:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 2/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519489:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519494:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497495.519498:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519515:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519534:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5d700) 00010000:00010000:1.0:1777497495.519537:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497495.519542:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519547:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691c6b0 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519571:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519576:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519581:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519585:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497495.519587:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519592:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519598:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9240a3b5d300) 00010000:00010000:1.0:1777497495.519610:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497495.519612:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519627:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691c6b7 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519661:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691c6a9 lrc: 1/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c114 expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519671:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5d700) 00010000:00010000:1.0:1777497495.519673:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497495.519676:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691c6a9 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c114 expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497495.519685:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38200, rc 0) 00000100:00100000:1.0:1777497495.519760:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:66556:x1863837546282496:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 543us (1595us total) trans 0 rc 301/301 00000100:00100000:1.0:1777497495.519768:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1151 00000100:00100000:3.0:1777497495.527214:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497495.527329:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546282752 00000100:00100000:0.0:1777497495.527341:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546282752 00000100:00100000:0.0:1777497495.527406:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1152 00000100:00100000:0.0:1777497495.527417:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:66556:x1863837546282752:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497495.527439:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497495.527459:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c11b expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497495.527612:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1777497495.527757:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6be lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c11b expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.527777:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497495.527781:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497495.527786:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c11b expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.527802:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9e00, rc 0) 00000100:00100000:0.0:1777497495.527866:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:66556:x1863837546282752:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 451us (663us total) trans 103079215105 rc 301/301 00000100:00100000:0.0:1777497495.527875:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1152 00000100:00100000:3.0:1777497495.533990:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497495.534353:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546282880 00000100:00100000:0.0:1777497495.534364:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546282880 00000100:00100000:0.0:1777497495.535854:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1153 00000100:00100000:0.0:1777497495.535873:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:66556:x1863837546282880:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:0.0:1777497495.535953:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 3/1,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.535971:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.535983:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 3/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.535998:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536005:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536011:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536089:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536129:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536136:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497495.536175:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497495.536203:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536219:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536225:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 4/1,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536232:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536238:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536244:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497495.536249:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 4/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536257:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 5/0,0 mode: CR/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536268:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0x0 (ffff9240a3b5d700) 00010000:00010000:0.0:1777497495.536272:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497495.536276:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 3/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536284:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6cc lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536298:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536304:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536315:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536320:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497495.536323:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536328:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536336:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x3:0x0].0xfa0fa5c1 (ffff9240885eba00) 00010000:00010000:0.0:1777497495.536339:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497495.536341:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536346:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6d3 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0xfa0fa5c1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536360:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536365:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536370:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536375:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497495.536377:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536399:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536409:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x5:0x0].0x0 (ffff9240885ebc00) 00010000:00010000:0.0:1777497495.536411:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497495.536413:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497495.536418:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691c6da lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497495.536509:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:66556:x1863837546282880:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 643us (2529us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497495.536517:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1153 00000100:00100000:3.0:1777497495.540721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497495.540923:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283136 00000100:00100000:1.0:1777497495.540936:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283136 00000100:00100000:1.0:1777497495.541018:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 223 00000100:00100000:1.0:1777497495.541029:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:66556:x1863837546283136:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1777497495.541299:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:66556:x1863837546283136:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 271us (588us total) trans 103079215106 rc 0/0 00000100:00100000:1.0:1777497495.541306:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 223 00010000:00010000:2.0:1777497495.717665:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497496.738819:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497497.635719:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497497.635741:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564875648:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497497.635809:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497497.636062:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875648 00000100:00100000:3.0:1777497497.636069:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875648 00000100:00100000:3.0:1777497497.636184:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3883 00000100:00100000:3.0:1777497497.636195:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564875648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497497.636227:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497497.636269:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564875648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497497.636276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3883 00000100:00100000:2.0:1777497497.636961:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564875904:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.636997:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637027:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564876416:0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.637041:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875904 00000100:00100000:1.0:1777497497.637047:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875904 00000100:00100000:2.0:1777497497.637053:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637073:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564876928:0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.637119:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1777497497.637129:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564875904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637132:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637155:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1777497497.637163:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564875776:0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.637181:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564875904:12345-0@lo:400:kworker.0 Request processed in 54us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497497.637189:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1777497497.637199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497497.637210:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497497.637237:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564876288:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637258:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637283:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564876800:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637331:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637363:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564875904:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637392:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876416 00000100:00100000:2.0:1777497497.637395:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876416 00000100:00100000:2.0:1777497497.637422:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3884 00000100:00100000:2.0:1777497497.637428:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637463:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564876416:12345-0@lo:400:kworker.0 Request processed in 35us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497497.637468:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3884 00000100:00100000:1.0:1777497497.637485:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876288 00000100:00100000:1.0:1777497497.637491:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876288 00000100:00100000:2.0:1777497497.637496:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564876160:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637536:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.637557:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564876672:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.637595:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497497.637613:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876928 00000100:00100000:3.0:1777497497.637618:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876928 00000100:00100000:2.0:1777497497.637618:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564877184:0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.637654:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876672 00000100:00100000:3.0:1777497497.637657:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876672 00000100:00100000:2.0:1777497497.637658:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497497.637688:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1777497497.637696:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564876928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.637730:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564876928:12345-0@lo:400:kworker.0 Request processed in 36us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497497.637736:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:3.0:1777497497.637748:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:3.0:1777497497.637754:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564876672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.637781:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564876672:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497497.637786:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:3.0:1777497497.637849:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564876032:0@lo:400:kworker.0 00000100:00100000:0.0:1777497497.642994:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564875776 00000100:00100000:0.0:1777497497.643010:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564875776 00000100:00100000:0.0:1777497497.643065:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1777497497.643076:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564875776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497497.643177:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564875776:12345-0@lo:400:kworker.0 Request processed in 103us (5978us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497497.643184:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1777497497.644970:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876800 00000100:00100000:1.0:1777497497.644982:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876800 00000100:00100000:1.0:1777497497.645036:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876160 00000100:00100000:1.0:1777497497.645039:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876160 00000100:00100000:1.0:1777497497.645067:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1777497497.645075:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564876288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.645160:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564876288:12345-0@lo:400:kworker.0 Request processed in 86us (7901us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497497.645167:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1777497497.645183:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1777497497.645188:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564876800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.645213:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564876800:12345-0@lo:400:kworker.0 Request processed in 25us (7882us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497497.645218:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1777497497.645228:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1777497497.645233:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564876160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.645256:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564876160:12345-0@lo:400:kworker.0 Request processed in 23us (7720us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497497.645261:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:1.0:1777497497.645283:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497497.645288:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497497.645299:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497497.645302:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497497.649426:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564876160:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.649444:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564876672:0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.649495:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877184 00000100:00100000:2.0:1777497497.649500:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497497.649504:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877184 00000100:00100000:1.0:1777497497.649645:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876032 00000100:00100000:1.0:1777497497.649649:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876032 00000100:00100000:1.0:1777497497.649679:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1777497497.649689:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564877184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.649699:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564876544:0@lo:400:kworker.0 00000100:00100000:0.0:1777497497.649842:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1777497497.649852:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564876032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.651181:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564875776:0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.651198:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564876288:0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.651209:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564876800:0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.651219:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564876416:0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.651229:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564876928:0@lo:400:kworker.0 00000100:00100000:1.0:1777497497.661141:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564877184:12345-0@lo:400:kworker.0 Request processed in 11445us (23473us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497497.661154:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:1.0:1777497497.661199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497497.661707:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564877184:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.661815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.661861:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564877056:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.661902:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497497.661949:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564875648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497497.662738:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564876544 00000100:00100000:3.0:1777497497.662746:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564876544 00000100:00100000:3.0:1777497497.662867:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877056 00000100:00100000:3.0:1777497497.662872:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877056 00000100:00100000:3.0:1777497497.662900:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1777497497.662909:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564876544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.662969:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564876544:12345-0@lo:400:kworker.0 Request processed in 60us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497497.662976:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:3.0:1777497497.662991:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:3.0:1777497497.662996:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564877056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497497.663026:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564877056:12345-0@lo:400:kworker.0 Request processed in 30us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497497.663032:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:2.0:1777497497.663904:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564876544:0@lo:400:kworker.0 00000100:00100000:2.0:1777497497.663918:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564877056:0@lo:400:kworker.0 00000100:00080000:1.0:1777497497.664134:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497497.664139:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497497.665201:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564876032:12345-0@lo:400:kworker.0 Request processed in 15346us (15698us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497497.665212:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:2.0:1777497497.666960:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564876032:0@lo:400:kworker.0 00010000:00010000:3.0:1777497497.762332:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497498.146457:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497498.146481:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564877312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497498.146550:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497498.146829:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877312 00000100:00100000:2.0:1777497498.146834:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564877440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497498.146849:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877312 00000100:00100000:2.0:1777497498.146857:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497498.146894:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:0.0:1777497498.146903:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564877312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497498.146930:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497498.146977:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564877312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497498.146983:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1777497498.147021:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877440 00000100:00100000:2.0:1777497498.147026:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877440 00000100:00100000:0.0:1777497498.147035:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564877312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497498.147057:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1777497498.147063:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564877440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497498.147080:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497498.147139:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564877440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497498.147145:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1777497498.147320:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564877440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497498.147451:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497498.147462:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564877568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497498.147502:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497498.148440:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877568 00000100:00100000:0.0:1777497498.148448:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877568 00000100:00100000:0.0:1777497498.148502:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3885 00000100:00100000:0.0:1777497498.148510:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564877568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497498.148541:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:0.0:1777497498.149391:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564877568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 878us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497498.149399:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3885 00000100:00100000:3.0:1777497498.149496:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564877568:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497498.433082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497498.433161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497498.433196:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497498.433230:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497498.433256:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497498.433325:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283264 00000100:00100000:0.0:1777497498.433335:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283264 00000100:00100000:0.0:1777497498.433398:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:0.0:1777497498.433406:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546283264:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497498.433474:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283520 00000100:00100000:0.0:1777497498.433474:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546283264:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497498.433478:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283520 00000100:00100000:0.0:1777497498.433482:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1777497498.433513:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283392 00000100:00100000:1.0:1777497498.433517:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283392 00000100:00080000:0.0:1777497498.433526:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497498.433529:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497498.433549:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1128 00000100:00100000:0.0:1777497498.433553:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283776 00000100:00100000:1.0:1777497498.433556:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546283520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497498.433568:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283776 00000100:00100000:1.0:1777497498.433598:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546283520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497498.433604:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1128 00000100:00100000:0.0:1777497498.433604:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283648 00000100:00100000:0.0:1777497498.433607:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283648 00000100:00100000:1.0:1777497498.433628:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1129 00000100:00100000:0.0:1777497498.433628:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2441 00000100:00100000:1.0:1777497498.433634:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2412:x1863837546283392:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497498.433634:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546283776:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497498.433659:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2412:x1863837546283392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497498.433659:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546283776:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497498.433665:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1129 00000100:00100000:0.0:1777497498.433665:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2441 00000100:00100000:0.0:1777497498.433676:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2442 00000100:00100000:0.0:1777497498.433681:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546283648:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:1.0:1777497498.433697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497498.433699:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497498.433705:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546283648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497498.433711:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2442 00010000:00010000:2.0:1777497498.787557:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497499.682389:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497499.682417:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564877696:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497499.682482:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497499.682530:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877696 00000100:00100000:2.0:1777497499.682538:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877696 00000100:00100000:2.0:1777497499.682603:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1777497499.682613:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564877696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497499.682644:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497499.682686:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564877696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497499.682693:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1777497499.682736:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564877696:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497499.682794:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497499.687026:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564877824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497499.687090:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497499.687155:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877824 00000100:00100000:0.0:1777497499.687162:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877824 00000100:00100000:0.0:1777497499.687208:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1777497499.687216:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564877824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497499.687243:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497499.687278:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564877824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497499.687285:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00080000:0.0:1777497499.687302:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497499.687335:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564877824:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497499.810379:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497500.834564:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777497501.736954:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215106 is committed 00010000:00010000:3.0:1777497501.858367:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497502.754482:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564878208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754608:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564878720:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754706:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754727:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564879232:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754764:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1777497502.754769:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564878080:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754792:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754814:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564878592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754831:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754843:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564879104:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754859:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754873:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564879616:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.754888:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497502.754928:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878208 00000100:00100000:1.0:1777497502.754935:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878208 00000100:00100000:1.0:1777497502.754982:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878592 00000100:00100000:1.0:1777497502.754985:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878592 00000100:00100000:1.0:1777497502.755002:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879104 00000100:00100000:1.0:1777497502.755005:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879104 00000100:00100000:1.0:1777497502.755014:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879616 00000100:00100000:1.0:1777497502.755016:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879616 00000100:00100000:1.0:1777497502.755028:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1777497502.755035:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564878208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755127:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564878208:12345-0@lo:400:kworker.0 Request processed in 59us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497502.755134:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1777497502.755150:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1777497502.755156:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564878592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755180:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564878592:12345-0@lo:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497502.755184:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1777497502.755193:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1777497502.755198:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564879104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755216:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564879104:12345-0@lo:400:kworker.0 Request processed in 19us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497502.755221:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1777497502.755230:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1777497502.755235:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564879616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755254:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564879616:12345-0@lo:400:kworker.0 Request processed in 20us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497502.755259:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:1.0:1777497502.755306:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564878592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755316:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564879104:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755324:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086433480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564879616:0@lo:400:kworker.0 00000100:00100000:1.0:1777497502.755331:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564878208:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755418:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564878336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755447:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755471:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564878848:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755496:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755514:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564879360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755544:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755562:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1777497502.755569:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564877952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497502.755590:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755607:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564878464:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755625:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755639:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564878976:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755659:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755672:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564879488:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755690:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497502.755712:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878848 00000100:00100000:3.0:1777497502.755715:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878848 00000100:00100000:3.0:1777497502.755750:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879360 00000100:00100000:3.0:1777497502.755753:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879360 00000100:00100000:3.0:1777497502.755766:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878976 00000100:00100000:3.0:1777497502.755768:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878976 00000100:00100000:3.0:1777497502.755782:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879488 00000100:00100000:3.0:1777497502.755784:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879488 00000100:00100000:3.0:1777497502.755801:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:3.0:1777497502.755807:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564878848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755839:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564878848:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.755845:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:3.0:1777497502.755856:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1777497502.755862:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564879360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755884:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564879360:12345-0@lo:400:kworker.0 Request processed in 22us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.755889:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000100:00100000:3.0:1777497502.755898:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1777497502.755903:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564878976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755924:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564878976:12345-0@lo:400:kworker.0 Request processed in 21us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.755930:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:3.0:1777497502.755938:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:3.0:1777497502.755944:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f81b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564879488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.755964:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f81b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564879488:12345-0@lo:400:kworker.0 Request processed in 21us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.755970:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00000100:00100000:3.0:1777497502.755986:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878720 00000100:00100000:3.0:1777497502.755995:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878720 00000100:00100000:3.0:1777497502.756015:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879232 00000100:00100000:3.0:1777497502.756017:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879232 00000100:00100000:3.0:1777497502.756026:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564877952 00000100:00100000:3.0:1777497502.756028:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564877952 00000100:00100000:3.0:1777497502.756037:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1777497502.756042:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564878720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756114:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564878720:12345-0@lo:400:kworker.0 Request processed in 50us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.756121:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3886 00000100:00100000:3.0:1777497502.756132:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1777497502.756138:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564879232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756162:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564879232:12345-0@lo:400:kworker.0 Request processed in 25us (1415us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.756168:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3887 00000100:00100000:3.0:1777497502.756177:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1777497502.756182:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564877952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497502.756205:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497502.756229:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564877952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.756235:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3888 00000100:00100000:3.0:1777497502.756255:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878336 00000100:00100000:3.0:1777497502.756258:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878336 00000100:00100000:3.0:1777497502.756281:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878464 00000100:00100000:3.0:1777497502.756283:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878464 00000100:00100000:3.0:1777497502.756298:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1777497502.756304:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564878336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756330:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564878336:12345-0@lo:400:kworker.0 Request processed in 27us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.756341:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1777497502.756360:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1777497502.756367:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564878464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756393:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564878464:12345-0@lo:400:kworker.0 Request processed in 27us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497502.756399:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:3.0:1777497502.756437:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564877952:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497502.756447:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564878464:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756456:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564878976:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756464:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564879488:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756473:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564878336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756481:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564878848:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756489:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564879360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756550:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564878720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497502.756559:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564879232:0@lo:400:kworker.0 00000100:00100000:0.0:1777497502.756742:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564878080 00000100:00100000:0.0:1777497502.756748:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564878080 00000100:00100000:0.0:1777497502.756787:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1777497502.756794:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564878080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497502.756832:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564878080:12345-0@lo:400:kworker.0 Request processed in 39us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497502.756837:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1777497502.756866:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497502.756870:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497502.756872:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497502.756873:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497502.756906:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564878080:0@lo:400:kworker.0 00010000:00010000:3.0:1777497502.882335:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497503.266434:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497503.266442:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564879744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497503.266450:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497503.266551:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497503.266561:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564880000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497503.271025:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497503.271113:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879872 00000100:00100000:2.0:1777497503.271124:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879872 00000100:00100000:2.0:1777497503.271187:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1777497503.271197:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564879872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497503.271233:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497503.271282:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564879872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497503.271289:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1777497503.271336:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564879872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497503.275991:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497503.277741:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497503.279035:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564879744 00000100:00100000:3.0:1777497503.279058:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564879744 00000100:00100000:3.0:1777497503.279310:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3889 00000100:00100000:3.0:1777497503.279321:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564879744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497503.279361:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1777497503.279508:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564879744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 189us (1770us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497503.279515:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3889 00000100:00100000:0.0:1777497503.281673:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880000 00000100:00100000:0.0:1777497503.281688:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880000 00000100:00100000:0.0:1777497503.281757:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1777497503.281768:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564880000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497503.281800:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497503.282690:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564880000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 922us (6702us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497503.282702:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:1.0:1777497503.284814:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564880000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497503.289204:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564879744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497503.550239:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497503.550333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497503.550361:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497503.550394:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497503.550419:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497503.550496:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284160 00000100:00100000:3.0:1777497503.550505:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284160 00000100:00100000:2.0:1777497503.550557:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284416 00000100:00100000:2.0:1777497503.550561:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284416 00000100:00100000:3.0:1777497503.550570:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284032 00000100:00100000:3.0:1777497503.550572:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284032 00000100:00100000:2.0:1777497503.550588:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284288 00000100:00100000:3.0:1777497503.550592:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1136 00000100:00100000:2.0:1777497503.550597:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284288 00000100:00100000:3.0:1777497503.550600:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546284160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497503.550618:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2447 00000100:00100000:2.0:1777497503.550623:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546284416:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:1.0:1777497503.552199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497503.552207:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497503.552210:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497503.552213:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497503.555031:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546284160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 4418us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497503.555060:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1136 00000100:00100000:3.0:1777497503.555119:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1137 00000100:00100000:3.0:1777497503.555138:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546284032:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497503.556813:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546284416:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 6179us (6441us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497503.556824:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2447 00000100:00100000:2.0:1777497503.556857:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2448 00000100:00100000:2.0:1777497503.556870:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546284288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497503.556937:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546284288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 72us (6515us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497503.556942:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2448 00000100:00100000:0.0:1777497503.563213:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546283904 00000100:00100000:0.0:1777497503.563228:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546283904 00000100:00100000:0.0:1777497503.563291:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:0.0:1777497503.563316:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546283904:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497503.563396:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546283904:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (13163us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497503.563403:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1777497503.564805:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546284032:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 9669us (14401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497503.564816:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1137 00010000:00010000:1.0:1777497503.910640:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497504.369680:0:84357:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 131a: DoM file write lock replay === 17:18:22 (1777497502) 00000100:00100000:1.0:1777497504.656007:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497504.656335:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284544 00000100:00100000:0.0:1777497504.656344:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284544 00000100:00100000:0.0:1777497504.656433:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1154 00000100:00100000:0.0:1777497504.656443:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67137:x1863837546284544:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497504.656464:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497504.656493:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c6e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c122 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656567:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656582:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656593:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656607:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656613:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656621:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656678:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656684:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656690:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656697:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656702:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497504.656706:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656712:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656722:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497504.656725:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497504.656728:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656734:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c6e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656745:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656750:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656761:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656766:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497504.656769:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656774:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656781:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9240885ebb00) 00010000:00010000:0.0:1777497504.656783:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497504.656785:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656790:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c6ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656817:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c6e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c122 expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656826:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497504.656828:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497504.656832:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c6e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c122 expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.656840:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9000, rc 0) 00000100:00100000:0.0:1777497504.656900:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67137:x1863837546284544:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 459us (903us total) trans 0 rc 301/301 00000100:00100000:0.0:1777497504.656916:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1154 00000100:00100000:0.0:1777497504.661970:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497504.662023:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546284800 00000100:00100000:3.0:1777497504.662056:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546284800 00000100:00100000:3.0:1777497504.662130:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1155 00000100:00100000:3.0:1777497504.662150:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67137:x1863837546284800:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497504.662172:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497504.662175:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1777497504.662208:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691c678 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c106 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662228:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:3.0:1777497504.662239:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497504.662255:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c6f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c129 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662352:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662365:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662375:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662387:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662394:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662401:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662768:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662777:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662785:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497504.662795:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00010000:00010000:3.0:1777497504.662814:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662822:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662829:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662836:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662842:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497504.662846:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662854:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662863:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408cba5600) 00010000:00010000:3.0:1777497504.662866:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497504.662875:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662882:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c6fd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497504.662893:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d18d73b0 reply state 00000000baa50097 transno 103079215107 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662905:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662911:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff92408cba5e00) 00010000:00010000:3.0:1777497504.662914:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497504.662916:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777497504.662938:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c6f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662953:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.662961:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff92408cba5700) 00010000:00010000:3.0:1777497504.662963:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497504.662966:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef200, rc 0) 00000100:00100000:3.0:1777497504.663037:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67137:x1863837546284800:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 898us (1077us total) trans 103079215107 rc 0/0 00000100:00100000:3.0:1777497504.663045:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1155 00000100:00100000:3.0:1777497504.672684:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497504.672742:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285056 00000100:00100000:0.0:1777497504.672754:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285056 00000100:00100000:0.0:1777497504.672818:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1156 00000100:00100000:0.0:1777497504.672828:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67137:x1863837546285056:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497504.672852:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497504.672874:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691c719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c130 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.672982:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.672998:0:63729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.673006:0:63729:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.673127:0:63729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497504.673139:0:63729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 11 pid: 63727 timeout: 3734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497504.673152:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63729:1863837564880128:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497504.673223:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661600 going to sleep for 11 seconds 00000100:00100000:0.0:1777497504.677378:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497504.677428:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:63729:1863837564880128:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497504.677455:0:63729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497504.677477:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285184 00000100:00100000:1.0:1777497504.677484:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285184 00010000:00010000:1.0:1777497504.677524:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 12 pid: 63727 timeout: 3734 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497504.677562:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2536 00000100:00100000:1.0:1777497504.677571:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2414:x1863837546285184:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497504.677588:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497504.677594:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 12 pid: 63727 timeout: 3734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677607:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 12 pid: 63727 timeout: 3734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677630:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691c70b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c129 expref: 12 pid: 63727 timeout: 3734 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677644:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff92408cba5700) 00010000:00010000:1.0:1777497504.677648:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677664:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677671:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497504.677697:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497504.677722:0:63729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677729:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497504.677746:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x6:0x0]: returning size 0 00000100:00100000:1.0:1777497504.677750:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2414:x1863837546285184:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 181us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497504.677757:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2536 00010000:00010000:3.0:1777497504.677944:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677952:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677958:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677963:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497504.677967:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677975:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677983:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff92408cba5700) 00010000:00010000:3.0:1777497504.677986:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777497504.677990:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.677995:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691c720 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.678064:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691c719 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c130 expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.678074:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885eb500) 00010000:00010000:3.0:1777497504.678077:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497504.678080:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691c719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c130 expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497504.678141:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8600, rc 0) 00000100:00100000:3.0:1777497504.678174:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67137:x1863837546285056:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5348us (5500us total) trans 103079215108 rc 301/301 00000100:00100000:3.0:1777497504.678182:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1156 00000100:00100000:0.0:1777497504.682835:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497504.682912:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285440 00000100:00100000:1.0:1777497504.682923:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285440 00000100:00100000:1.0:1777497504.682979:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:1.0:1777497504.682990:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67137:x1863837546285440:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1777497504.683250:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:67137:x1863837546285440:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 262us (424us total) trans 103079215109 rc 0/0 00000100:00100000:1.0:1777497504.683256:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 224 00000100:00100000:1.0:1777497504.694267:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497504.699701:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285696 00000100:00100000:3.0:1777497504.699716:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285696 00000100:00100000:3.0:1777497504.699783:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:3.0:1777497504.699794:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:67137:x1863837546285696:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:3.0:1777497504.700157:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+12:67137:x1863837546285696:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 364us (5901us total) trans 103079215110 rc 0/0 00000100:00100000:3.0:1777497504.700165:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 225 00000100:00100000:0.0:1777497504.802435:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564880256:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497504.802546:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497504.802652:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880256 00000100:00100000:2.0:1777497504.802659:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880256 00000100:00100000:2.0:1777497504.802724:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2010 00000100:00100000:2.0:1777497504.802736:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564880256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497504.802765:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497504.802808:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564880256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497504.802813:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2010 00000100:00100000:1.0:1777497504.803077:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564880384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497504.803141:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497504.803245:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880384 00000100:00100000:3.0:1777497504.803250:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880384 00000100:00100000:3.0:1777497504.803288:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1777497504.803295:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564880384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497504.803312:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497504.803354:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564880384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497504.803373:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00080000:0.0:1777497504.803675:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497504.803680:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497504.803718:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098828000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564880256:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497504.803915:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564880384:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497504.932777:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777497505.667295:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215110 is committed 00010000:00010000:1.0:1777497505.669589:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669607:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669629:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669636:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497505.669642:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669650:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669669:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff92408cba5e00) 00010000:00010000:1.0:1777497505.669672:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497505.669677:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.669684:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691c704 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497505.778561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497505.784003:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285824 00000100:00100000:1.0:1777497505.784019:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285824 00000100:00100000:1.0:1777497505.784122:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1157 00000100:00100000:1.0:1777497505.784133:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:67153:x1863837546285824:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497505.784159:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497505.784181:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c72e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c137 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784244:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784275:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784287:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497505.784331:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1777497505.784336:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497505.784356:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784379:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c72e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c137 expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784398:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c137 expref: 8 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497505.784407:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5d200) 00010000:00010000:1.0:1777497505.784410:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497505.784413:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38e00, rc 0) 00000100:00100000:1.0:1777497505.786588:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67153:x1863837546285824:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2446us (8024us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497505.786600:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1157 00000100:00080000:1.0:1777497505.786644:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497505.797427:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497505.797585:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546285952 00000100:00100000:3.0:1777497505.797606:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546285952 00000100:00100000:3.0:1777497505.797682:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1158 00000100:00100000:3.0:1777497505.797692:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67153:x1863837546285952:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497505.797734:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00000100:00100000:3.0:1777497505.797817:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67153:x1863837546285952:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 126us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497505.797824:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1158 00000100:00100000:2.0:1777497505.801163:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497505.801255:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286080 00000100:00100000:0.0:1777497505.801266:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286080 00000100:00100000:0.0:1777497505.801350:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1159 00000100:00100000:0.0:1777497505.801361:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67153:x1863837546286080:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497505.801404:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497505.801477:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67153:x1863837546286080:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 119us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497505.801485:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1159 00000100:00080000:2.0:1777497505.802673:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497505.805151:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497505.805235:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286208 00000100:00100000:2.0:1777497505.805245:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286208 00000100:00100000:2.0:1777497505.805319:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2012 00000100:00080000:3.0:1777497505.805326:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497505.805343:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:67153:x1863837546286208:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497505.805370:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497505.805434:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:67153:x1863837546286208:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497505.805442:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2012 00000100:00100000:2.0:1777497505.812495:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497505.816619:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286336 00000100:00100000:3.0:1777497505.816637:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286336 00000100:00100000:2.0:1777497505.818234:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2013 00000100:00100000:2.0:1777497505.818246:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:67153:x1863837546286336:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497505.818275:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497505.818345:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:67153:x1863837546286336:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 102us (5859us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497505.818351:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2013 00000100:00080000:1.0:1777497505.819490:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777497505.965188:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497506.011191:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497506.011314:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286592 00000100:00100000:1.0:1777497506.011324:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286592 00000100:00100000:1.0:1777497506.011383:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1160 00000100:00100000:1.0:1777497506.011404:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67160:x1863837546286592:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:1.0:1777497506.011476:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497506.011509:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c137 expref: 8 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011529:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5d200) 00010000:00010000:1.0:1777497506.011539:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497506.011602:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011617:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011626:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011639:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011646:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.011652:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.012398:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.012411:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.012418:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.012433:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497506.012438:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.012446:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.015520:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5d500) 00010000:00010000:1.0:1777497506.015529:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497506.015538:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.015548:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c73c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497506.015574:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003f3f28b3 reply state 000000005ae6d8b2 transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.017274:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497506.017294:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d100) 00010000:00010000:1.0:1777497506.017297:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497506.017302:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497506.017411:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+9:67160:x1863837546286592:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 6005us (6225us total) trans 103079215111 rc 0/0 00000100:00100000:1.0:1777497506.017421:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1160 00000100:00100000:2.0:1777497506.087581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497506.088373:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286720 00000100:00100000:3.0:1777497506.088385:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286720 00000100:00100000:3.0:1777497506.088480:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1161 00000100:00100000:3.0:1777497506.088492:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:67163:x1863837546286720:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1777497506.088529:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497506.088555:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c74a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c13e expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.088624:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.088639:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.088668:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497506.089038:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497506.089043:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497506.089069:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.089126:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c74a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c13e expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.089146:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c13e expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.089154:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408cba5700) 00010000:00010000:3.0:1777497506.089157:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497506.089161:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefc00, rc 0) 00000100:00100000:3.0:1777497506.089234:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67163:x1863837546286720:12345-192.168.202.4@tcp:101:rm.0 Request processed in 744us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497506.089241:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1161 00000100:00100000:0.0:1777497506.092974:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497506.093062:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286848 00000100:00100000:3.0:1777497506.093073:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286848 00000100:00100000:0.0:1777497506.093377:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1162 00000100:00100000:0.0:1777497506.093388:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67163:x1863837546286848:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1777497506.093411:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497506.093430:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691c758 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c145 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093512:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093534:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093545:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093557:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093564:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093571:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093643:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093650:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093657:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497506.093699:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x7:0x0]: returning size 0 00000004:00200000:0.0:1777497506.093703:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497506.093724:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093735:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093754:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093759:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093765:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093771:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093777:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497506.093781:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093789:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093800:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408cba5700) 00010000:00010000:0.0:1777497506.093803:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497506.093806:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093812:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691c75f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093825:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093830:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093841:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093846:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497506.093848:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093853:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093873:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d100) 00010000:00010000:0.0:1777497506.093876:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497506.093879:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093884:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691c766 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093912:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691c758 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c145 expref: 12 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093924:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c145 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.093930:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9240885eb800) 00010000:00010000:0.0:1777497506.093932:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497506.093934:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9400, rc 0) 00000100:00100000:0.0:1777497506.093995:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+11:67163:x1863837546286848:12345-192.168.202.4@tcp:101:rm.0 Request processed in 609us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497506.094010:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1162 00000100:00100000:0.0:1777497506.097597:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497506.098010:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287104 00000100:00100000:2.0:1777497506.098022:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287104 00000100:00100000:1.0:1777497506.098337:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1163 00000100:00100000:0.0:1777497506.098662:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:67163:x1863837546287104:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:0.0:1777497506.098794:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777497506.098822:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691c76d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c145 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.098840:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9240885eb800) 00010000:00010000:0.0:1777497506.098856:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c13e expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.098952:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92408cba5700) 00010000:00010000:0.0:1777497506.098959:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497506.098984:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.098998:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099008:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099020:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099027:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099034:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099310:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099320:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099327:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099527:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099537:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099546:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099553:0:73210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099560:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099567:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099619:0:73210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497506.099637:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099643:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099655:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099661:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497506.099665:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099672:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099691:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9240885ebc00) 00010000:00010000:0.0:1777497506.099695:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777497506.099698:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099704:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691c782 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099720:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099726:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099730:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099735:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497506.099737:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099752:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099760:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885ebf00) 00010000:00010000:0.0:1777497506.099762:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497506.099765:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099771:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691c774 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497506.099783:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000279a96de reply state 0000000008635bb5 transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099793:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497506.099799:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d100) 00010000:00010000:0.0:1777497506.099801:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497506.099804:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497506.099894:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:67163:x1863837546287104:12345-192.168.202.4@tcp:36:rm.0 Request processed in 1546us (2303us total) trans 103079215112 rc 0/0 00000100:00100000:0.0:1777497506.099902:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1163 00010000:00010000:3.0:1777497506.105652:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497506.105665:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.105689:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497506.105694:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.105722:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.105740:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9240885ebc00) 00010000:00010000:3.0:1777497506.105743:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777497506.105748:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 1/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497506.105754:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691c789 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x7:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497506.105849:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497506.105852:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497506.105854:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497506.981879:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497507.876179:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564880640:0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.876179:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564880896:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.876332:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564880768:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.876391:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564880512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.876451:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497507.876499:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564881152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.876525:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497507.876541:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564881664:0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.876556:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497507.876567:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497507.876586:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564881408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.876590:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564882176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497507.876624:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497507.876631:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497507.876648:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564881920:0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.876677:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497507.876686:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880640 00000100:00100000:2.0:1777497507.876695:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880640 00000100:00100000:1.0:1777497507.876718:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881408 00000100:00100000:1.0:1777497507.876723:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881408 00000100:00100000:2.0:1777497507.876757:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880896 00000100:00100000:2.0:1777497507.876760:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880896 00000100:00100000:2.0:1777497507.876786:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1777497507.876794:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564880640:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497507.876819:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b3100 x1863837564880640/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:263/0 lens 224/224 e 0 to 0 dl 1777497518 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497507.876857:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837564880640:12345-0@lo:400:kworker.0 Request processed in 64us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.876864:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1777497507.876881:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1777497507.876887:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564880896:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497507.876897:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086433480 x1863837564880896/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:263/0 lens 224/224 e 0 to 0 dl 1777497518 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497507.876925:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564880896:12345-0@lo:400:kworker.0 Request processed in 38us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.876931:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1777497507.876948:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881152 00000100:00100000:2.0:1777497507.876952:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881152 00000100:00100000:2.0:1777497507.876970:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881664 00000100:00100000:2.0:1777497507.876972:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881664 00000100:00100000:2.0:1777497507.876981:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882176 00000100:00100000:2.0:1777497507.876983:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882176 00000100:00100000:2.0:1777497507.876991:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1777497507.876995:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564881152:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497507.877019:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b2a00 x1863837564881152/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:263/0 lens 224/224 e 0 to 0 dl 1777497518 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497507.877045:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564881152:12345-0@lo:400:kworker.0 Request processed in 49us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.877051:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3890 00000100:00100000:2.0:1777497507.877062:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1777497507.877067:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564881664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.877136:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564881664:12345-0@lo:400:kworker.0 Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.877142:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3891 00000100:00100000:2.0:1777497507.877154:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1777497507.877160:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564882176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497507.877194:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497507.877230:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564882176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.877235:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3892 00000100:00100000:2.0:1777497507.877285:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564880640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.877297:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564881152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.877305:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564881664:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.877316:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564882176:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497507.877604:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881920 00000100:00100000:1.0:1777497507.877609:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881920 00000100:00100000:1.0:1777497507.877641:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1777497507.877648:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564881408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.877685:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564881408:12345-0@lo:400:kworker.0 Request processed in 38us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497507.877691:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2449 00000100:00100000:1.0:1777497507.877703:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2450 00000100:00100000:1.0:1777497507.877710:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564881920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.877736:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564881920:12345-0@lo:400:kworker.0 Request processed in 27us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497507.877742:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2450 00000100:00080000:1.0:1777497507.877873:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497507.877878:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497507.877905:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564880896:0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.877916:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564881408:0@lo:400:kworker.0 00000100:00100000:1.0:1777497507.877926:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564881920:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.879824:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497507.879875:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564881280:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.879911:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497507.879930:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564881792:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.879965:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497507.880030:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880768 00000100:00100000:0.0:1777497507.880036:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880768 00000100:00100000:0.0:1777497507.880082:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1777497507.880112:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564880768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.880164:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564880768:12345-0@lo:400:kworker.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497507.880172:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1777497507.880198:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881280 00000100:00100000:0.0:1777497507.880201:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881280 00000100:00100000:0.0:1777497507.880224:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881792 00000100:00100000:0.0:1777497507.880227:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881792 00000100:00100000:0.0:1777497507.880246:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1777497507.880252:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564881280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.880281:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564881280:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497507.880287:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2451 00000100:00100000:0.0:1777497507.880297:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1777497507.880302:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564881792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.880326:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564881792:12345-0@lo:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497507.880332:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2452 00000100:00100000:0.0:1777497507.880391:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564880768:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.880401:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564881280:0@lo:400:kworker.0 00000100:00100000:0.0:1777497507.880410:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564881792:0@lo:400:kworker.0 00000100:00080000:0.0:1777497507.880463:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497507.880468:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497507.882465:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497507.882560:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564881024:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.882597:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497507.882617:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564881536:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.882637:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497507.882655:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564882048:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.882674:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497507.882715:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881024 00000100:00100000:3.0:1777497507.882724:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881024 00000100:00100000:3.0:1777497507.882771:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564881536 00000100:00100000:3.0:1777497507.882774:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564881536 00000100:00100000:3.0:1777497507.882790:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882048 00000100:00100000:3.0:1777497507.882792:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882048 00000100:00100000:3.0:1777497507.882811:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1777497507.882819:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564881024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.882874:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564881024:12345-0@lo:400:kworker.0 Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497507.882881:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1777497507.882898:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1777497507.882903:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564881536:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497507.882916:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f84700e00 x1863837564881536/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:263/0 lens 224/224 e 0 to 0 dl 1777497518 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497507.882941:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564881536:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497507.882947:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1777497507.882958:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:3.0:1777497507.882964:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564882048:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497507.882973:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f84701500 x1863837564882048/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:263/0 lens 224/224 e 0 to 0 dl 1777497518 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497507.882996:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564882048:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497507.883002:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00080000:3.0:1777497507.883020:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497507.883059:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564881024:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.883068:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564881536:0@lo:400:kworker.0 00000100:00100000:3.0:1777497507.883076:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564882048:0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.887355:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564880512 00000100:00100000:2.0:1777497507.887367:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564880512 00000100:00100000:2.0:1777497507.887427:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1777497507.887437:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564880512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497507.887534:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564880512:12345-0@lo:400:kworker.0 Request processed in 99us (5076us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497507.887542:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1777497507.887594:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564880512:0@lo:400:kworker.0 00010000:00010000:0.0:1777497508.005638:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497508.386586:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497508.386612:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564882304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497508.386685:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497508.386757:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497508.386778:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564882432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497508.386811:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497508.391608:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882304 00000100:00100000:2.0:1777497508.391621:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882304 00000100:00100000:2.0:1777497508.391677:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2014 00000100:00100000:2.0:1777497508.391686:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564882304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497508.391721:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497508.391781:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564882304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (5098us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497508.391787:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2014 00000100:00100000:2.0:1777497508.391839:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564882304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497508.392769:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497508.392822:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497508.393139:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882560 00000100:00100000:2.0:1777497508.393145:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882560 00000100:00100000:2.0:1777497508.393187:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1777497508.393196:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497508.393221:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497508.393266:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497508.393273:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:2.0:1777497508.393314:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497508.400126:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882432 00000100:00100000:2.0:1777497508.400141:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882432 00000100:00100000:2.0:1777497508.400220:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3893 00000100:00100000:2.0:1777497508.400232:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564882432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497508.400276:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00010000:00000080:2.0:1777497508.400291:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086d09f80 x1863837564882432/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:264/0 lens 224/368 e 0 to 0 dl 1777497519 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497508.400360:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564882432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 133us (13549us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497508.400367:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3893 00000100:00100000:1.0:1777497508.400924:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564882432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497508.687086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497508.687147:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497508.687164:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497508.687181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497508.687199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497508.687554:0:83640:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287232 00000100:00100000:0.0:1777497508.687566:0:83640:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287232 00000100:00100000:0.0:1777497508.687622:0:83640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:0.0:1777497508.687631:0:83640:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546287232:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497508.687704:0:83640:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546287232:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497508.687711:0:83640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:0.0:1777497508.687744:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287744 00000100:00100000:0.0:1777497508.687747:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287744 00000100:00100000:0.0:1777497508.687781:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287616 00000100:00100000:0.0:1777497508.687784:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287616 00000100:00100000:0.0:1777497508.687803:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2453 00000100:00100000:0.0:1777497508.687809:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546287744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497508.687835:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546287744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497508.687840:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2453 00000100:00100000:0.0:1777497508.687851:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2454 00000100:00100000:0.0:1777497508.687856:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546287616:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497508.687878:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546287616:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 22us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497508.687883:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2454 00000100:00080000:0.0:1777497508.688012:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497508.688016:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497508.690373:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287360 00000100:00100000:3.0:1777497508.690387:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287360 00000100:00100000:3.0:1777497508.690706:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287488 00000100:00100000:3.0:1777497508.690711:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287488 00000100:00080000:0.0:1777497508.690769:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497508.690773:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497508.696683:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1144 00000100:00100000:2.0:1777497508.696708:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2415:x1863837546287360:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:2.0:1777497508.696750:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b0a80 x1863837546287360/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:264/0 lens 224/224 e 0 to 0 dl 1777497519 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497508.696836:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2415:x1863837546287360:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 142us (9761us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497508.696843:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1144 00000100:00100000:2.0:1777497508.696873:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1145 00000100:00100000:2.0:1777497508.696880:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546287488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497508.696904:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546287488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (9739us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497508.696927:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1145 00010000:00010000:0.0:1777497509.030150:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497509.923514:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564882688:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497509.923588:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497509.923927:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882688 00000100:00100000:1.0:1777497509.923934:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882688 00000100:00100000:1.0:1777497509.923989:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:1.0:1777497509.923998:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564882688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497509.924023:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497509.924063:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564882688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497509.924070:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00080000:0.0:1777497509.924147:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497509.924498:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564882688:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497509.924548:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497509.924558:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564882816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497509.924594:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497509.925406:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882816 00000100:00100000:2.0:1777497509.925412:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882816 00000100:00100000:2.0:1777497509.925479:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1777497509.925488:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564882816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497509.925511:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497509.925556:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564882816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497509.925563:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00080000:0.0:1777497509.925757:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497509.925789:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564882816:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497510.051643:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497511.075687:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1777497511.931641:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215112 is committed 00010000:00010000:3.0:1777497511.931717:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931733:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931741:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931748:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497511.931755:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931764:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931788:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d100) 00010000:00010000:3.0:1777497511.931792:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497511.931798:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931805:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c743 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931832:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931838:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931881:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931887:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497511.931890:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931897:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931906:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d100) 00010000:00010000:3.0:1777497511.931908:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497511.931912:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497511.931918:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691c77b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497512.099694:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497512.998134:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497512.998159:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564882944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497512.998251:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497512.998305:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564883328:0@lo:400:kworker.0 00000100:00100000:2.0:1777497512.998339:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497512.998365:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564883840:0@lo:400:kworker.0 00000100:00100000:1.0:1777497512.998387:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883328 00000100:00100000:2.0:1777497512.998394:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497512.998410:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883328 00000100:00100000:2.0:1777497512.998421:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564884352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497512.998457:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497512.998501:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1777497512.998511:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1777497512.998515:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564883456:0@lo:400:kworker.0 00000100:00100000:1.0:1777497512.998535:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564883328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497512.998549:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497512.998572:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564883968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497512.998678:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564883072:0@lo:400:kworker.0 00000100:00100000:3.0:1777497513.000556:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883840 00000100:00100000:3.0:1777497513.000573:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883840 00000100:00100000:3.0:1777497513.000651:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884352 00000100:00100000:3.0:1777497513.000655:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884352 00000100:00100000:3.0:1777497513.000787:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1777497513.000877:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564883840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002027:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002118:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564883584:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002194:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002221:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564884096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002339:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002362:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564884608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002400:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002426:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1777497513.002433:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564883200:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002464:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002476:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564883712:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.002500:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497513.002518:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564884224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.003185:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497513.003219:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564884480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.003365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497513.003409:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497513.003415:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497513.003455:0:83643:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883072 00000100:00100000:0.0:1777497513.003462:0:83643:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883072 00000100:00100000:0.0:1777497513.003511:0:83643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1777497513.003522:0:83643:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564883072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497513.003554:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564883328:12345-0@lo:400:kworker.0 Request processed in 5020us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497513.003571:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:1.0:1777497513.003614:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883456 00000100:00100000:1.0:1777497513.003621:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883456 00000100:00100000:1.0:1777497513.003684:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883584 00000100:00100000:1.0:1777497513.003688:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883584 00000100:00100000:1.0:1777497513.003708:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884096 00000100:00100000:1.0:1777497513.003711:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884096 00000100:00100000:1.0:1777497513.003725:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884608 00000100:00100000:1.0:1777497513.003727:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884608 00000100:00100000:1.0:1777497513.003739:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883200 00000100:00100000:1.0:1777497513.003742:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883200 00000100:00100000:1.0:1777497513.003779:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:1.0:1777497513.003788:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564883456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497513.003931:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564883840:12345-0@lo:400:kworker.0 Request processed in 3132us (5533us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.003942:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2455 00000100:00100000:3.0:1777497513.003963:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883968 00000100:00100000:3.0:1777497513.003967:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883968 00000100:00100000:3.0:1777497513.004010:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1777497513.004019:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564884352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497513.004072:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564884352:12345-0@lo:400:kworker.0 Request processed in 55us (5615us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.004080:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1777497513.004120:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1777497513.004127:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564883968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497513.004159:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564883968:12345-0@lo:400:kworker.0 Request processed in 34us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.004396:0:83643:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564883072:12345-0@lo:400:kworker.0 Request processed in 873us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.004406:0:83643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1777497513.004468:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1777497513.004478:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564883584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.004517:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564883584:12345-0@lo:400:kworker.0 Request processed in 42us (2323us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.004522:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1777497513.004539:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:0.0:1777497513.004545:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564884096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.004704:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497513.004751:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564883328:0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.004770:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564883840:0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.004791:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564884352:0@lo:400:kworker.0 00010000:00000080:1.0:1777497513.004791:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f841a5500 x1863837564883456/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:268/0 lens 224/224 e 0 to 0 dl 1777497523 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497513.004879:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2457 00000100:00100000:3.0:1777497513.004899:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884480 00000100:00100000:3.0:1777497513.004903:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884480 00000100:00100000:2.0:1777497513.004910:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564883968:0@lo:400:kworker.0 00000100:00100000:3.0:1777497513.004959:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:3.0:1777497513.004972:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564884480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.004985:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1777497513.004997:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564884608:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497513.005017:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf98a80 x1863837564884608/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1777497524 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497513.005042:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564884480:12345-0@lo:400:kworker.0 Request processed in 74us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.005050:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1777497513.005086:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564884608:12345-0@lo:400:kworker.0 Request processed in 79us (2670us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.005092:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564882944 00000100:00100000:2.0:1777497513.005122:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:3.0:1777497513.005123:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564882944 00000100:00100000:2.0:1777497513.005158:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1777497513.005168:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564883200:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497513.005178:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf9b800 x1863837564883200/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1777497524 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497513.005201:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564883200:12345-0@lo:400:kworker.0 Request processed in 37us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497513.005218:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1777497513.005305:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564883456:12345-0@lo:400:kworker.0 Request processed in 1518us (6757us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497513.005314:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00010000:00000080:0.0:1777497513.005352:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf98000 x1863837564884096/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1777497524 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497513.005396:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564884096:12345-0@lo:400:kworker.0 Request processed in 851us (3057us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.005403:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1777497513.005530:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564883712 00000100:00100000:3.0:1777497513.005536:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564883712 00000100:00100000:0.0:1777497513.005804:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884224 00000100:00100000:0.0:1777497513.005813:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884224 00000100:00100000:3.0:1777497513.005900:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3894 00000100:00100000:3.0:1777497513.005914:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564882944:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497513.005946:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564883456:0@lo:400:kworker.0 00000004:00000024:3.0:1777497513.005962:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497513.005964:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564884480:0@lo:400:kworker.0 00000100:00100000:2.0:1777497513.006007:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3895 00000100:00100000:2.0:1777497513.006020:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564883712:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497513.006039:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf99880 x1863837564883712/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/224 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497513.006057:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564882944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 146us (7805us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.006064:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3894 00000100:00100000:2.0:1777497513.006086:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564883712:12345-0@lo:400:kworker.0 Request processed in 68us (3582us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497513.006125:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3895 00000100:00100000:1.0:1777497513.006575:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564882944:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1777497513.008007:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497513.008018:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497513.008022:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497513.008589:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1777497513.008606:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564884224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008693:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564884224:12345-0@lo:400:kworker.0 Request processed in 92us (5327us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.008700:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3896 00000100:00100000:0.0:1777497513.008772:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564883200:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008785:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564883712:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008795:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564884224:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008805:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564883072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008816:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564883584:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008827:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564884096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497513.008838:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564884608:0@lo:400:kworker.0 00010000:00010000:0.0:1777497513.127282:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777497513.133126:0:84753:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:3.0:1777497513.251448:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497513.251554:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287872 00000100:00100000:0.0:1777497513.251568:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287872 00000100:00100000:0.0:1777497513.251662:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1164 00000100:00100000:0.0:1777497513.251690:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:67232:x1863837546287872:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497513.251721:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497513.251752:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691c790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c14c expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.251837:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.251853:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.251867:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497513.251923:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497513.251939:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497513.251985:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.252016:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691c790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c14c expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.252038:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c14c expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497513.252047:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885ebf00) 00010000:00010000:0.0:1777497513.252051:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497513.252055:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8000, rc 0) 00010000:00000080:0.0:1777497513.252065:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f840db100 x1863837546287872/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 576/688 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497513.252170:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67232:x1863837546287872:12345-192.168.202.4@tcp:101:dd.0 Request processed in 498us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.252178:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1164 00000100:00080000:3.0:1777497513.252483:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497513.257009:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.257078:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288128 00000100:00100000:1.0:1777497513.257089:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288128 00000100:00100000:1.0:1777497513.257161:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1165 00000100:00100000:1.0:1777497513.257170:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67232:x1863837546288128:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497513.257194:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497513.257197:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1777497513.257226:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691c797 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c14c expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257242:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885ebf00) 00010000:00010000:1.0:1777497513.257252:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497513.257269:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c79e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c153 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257412:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257425:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257475:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257490:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257497:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257503:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257582:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257591:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257599:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497513.257730:0:63727:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1777497513.257734:0:63727:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1777497504 00000004:00010000:1.0:1777497513.257737:0:63727:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1777497504 00000004:00010000:1.0:1777497513.257740:0:63727:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1777497504 00000004:00010000:1.0:1777497513.257742:0:63727:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 0 00002000:00010000:1.0:1777497513.257746:0:63727:0:(mdt_io.c:1550:mdt_lvb2reply()) size 0 00010000:00010000:1.0:1777497513.257753:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257761:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257774:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257781:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257788:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497513.257794:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257802:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257811:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5db00) 00010000:00010000:1.0:1777497513.257815:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497513.257819:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257826:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691c7a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257838:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257844:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257850:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257860:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497513.257871:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257877:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257884:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc958f637 (ffff9240a3b5df00) 00010000:00010000:1.0:1777497513.257887:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497513.257889:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257895:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691c7ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc958f637 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257945:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691c79e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257960:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.257968:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:1.0:1777497513.257970:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1777497513.257972:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39800, rc 0) 00010000:00000080:1.0:1777497513.257981:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf99500 x1863837546288128/t103079215113(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 752/824 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497513.258057:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:67232:x1863837546288128:12345-192.168.202.4@tcp:101:dd.0 Request processed in 888us (1059us total) trans 103079215113 rc 0/0 00000100:00100000:1.0:1777497513.258064:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1165 00000100:00100000:0.0:1777497513.264308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497513.264399:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288256 00000100:00100000:3.0:1777497513.264410:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288256 00000100:00100000:3.0:1777497513.264482:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1166 00000100:00100000:3.0:1777497513.264494:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:67232:x1863837546288256:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497513.264528:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497513.264554:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c7c1 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c15a expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264600:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c7c8 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264619:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c7c8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264633:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c7c8 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264778:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefa00/0x3e357265691c7c1 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c15a expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264797:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c7c8 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c15a expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.264807:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:3.0:1777497513.264816:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497513.264821:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef000, rc 0) 00010000:00000080:3.0:1777497513.264830:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf99c00 x1863837546288256/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 568/1272 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497513.264905:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67232:x1863837546288256:12345-192.168.202.4@tcp:101:dd.0 Request processed in 414us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.264914:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1166 00000100:00100000:1.0:1777497513.268456:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497513.271314:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288512 00000100:00100000:2.0:1777497513.271335:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288512 00000100:00100000:3.0:1777497513.271619:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1167 00000100:00100000:3.0:1777497513.271634:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:67232:x1863837546288512:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497513.271798:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.271822:0:63728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.271832:0:63728:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 4/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.271878:0:63728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497513.271895:0:63728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497513.271915:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837564884736:192.168.202.4@tcp:104: 00000100:00100000:3.0:1777497513.272042:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497513.283136:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497513.283210:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837564884736:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497513.283247:0:63728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497513.285028:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288640 00000100:00100000:1.0:1777497513.285046:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288640 00010000:00010000:1.0:1777497513.285143:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497513.285199:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2537 00000100:00100000:1.0:1777497513.285211:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2415:x1863837546288640:12345-192.168.202.4@tcp:102:ldlm_bl.0 00010000:00010000:1.0:1777497513.285232:0:6501:0:(ldlm_lockd.c:1655:ldlm_handle_convert0()) ### server-side convert handler START ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285248:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285263:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285274:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:1.0:1777497513.285278:0:6501:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5b 00010000:00010000:1.0:1777497513.285282:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285294:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285302:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497513.285338:0:6501:0:(ldlm_lockd.c:1704:ldlm_handle_convert0()) ### server-side convert handler END, rc = 0 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497513.285451:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2415:x1863837546288640:12345-192.168.202.4@tcp:102:ldlm_bl.0 Request processed in 242us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497513.285460:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2537 00010000:00010000:2.0:1777497513.285708:0:63728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497513.285717:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497513.285926:0:63728:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:2.0:1777497513.285931:0:63728:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1777497504 -> 1777497513 00000004:00010000:2.0:1777497513.285934:0:63728:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1777497504 -> 1777497504 00000004:00010000:2.0:1777497513.285944:0:63728:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1777497504 -> 1777497513 00000004:00010000:2.0:1777497513.285946:0:63728:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00010000:2.0:1777497513.285956:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001b9b60ac reply state 000000000ab51ee1 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497513.285970:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497513.285977:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:2.0:1777497513.285980:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497513.285984:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:2.0:1777497513.286056:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924088f86a00 x1863837546288512/t103079215114(0) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 488/456 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497513.286118:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:67232:x1863837546288512:12345-192.168.202.4@tcp:36:dd.0 Request processed in 14490us (17688us total) trans 103079215114 rc 0/0 00000100:00100000:2.0:1777497513.286127:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1167 00000100:00100000:3.0:1777497513.288989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.289188:0:63740:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288768 00000100:00100000:1.0:1777497513.289200:0:63740:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288768 00002000:00010000:1.0:1777497513.289249:0:63740:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1777497513.289255:0:63740:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff923f840d9500 with x1863837546288768 00000100:00100000:1.0:1777497513.289297:0:63740:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1777497513.289308:0:63740:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2414:x1863837546288768:12345-192.168.202.4@tcp:10:dd.0 00000004:00010000:1.0:1777497513.289640:0:63740:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 0 00000004:00010000:1.0:1777497513.289644:0:63740:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1777497513 -> 1777497513 00000004:00010000:1.0:1777497513.289646:0:63740:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1777497504 -> 1777497504 00000004:00010000:1.0:1777497513.289649:0:63740:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1777497513 -> 1777497513 00000004:00010000:1.0:1777497513.289651:0:63740:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497513.289673:0:63740:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f840d9500 x1863837546288768/t103079215115(0) o10->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 440/432 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497513.289750:0:63740:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2414:x1863837546288768:12345-192.168.202.4@tcp:10:dd.0 Request processed in 444us (773us total) trans 103079215115 rc 0/0 00000100:00100000:1.0:1777497513.289758:0:63740:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00002000:00010000:1.0:1777497513.289762:0:63740:0:(mdt_io.c:271:mdt_punch_hpreq_check()) lustre-MDT0000: refresh DOM lock for [0x20000a811:0x6:0x0] 00002000:00100000:1.0:1777497513.289764:0:63740:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff923f840d9500 with x1863837546288768 00000100:00100000:1.0:1777497513.304587:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497513.304697:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289024 00000100:00100000:3.0:1777497513.304711:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289024 00000100:00100000:3.0:1777497513.304787:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 226 00000100:00100000:3.0:1777497513.304922:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+13:67232:x1863837546289024:12345-192.168.202.4@tcp:35:dd.0 00010000:00000080:3.0:1777497513.305248:0:66634:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924088f85880 x1863837546289024/t103079215116(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 392/456 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497513.305365:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+14:67232:x1863837546289024:12345-192.168.202.4@tcp:35:dd.0 Request processed in 449us (793us total) trans 103079215116 rc 0/0 00000100:00100000:3.0:1777497513.305373:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 226 00000100:00100000:2.0:1777497513.506302:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497513.506334:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564884864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497513.506446:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497513.506508:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884864 00000100:00100000:2.0:1777497513.506518:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884864 00000100:00100000:2.0:1777497513.506577:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1777497513.506588:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564884864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497513.506625:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497513.506687:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564884864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497513.506695:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:2.0:1777497513.506754:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564884864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497513.507185:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497513.507198:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564884992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497513.507241:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497513.507540:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564885120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497513.507571:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497513.507635:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885120 00000100:00100000:1.0:1777497513.507641:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885120 00000100:00100000:2.0:1777497513.507896:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564884992 00000100:00100000:2.0:1777497513.507900:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564884992 00000100:00100000:2.0:1777497513.507933:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:2.0:1777497513.507941:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564884992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497513.507969:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497513.508242:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3897 00000100:00100000:1.0:1777497513.508251:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564885120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497513.508282:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445240832 avail 1299001344 00010000:00000080:1.0:1777497513.508299:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d96d80 x1863837564885120/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:269/0 lens 224/368 e 0 to 0 dl 1777497524 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497513.508339:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564885120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497513.508346:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3897 00000100:00100000:2.0:1777497513.508515:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564884992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 575us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497513.508522:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:3.0:1777497513.508602:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564884992:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497513.508636:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564885120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497513.789861:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.789908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.789998:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.790042:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497513.790073:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497513.790145:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289280 00000100:00100000:3.0:1777497513.790156:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289280 00000100:00100000:3.0:1777497513.790209:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289408 00000100:00100000:3.0:1777497513.790212:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289408 00000100:00100000:3.0:1777497513.790251:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1152 00000100:00100000:3.0:1777497513.790260:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+14:2413:x1863837546289280:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:3.0:1777497513.790295:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924088f85500 x1863837546289280/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:269/0 lens 224/224 e 0 to 0 dl 1777497524 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497513.790355:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+14:2413:x1863837546289280:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 97us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.790377:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1152 00000100:00100000:3.0:1777497513.790410:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1153 00000100:00100000:3.0:1777497513.790416:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546289408:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497513.790455:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546289408:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.790460:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1153 00000100:00080000:3.0:1777497513.790479:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497513.790863:0:83642:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289152 00000100:00100000:0.0:1777497513.790878:0:83642:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289152 00000100:00100000:0.0:1777497513.790951:0:83642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:0.0:1777497513.790961:0:83642:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240912f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546289152:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497513.791039:0:83642:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240912f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546289152:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 80us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497513.791047:0:83642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1777497513.802148:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289536 00000100:00100000:2.0:1777497513.802164:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289536 00000100:00100000:1.0:1777497513.804904:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289664 00000100:00100000:1.0:1777497513.804918:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289664 00000100:00100000:1.0:1777497513.805018:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2459 00000100:00080000:0.0:1777497513.805062:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497513.805128:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546289664:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497513.805221:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546289664:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 193us (15145us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497513.805228:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2459 00000100:00080000:0.0:1777497513.805618:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497513.814442:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2460 00000100:00100000:3.0:1777497513.814467:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546289536:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497513.814600:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546289536:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 144us (24691us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497513.814609:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2460 00010000:00010000:0.0:1777497514.151360:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497515.042383:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564885248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497515.042484:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497515.042595:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885248 00000100:00100000:2.0:1777497515.042608:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885248 00000100:00100000:2.0:1777497515.042691:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:2.0:1777497515.042703:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564885248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497515.042745:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497515.042797:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564885248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497515.042805:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00080000:3.0:1777497515.042868:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497515.042916:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564885248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497515.043116:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497515.043125:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564885376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497515.043151:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497515.043226:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885376 00000100:00100000:2.0:1777497515.043242:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885376 00000100:00100000:2.0:1777497515.043282:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1777497515.043289:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564885376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497515.043309:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497515.043343:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564885376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497515.043349:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00080000:3.0:1777497515.043486:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497515.043510:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564885376:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497515.170295:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1777497515.306035:0:84850:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1777497515.306140:0:84850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.306160:0:84850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.306168:0:84850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.306175:0:84850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.306205:0:84850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1777497515.306211:0:84850:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1777497515.306244:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497515.306250:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1777497515.306258:0:84850:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1777497515.306293:0:84850:0:(import.c:65:import_set_state_nolock()) ffff923f8274d800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777497515.306389:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564885504:0@lo:39:umount.0 00000100:00100000:1.0:1777497515.306492:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497515.306621:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885504 00000100:00100000:3.0:1777497515.306631:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885504 00000100:00100000:3.0:1777497515.306701:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1168 00000100:00100000:3.0:1777497515.306731:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564885504:12345-0@lo:39:umount.0 00000020:00000080:3.0:1777497515.306767:0:64885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c464 00000100:00080000:3.0:1777497515.306789:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240a6375800 : changing import state from FULL to CLOSED 00010000:00000080:3.0:1777497515.306832:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240af503480 x1863837564885504/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:271/0 lens 224/224 e 0 to 0 dl 1777497526 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497515.306886:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837564885504:12345-0@lo:39:umount.0 Request processed in 158us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497515.306894:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1168 00000020:00000080:3.0:1777497515.306905:0:64885:0:(genops.c:906:class_export_put()) final put ffff9240b539d800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1777497515.306962:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b539d800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1777497515.307018:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a6375800 for lustre-MDT0000 00000100:00080000:3.0:1777497515.307062:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8274d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1777497515.307072:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564885504:0@lo:39:umount.0 00010000:00010000:1.0:1777497515.307174:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497515.307183:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.307194:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497515.307208:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.307219:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497515.307226:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497515.307233:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497515.307236:0:6502:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1777497515.307239:0:6502:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1777497515.307271:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.307279:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497515.307297:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.307305:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691c34c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c353 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.307319:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.307321:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.307323:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497515.307386:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497515.307435:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564885632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.307472:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497515.307577:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497515.307581:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1777497515.307587:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1777497515.308670:0:84850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308690:0:84850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308696:0:84850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308720:0:84850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308752:0:84850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497515.308758:0:84850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308764:0:84850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308770:0:84850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308775:0:84850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308786:0:84850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497515.308792:0:84850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308798:0:84850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308804:0:84850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308810:0:84850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308840:0:84850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777497515.308859:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497515.308865:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308871:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e95e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497515.308875:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308882:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497515.308887:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497515.308893:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497515.308896:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1777497515.308926:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308932:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497515.308951:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308957:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e95e00/0x3e357265691c26c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c273 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308971:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497515.308974:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308987:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeee00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497515.308990:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.308996:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497515.309002:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497515.309007:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497515.309009:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1777497515.309011:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1777497515.309026:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309031:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497515.309042:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309048:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691c36f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c376 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309057:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497515.309060:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309065:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef600 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497515.309067:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309080:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497515.309085:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497515.309090:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1777497515.309092:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1777497515.309121:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1777497515.309139:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497515.309139:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309151:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497515.309160:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309165:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691c330 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c337 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497515.309174:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564885888:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497515.309177:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497515.309180:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497515.309187:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497515.309201:0:84850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309209:0:84850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309214:0:84850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309232:0:84850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497515.309250:0:84850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1777497515.309253:0:84850:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1777497515.309256:0:84850:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000100:00100000:3.0:1777497515.309265:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1777497515.309308:0:84850:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1777497515.309314:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1777497515.309320:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1777497515.309327:0:84850:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:0.0:1777497515.309350:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497515.309358:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.309367:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086e94000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497515.309371:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.309380:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497515.309387:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497515.309393:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1777497515.309396:0:16604:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1777497515.309399:0:16604:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1777497515.309439:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.309446:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497515.309458:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.309465:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e94000/0x3e357265691c25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c265 expref: -99 pid: 83634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.309478:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497515.309480:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497515.309493:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497515.309507:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564886016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.310356:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564885760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.310405:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497515.310540:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885632 00000100:00100000:1.0:1777497515.310551:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885632 00000100:00100000:1.0:1777497515.310613:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885888 00000100:00100000:1.0:1777497515.310616:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885888 00000100:00100000:3.0:1777497515.312259:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497515.312281:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564886144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.312353:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497515.312400:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564885760 00000100:00100000:3.0:1777497515.312408:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564885760 00000100:00100000:3.0:1777497515.312483:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886144 00000100:00100000:3.0:1777497515.312486:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886144 00000100:00100000:3.0:1777497515.312506:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:3.0:1777497515.312515:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+26:3657:x1863837564885632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497515.312534:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497515.312559:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dca00/0x3e357265691c353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c34c expref: 26 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497515.312582:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497515.312619:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3657:x1863837564885632:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497515.312862:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1777497515.313033:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1777497515.313046:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3658:x1863837564885760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497515.313067:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497515.313078:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefe00/0x3e357265691c273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c26c expref: 24 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.313090:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497515.313145:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564885760:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.313152:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1777497515.313168:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1777497515.313174:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837564886144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497515.313182:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497515.313190:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd200/0x3e357265691c265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c25e expref: 22 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.313201:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497515.313222:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3658:x1863837564886144:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.313228:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1777497515.313241:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1777497515.313246:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3659:x1863837564885888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497515.313254:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497515.313262:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dc000/0x3e357265691c376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c36f expref: 20 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.313272:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497515.313301:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3659:x1863837564885888:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (4042us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.313317:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00010000:00010000:1.0:1777497515.313350:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497515.313391:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564885888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.313509:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497515.313571:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564885632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.313594:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564886144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497515.313601:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564885760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497515.313735:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886016 00000100:00100000:1.0:1777497515.313741:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886016 00000100:00100000:1.0:1777497515.313785:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1777497515.313792:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409b413850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3660:x1863837564886016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497515.313801:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497515.313811:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd000/0x3e357265691c337 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c330 expref: 19 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.313828:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497515.313860:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409b413850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3660:x1863837564886016:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.313866:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:1.0:1777497515.313933:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564886016:0@lo:103:ldlm_bl.0 00000004:00000080:2.0:1777497515.332314:0:84850:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:2.0:1777497515.337641:0:83635:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215116 is committed 00010000:00010000:1.0:1777497515.337686:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337702:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337711:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337718:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497515.337724:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337754:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337777:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240a3b5d800) 00010000:00010000:1.0:1777497515.337780:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497515.337787:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.337794:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefc00/0x3e357265691c7cf lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1777497515.337909:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1777497515.337920:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92408a0a1800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497515.337927:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff924086e2c800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497515.337932:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92409c46f000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497515.337936:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92409c46b800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497515.337943:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff92409c468800 6d03493e-1218-49f3-bdd0-b10716c402e0 192.168.202.4@tcp 8 (0 0 3) 0 0 0 0: 0000000000000000 103079215116 stale:0 00000020:00080000:3.0:1777497515.337949:0:84850:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff9240a62e8000) has exports, disconnecting them 00000020:00080000:3.0:1777497515.337955:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92408a0a1800), last request at 1777497482 00000020:00000080:3.0:1777497515.337963:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c45d 00000100:00080000:3.0:1777497515.337982:0:84850:0:(import.c:65:import_set_state_nolock()) ffff92408a0a3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497515.338022:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92408a0a1800): rc 0 00000020:00000080:3.0:1777497515.338025:0:84850:0:(genops.c:906:class_export_put()) final put ffff92408a0a1800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1777497515.338049:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff924086e2c800), last request at 1777497513 00000020:00000080:3.0:1777497515.338052:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c456 00000100:00080000:3.0:1777497515.338057:0:84850:0:(import.c:65:import_set_state_nolock()) ffff92408a0a4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497515.338078:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff924086e2c800): rc 0 00000020:00000080:3.0:1777497515.338080:0:84850:0:(genops.c:906:class_export_put()) final put ffff924086e2c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1777497515.338087:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92409c46f000), last request at 1777497513 00000020:00000080:3.0:1777497515.338128:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c44f 00000100:00080000:3.0:1777497515.338135:0:84850:0:(import.c:65:import_set_state_nolock()) ffff924086e2b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497515.338148:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92409c46f000): rc 0 00000020:00000080:3.0:1777497515.338150:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409c46f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1777497515.338158:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff92409c46b800), last request at 1777497476 00000020:00000080:3.0:1777497515.338171:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2b9 00000100:00080000:3.0:1777497515.338190:0:84850:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497515.338246:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff92409c46b800): rc 0 00000020:00000080:3.0:1777497515.338248:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409c46b800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:3.0:1777497515.338253:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff92409c468800), last request at 1777497513 00000020:00000080:3.0:1777497515.338256:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2b2 00000020:00010000:3.0:1777497515.338262:0:84850:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92409c468800: total 4 00000100:00080000:3.0:1777497515.338266:0:84850:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497515.338277:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff92409c468800): rc 0 00000004:00000080:3.0:1777497515.338284:0:84850:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef01c5fae0 00000100:00080000:3.0:1777497515.338318:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497515.338325:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1777497515.338824:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92409c468800: total 4 00010000:00010000:0.0:1777497515.338907:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff92409c468800, canceled 0 locks, left on hash table 3. 00010000:00010000:0.0:1777497515.338973:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691c7c8 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c15a expref: 4 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.339025:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691c7b3 lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 3 pid: 63727 timeout: 3742 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497515.339071:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691c6a2 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x3:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c10d expref: 2 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777497515.339230:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497515.339296:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e2c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497515.339323:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497515.339347:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46b800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497515.339386:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92408a0a3800 for lustre-MDT0000 00000020:00000080:1.0:1777497515.339392:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92408a0a4000 for lustre-MDT0000 00000020:00000080:1.0:1777497515.339395:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e2b000 for lustre-MDT0000 00000020:00000080:1.0:1777497515.339398:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b3000 for lustre-MDT0000 00010000:00010000:1.0:1777497515.339424:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497515.339462:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff92409c468800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1777497515.341148:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497515.341162:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.341839:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497515.341854:0:84850:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1777497515.341891:0:84850:0:(import.c:65:import_set_state_nolock()) ffff92409c761000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1777497515.341990:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886272:0@lo:39:umount.0 00000100:00100000:1.0:1777497515.342067:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497515.342224:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886272 00000100:00100000:2.0:1777497515.342239:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886272 00000100:00100000:2.0:1777497515.342340:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3898 00000100:00100000:2.0:1777497515.342354:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564886272:12345-0@lo:39:umount.0 00000020:00000080:2.0:1777497515.342423:0:8407:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2ea 00000100:00080000:2.0:1777497515.342435:0:8407:0:(import.c:65:import_set_state_nolock()) ffff924086e22800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497515.342467:0:8407:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378732 00010000:00010000:1.0:1777497515.342477:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497515.342713:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837564886272:12345-0@lo:39:umount.0 Request processed in 362us (644us total) trans 81604378733 rc 0/0 00000100:00100000:2.0:1777497515.342721:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3898 00000100:00080000:1.0:1777497515.347209:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c761000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777497515.347226:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886272:0@lo:39:umount.0 00000100:00080000:3.0:1777497515.347877:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777497515.347897:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 3 00000004:00080000:3.0:1777497515.347917:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777497515.348647:0:84850:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1777497515.348678:0:84850:0:(import.c:65:import_set_state_nolock()) ffff923f81a05000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1777497515.348697:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777497515.348700:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 3 00000004:00080000:3.0:1777497515.348713:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777497515.349392:0:84850:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1777497515.349407:0:84850:0:(import.c:65:import_set_state_nolock()) ffff923f818b1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1777497515.349465:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a62e8000) has no exports 00000100:00100000:1.0:1777497515.350157:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886400:0@lo:9:umount.0 00000100:00100000:1.0:1777497515.350240:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497515.350280:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886528:0@lo:9:umount.0 00000100:00100000:1.0:1777497515.350304:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497515.350352:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886400 00000100:00100000:1.0:1777497515.350360:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886400 00000100:00100000:1.0:1777497515.350432:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886528 00000100:00100000:1.0:1777497515.350435:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886528 00000100:00100000:1.0:1777497515.350462:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1777497515.350471:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564886400:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777497515.350497:0:23437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c306 00000100:00080000:1.0:1777497515.350504:0:23437:0:(import.c:65:import_set_state_nolock()) ffff923f88a89800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497515.350550:0:23437:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:1.0:1777497515.350849:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564886400:12345-0@lo:9:umount.0 Request processed in 378us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.350857:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5849 00000100:00100000:1.0:1777497515.350875:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5850 00000100:00100000:1.0:1777497515.350882:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564886528:12345-0@lo:9:umount.0 00000020:00000080:1.0:1777497515.350894:0:23437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c33e 00000100:00080000:1.0:1777497515.350899:0:23437:0:(import.c:65:import_set_state_nolock()) ffff9240aef68800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497515.350926:0:23437:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:1.0:1777497515.351003:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564886528:12345-0@lo:9:umount.0 Request processed in 121us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497515.351010:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5850 00000100:00080000:1.0:1777497515.351043:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497515.351053:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1777497515.351073:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.351080:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497515.351088:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81a05000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497515.351135:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497515.351138:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.351145:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886400:0@lo:9:umount.0 00000100:00080000:2.0:1777497515.351187:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f818b1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497515.351207:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497515.351209:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.351213:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564886528:0@lo:9:umount.0 00000020:00080000:3.0:1777497515.355420:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a62e8000) has no exports 00000020:00000080:0.0:1777497515.412124:0:6503:0:(genops.c:906:class_export_put()) final put ffff92409c468800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:1.0:1777497515.412167:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c468800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0000 00000020:00000080:1.0:1777497515.412262:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b3800 for lustre-MDT0000 00010000:00010000:1.0:1777497515.412277:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.412279:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.412281:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777497515.433580:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2ce 00000020:00000080:3.0:1777497515.433595:0:84850:0:(genops.c:906:class_export_put()) final put ffff9240a3af0000/lustre-QMT0000_UUID 00000020:01000000:3.0:1777497515.433718:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1777497515.433986:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1777497515.434026:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497515.434038:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1777497515.434043:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff923f84b099c0) has no exports 00000020:00000080:2.0:1777497515.434304:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2c7 00000020:00000080:2.0:1777497515.434312:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f81a02000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497515.434337:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a02000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497515.434380:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497515.434388:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497515.434391:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f86084000/lustre-QMT0000_UUID 00000020:00000080:2.0:1777497515.434395:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff923f86084000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1777497515.434405:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1777497515.434547:0:84850:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f83e4fae0 - data ffff9240b6112948/ffff923f84997800 00000020:01000000:2.0:1777497515.434676:0:84850:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a6a1dde0 - data ffff9240b60dd438/ffff9240a738e000 00000100:00080000:2.0:1777497515.501626:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1777497515.501635:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1777497515.501652:0:84850:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240a6d95880 x1863837564886272/t81604378733(81604378733) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497525 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497515.501681:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1777497515.504278:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497515.504285:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 4 00000004:00080000:2.0:1777497515.504344:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.504347:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777497515.508248:0:83653:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777497515.508256:0:83653:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x60:0x0] index 1 count 1 00000040:00080000:1.0:1777497515.508272:0:83653:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 24 count 2 00000100:00080000:2.0:1777497515.508977:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497515.508983:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 4 00000004:00080000:2.0:1777497515.509000:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.509004:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777497515.509485:0:83655:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777497515.509490:0:83655:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x62:0x0] index 1 count 1 00000040:00080000:1.0:1777497515.509500:0:83655:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 24 count 2 00000020:00000080:2.0:1777497515.516705:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c288 00000020:00000080:2.0:1777497515.516716:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f839d7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777497515.517375:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c29d 00000020:00000080:2.0:1777497515.517381:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409852c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497515.517386:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1777497515.517390:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497515.517399:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497515.517402:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9240a62e99c0) has no exports 00000004:01000000:2.0:1777497515.517554:0:84850:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1777497515.517562:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c31b 00000020:00000080:2.0:1777497515.517566:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409f6c3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497515.517570:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777497515.517574:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497515.517578:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497515.517581:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff923f84b08000) has no exports 00000020:00000080:2.0:1777497515.517586:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c314 00000020:00000080:2.0:1777497515.517588:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f818b3800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1777497515.517910:0:84850:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777497515.517915:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497515.517919:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969448 gen 5 00000004:00080000:2.0:1777497515.517924:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.517927:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497515.517959:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497515.517966:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497515.517971:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2ff 00000020:00000080:2.0:1777497515.517974:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409f6c5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497515.517978:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1777497515.517981:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497515.517984:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497515.517986:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9240a695b380) has no exports 00000020:00000080:2.0:1777497515.517990:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2f8 00000020:00000080:2.0:1777497515.517993:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f81a04800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1777497515.518318:0:84850:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1777497515.518335:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497515.518337:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969452 gen 5 00000004:00080000:2.0:1777497515.518339:0:84850:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497515.518341:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497515.518366:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497515.518372:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1777497515.518380:0:84850:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1777497515.518384:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2e3 00000020:00000080:2.0:1777497515.518389:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409f6c2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1777497515.518392:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1777497515.518395:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497515.518398:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1777497515.518400:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240aecd8000) has no exports 00000020:00000080:2.0:1777497515.518404:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2dc 00000020:00000080:2.0:1777497515.518406:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409c761800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497515.519204:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497515.519214:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409852c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1777497515.519219:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f6c3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1777497515.519225:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f818b3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497515.519229:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f818b1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1777497515.519233:0:8:0:(genops.c:906:class_export_put()) final put ffff92409f6c1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497515.519235:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f6c1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1777497515.519240:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497515.519315:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f6c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1777497515.519320:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a04800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497515.519323:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81a05000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1777497515.519326:0:8:0:(genops.c:906:class_export_put()) final put ffff92408a0a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497515.519328:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1777497515.519331:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497515.519354:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f6c2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777497515.519358:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c761800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777497515.521149:0:84850:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1777497515.521156:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497515.521160:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1777497515.521171:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497515.521225:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497515.521236:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497515.521266:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497515.521270:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497515.521275:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409f6c3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497515.521278:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f6c3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1777497515.521290:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497515.521379:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2a4 00000020:00000080:0.0:1777497515.521386:0:84850:0:(genops.c:906:class_export_put()) final put ffff924098529800/lustre-MDD0000_UUID 00000020:01000000:0.0:1777497515.521390:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1777497515.521402:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497515.521407:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497515.521423:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9240a62ecd40) has no exports 00000020:00000080:0.0:1777497515.521446:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497515.521450:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1777497515.521454:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c2ab 00000020:00000080:0.0:1777497515.521458:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409852a800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497515.521465:0:84850:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a68cf800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1777497515.521468:0:84850:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a68cf800 3 00000020:01000004:0.0:1777497515.521472:0:84850:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a68cf800 from lustre-MDT0000 00000020:00000080:0.0:1777497515.521493:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497515.521496:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1777497515.521498:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f839d1000/lustre-MDT0000_UUID 00000020:00000080:0.0:1777497515.521500:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d1000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1777497515.521507:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1777497515.521538:0:84850:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1777497515.521542:0:84850:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1777497515.521545:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1777497515.521547:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497515.521550:0:84850:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1777497515.521558:0:84850:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff92409c764000 95f1b493-372d-4153-ad35-48e1115be1b1 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497515.521564:0:84850:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240a68ce000 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497515.521568:0:84850:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff923f84b0cd40) has exports, disconnecting them 00000020:00080000:0.0:1777497515.521573:0:84850:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff92409c764000), last request at 1777497476 00000020:00000080:0.0:1777497515.521595:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c345 00000020:00010000:0.0:1777497515.521600:0:84850:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92409c764000: total 2 00000100:00080000:0.0:1777497515.521605:0:84850:0:(import.c:65:import_set_state_nolock()) ffff923f818b2800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1777497515.521831:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c761000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777497515.521839:0:8:0:(genops.c:906:class_export_put()) final put ffff9240bb70e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497515.521842:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb70e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1777497515.521847:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497515.522193:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924098529800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1777497515.522198:0:8:0:(genops.c:906:class_export_put()) final put ffff923f88a1e800/lustre-MDD0000_UUID 00000020:00000080:1.0:1777497515.522200:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1777497515.522204:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1777497515.522234:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409852a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1777497515.522351:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff92409c764000): rc 0 00000020:00080000:0.0:1777497515.522356:0:84850:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9240a68ce000), last request at 1777497476 00000020:00000080:0.0:1777497515.522401:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c249 00000020:00010000:0.0:1777497515.522405:0:84850:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240a68ce000: total 0 00000100:00080000:0.0:1777497515.522429:0:84850:0:(import.c:65:import_set_state_nolock()) ffff9240a68cb800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497515.522440:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240a68ce000): rc 0 00000020:00080000:0.0:1777497515.522444:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff923f84b0cd40) has no exports 00000100:00100000:0.0:1777497515.522495:0:83642:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff923f8388ac00:83642] 1 exiting: rc = 0 00000100:00100000:1.0:1777497515.522756:0:83640:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff923f8500e400:83640] 0 exiting: rc = 1 00000020:00010000:1.0:1777497515.522798:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92409c764000: total 0 00010000:00010000:1.0:1777497515.522841:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff92409c764000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1777497515.522873:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38800/0x3e357265691c441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f8 expref: 5 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.522901:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95c00/0x3e357265691c433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ea expref: 4 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.522914:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee000/0x3e357265691c43a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0f1 expref: 3 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.522924:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee400/0x3e357265691c448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c0ff expref: 2 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.522933:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff92409c764000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1777497515.523394:0:16604:0:(genops.c:906:class_export_put()) final put ffff92409c764000/95f1b493-372d-4153-ad35-48e1115be1b1 00000020:00010000:1.0:1777497515.523424:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240a68ce000: total 1 00010000:00010000:1.0:1777497515.523429:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.523450:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240a68ce000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1777497515.523478:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd400/0x3e357265691c392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c38b expref: 14 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523496:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95200/0x3e357265691c410 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c409 expref: 13 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523506:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866ddc00/0x3e357265691c3a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c399 expref: 12 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523515:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dcc00/0x3e357265691c402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3fb expref: 11 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523525:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e95600/0x3e357265691c3bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3b5 expref: 10 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523533:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd600/0x3e357265691c41e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c417 expref: 9 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523543:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924086e94e00/0x3e357265691c3ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3a7 expref: 8 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523553:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924099078000/0x3e357265691c42c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c425 expref: 7 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523561:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38000/0x3e357265691c3ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3c3 expref: 6 pid: 83643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523570:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691c3d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3d1 expref: 5 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523579:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38600/0x3e357265691c3e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3df expref: 4 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523602:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dde00/0x3e357265691c3f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c3ed expref: 3 pid: 83640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523625:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dc600/0x3e357265691c384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c37d expref: 2 pid: 83642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497515.523634:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240a68ce000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1777497515.523647:0:16604:0:(genops.c:906:class_export_put()) final put ffff9240a68ce000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00010000:00010000:1.0:1777497515.523652:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.523653:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.523655:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497515.523664:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777497515.523757:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c764000/95f1b493-372d-4153-ad35-48e1115be1b1 for MGS 00000020:00000080:0.0:1777497515.523796:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68ce000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:0.0:1777497515.523806:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f818b2800 for MGS 00000020:00000080:0.0:1777497515.523809:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a68cb800 for MGS 00000100:00100000:0.0:1777497515.541317:0:83643:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff923f8388b400:83643] 2 exiting: rc = 0 00000100:00100000:1.0:1777497515.541520:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541528:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541534:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541540:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541545:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541550:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541555:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541562:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541568:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541573:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541578:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541585:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541591:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541596:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541602:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541607:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541612:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541617:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541636:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541656:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541662:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541667:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541673:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541679:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541685:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541690:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541696:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541701:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541706:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541711:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541716:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541721:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541726:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541731:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541736:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541741:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541746:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541750:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541755:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541760:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541764:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541769:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541774:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541779:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541784:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541788:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541793:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541798:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541803:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541808:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541813:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541829:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541834:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541839:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541852:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541857:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541862:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541867:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541872:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541877:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541882:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541887:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541892:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1777497515.541897:0:84850:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1777497515.543405:0:84850:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240bb7f6cc0 - data ffff9240a30d3bd0/ffff923f8412b400 00000020:01000000:1.0:1777497515.543544:0:84850:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240bb7f6840 - data ffff9240b6197798/ffff923f85ddc000 00000020:00000080:1.0:1777497515.544008:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c242 00000020:00000080:1.0:1777497515.544017:0:84850:0:(genops.c:906:class_export_put()) final put ffff92409c46f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1777497515.544077:0:84850:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a68cf800 from MGS, refs=2 00000020:01000004:1.0:1777497515.544081:0:84850:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a68cf800 2 00000020:01000004:1.0:1777497515.544084:0:84850:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a68cf800 from MGS 00000020:00000080:1.0:1777497515.544128:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497515.544136:0:84850:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1777497515.544138:0:84850:0:(genops.c:906:class_export_put()) final put ffff9240b539c000/MGS 00000020:00000080:1.0:1777497515.544141:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b539c000/MGS for MGS 00000020:01000000:1.0:1777497515.544148:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1777497515.544218:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1777497515.544222:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497515.544227:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1777497515.544233:0:84850:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9240bcc6e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1777497515.544238:0:84850:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9240a62eb380) has exports, disconnecting them 00000020:00080000:1.0:1777497515.544242:0:84850:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9240bcc6e800), last request at 1777497476 00000020:00000080:1.0:1777497515.544246:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c361 00000020:00080000:1.0:1777497515.544256:0:84850:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240bcc6e800): rc 0 00000020:00000080:1.0:1777497515.544260:0:84850:0:(genops.c:906:class_export_put()) final put ffff9240bcc6e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1777497515.545769:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497515.550968:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcc6e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1777497515.557186:0:84850:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1777497515.557195:0:84850:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497515.557199:0:84850:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1777497515.557207:0:84850:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497515.557238:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f8274d800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1777497515.557378:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497515.557387:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1777497515.557393:0:84850:0:(genops.c:906:class_export_put()) final put ffff923f82ab0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1777497515.557398:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1777497515.557403:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1777497515.557496:0:84850:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a68cf800 1 00000020:00000080:0.0:1777497515.557502:0:84850:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c234 00000020:00000080:0.0:1777497515.557508:0:84850:0:(genops.c:906:class_export_put()) final put ffff9240b539c800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1777497515.557516:0:84850:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1777497515.557524:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b539c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497515.557533:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497515.557537:0:84850:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1777497515.557540:0:84850:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9240a695cd40) has no exports 00000020:00000080:1.0:1777497515.654894:0:84850:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497515.654915:0:84850:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1777497515.654921:0:84850:0:(genops.c:906:class_export_put()) final put ffff9240a68c9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497515.654925:0:84850:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68c9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1777497515.654935:0:84850:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1777497515.655064:0:84850:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9240a68cc800 00000020:02000400:1.0:1777497515.655147:0:84850:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1777497516.200269:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497517.220681:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497518.115710:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564886784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497518.115789:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497518.115831:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564887296:0@lo:400:kworker.0 00000100:00100000:1.0:1777497518.115859:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497518.115888:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1777497518.115894:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564886912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497518.115915:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497518.115930:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564887424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497518.115951:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497518.115987:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887296 00000100:00100000:1.0:1777497518.115994:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887296 00000100:00100000:1.0:1777497518.116034:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3899 00000100:00100000:1.0:1777497518.116041:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564887296:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497518.116049:0:80394:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497518.116086:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3659:x1863837564887296:12345-0@lo:400:kworker.0 Request processed in 43us (225us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497518.116114:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3899 00000100:00080000:1.0:1777497518.116155:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497518.116159:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497518.116163:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497518.116183:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497518.116188:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1777497518.116194:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497518.116216:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af501500 x1863837564887808/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497518.116236:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564887296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116331:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564886656:0@lo:400:kworker.0 00000400:00000100:3.0:1777497518.116370:0:3658:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564886656 offset 0 length 224: 4 00000100:00100000:3.0:1777497518.116406:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564887168:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116429:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497518.116456:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564887680:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116475:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497518.116491:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1777497518.116497:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564887040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116514:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497518.116531:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564887552:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116551:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497518.116575:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886784 00000100:00100000:3.0:1777497518.116579:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886784 00000100:00100000:3.0:1777497518.116609:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564886912 00000100:00100000:3.0:1777497518.116612:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564886912 00000100:00100000:3.0:1777497518.116636:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887168 00000100:00100000:3.0:1777497518.116638:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887168 00000100:00100000:3.0:1777497518.116647:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887680 00000100:00100000:3.0:1777497518.116649:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887680 00000100:00100000:3.0:1777497518.116655:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887040 00000100:00100000:3.0:1777497518.116657:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887040 00000100:00100000:3.0:1777497518.116666:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1777497518.116672:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564886912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116713:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564886912:12345-0@lo:400:kworker.0 Request processed in 41us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497518.116720:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1777497518.116734:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1777497518.116740:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564887168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.116770:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564887168:12345-0@lo:400:kworker.0 Request processed in 30us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497518.116775:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:3.0:1777497518.116787:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1777497518.116790:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1863837564886784:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497518.116794:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497518.116816:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1863837564886784:12345-0@lo:400:kworker.0 Request processed in 24us (1027us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497518.116821:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1777497518.116831:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1777497518.116834:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837564887680:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497518.116838:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497518.116860:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837564887680:12345-0@lo:400:kworker.0 Request processed in 24us (384us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497518.116871:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1777497518.116884:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:3.0:1777497518.116888:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837564887040:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497518.116893:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497518.116914:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837564887040:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497518.116920:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00080000:3.0:1777497518.116946:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497518.116949:0:3658:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777497518.116952:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777497518.116957:0:3658:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497518.116960:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1777497518.116964:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497518.116981:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408788aa00 x1863837564887936/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497518.116994:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564887040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.117009:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564887168:0@lo:400:kworker.0 00000100:00080000:3.0:1777497518.117016:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497518.117019:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777497518.117021:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777497518.117024:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497518.117027:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3611 00000100:00080000:3.0:1777497518.117030:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497518.117048:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924087888a80 x1863837564888064/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497518.117059:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564887680:0@lo:400:kworker.0 00000100:00080000:1.0:1777497518.117347:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497518.117374:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564886912:0@lo:400:kworker.0 00000100:00080000:1.0:1777497518.117384:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497518.117398:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497518.117401:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497518.117404:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497518.117408:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3611 00000100:00080000:1.0:1777497518.117412:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497518.117426:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af502300 x1863837564888192/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497518.117437:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564886784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497518.117855:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564887808:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777497518.117905:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497518.117939:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564887936:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497518.117960:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497518.117983:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564888064:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497518.118002:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497518.118018:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564888192:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777497518.118035:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497518.118064:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887936 00000100:00100000:2.0:1777497518.118069:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887936 00000100:00100000:2.0:1777497518.118091:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888064 00000100:00100000:2.0:1777497518.118118:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888064 00000100:00100000:2.0:1777497518.118127:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888192 00000100:00100000:2.0:1777497518.118138:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888192 00000100:00100000:2.0:1777497518.118151:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1777497518.118155:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564887936:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777497518.118188:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497518.118222:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564887936:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (261us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497518.118229:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00100000:2.0:1777497518.118243:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1777497518.118247:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564888064:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777497518.118257:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497518.118278:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564888064:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 29us (274us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497518.118283:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1777497518.118606:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:2.0:1777497518.118611:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564888192:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1777497518.118622:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497518.118647:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564888192:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (611us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497518.118654:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00080000:2.0:1777497518.118689:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497518.118693:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497518.118697:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564887936:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1777497518.118705:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497518.118708:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497518.118711:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564888064:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1777497518.118727:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497518.118730:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497518.118733:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564888192:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1777497518.118842:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887424 00000100:00100000:0.0:1777497518.118848:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887424 00000100:00100000:0.0:1777497518.118898:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887552 00000100:00100000:0.0:1777497518.118902:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887552 00000100:00100000:0.0:1777497518.118923:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1777497518.118930:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564887424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497518.118974:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564887424:12345-0@lo:400:kworker.0 Request processed in 44us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497518.118980:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1777497518.118992:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1777497518.118998:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564887552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497518.119028:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564887552:12345-0@lo:400:kworker.0 Request processed in 31us (2476us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497518.119034:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1777497518.119075:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564887552:0@lo:400:kworker.0 00000100:00080000:2.0:1777497518.119238:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497518.119244:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497518.119331:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564887424:0@lo:400:kworker.0 00000100:00100000:3.0:1777497518.119617:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564887808 00000100:00100000:3.0:1777497518.119622:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564887808 00000100:00100000:3.0:1777497518.119656:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3900 00000100:00100000:3.0:1777497518.119661:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564887808:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1777497518.119674:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497518.119716:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564887808:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 54us (1810us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497518.119723:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3900 00000100:00080000:2.0:1777497518.120622:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497518.120629:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497518.120633:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564887808:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:1.0:1777497518.243593:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497518.403212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497518.403274:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497518.403407:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289920 00000100:00100000:2.0:1777497518.403419:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289920 00000100:00100000:2.0:1777497518.403482:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1175 00000100:00100000:2.0:1777497518.403491:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2413:x1863837546289920:12345-192.168.202.4@tcp:16:kworker.0 00000020:00080000:2.0:1777497518.403501:0:63728:0:(tgt_handler.c:795:tgt_request_handle()) operation 16 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:2.0:1777497518.403892:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2413:x1863837546289920:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 399us (615us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497518.403899:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1175 00000100:00100000:0.0:1777497518.405902:0:63742:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289792 00000100:00100000:0.0:1777497518.405916:0:63742:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289792 00000100:00100000:0.0:1777497518.405978:0:63742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1777497518.405986:0:63742:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2413:x1863837546289792:12345-192.168.202.4@tcp:4:dd.0 00000020:00080000:0.0:1777497518.405994:0:63742:0:(tgt_handler.c:795:tgt_request_handle()) operation 4 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:0.0:1777497518.406064:0:63742:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:0+-99:2413:x1863837546289792:12345-192.168.202.4@tcp:4:dd.0 Request processed in 77us (2861us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497518.406070:0:63742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1777497518.410044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497518.410352:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290048 00000100:00100000:2.0:1777497518.410363:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290048 00000100:00100000:2.0:1777497518.410428:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1176 00000100:00100000:2.0:1777497518.410448:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546290048:12345-192.168.202.4@tcp:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777497518.410474:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497518.410546:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546290048:12345-192.168.202.4@tcp:38:ptlrpcd_00_01.0 Request processed in 109us (511us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497518.410554:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1176 00000100:00100000:2.0:1777497518.917534:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497518.917595:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:2.0:1777497518.917616:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546290176 offset 0 length 224: 4 00000100:00100000:2.0:1777497518.917633:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497518.917673:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497518.917865:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290688 00000100:00100000:3.0:1777497518.917875:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290688 00000100:00100000:3.0:1777497518.917947:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290560 00000100:00100000:3.0:1777497518.917950:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290560 00000100:00100000:3.0:1777497518.917978:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2463 00000100:00100000:3.0:1777497518.917988:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546290688:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497518.918056:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546290688:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497518.918064:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2463 00000100:00100000:3.0:1777497518.918080:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2464 00000100:00100000:3.0:1777497518.918086:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546290560:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497518.918166:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546290560:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497518.918173:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2464 00000100:00100000:0.0:1777497518.920328:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290432 00000100:00100000:0.0:1777497518.920352:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290432 00000100:00100000:0.0:1777497518.920429:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290304 00000100:00100000:0.0:1777497518.920433:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290304 00000100:00100000:0.0:1777497518.920472:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1156 00000100:00100000:0.0:1777497518.920512:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546290432:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497518.920583:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546290432:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (3059us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497518.920591:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1156 00000100:00100000:0.0:1777497518.920609:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1177 00000100:00100000:0.0:1777497518.920614:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546290304:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497518.920635:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497518.920662:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546290304:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 47us (3027us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497518.920668:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1177 00000100:00080000:2.0:1777497518.921318:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497518.921324:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497518.921327:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777497519.267256:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497520.164583:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564888320:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497520.164663:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497520.164786:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888320 00000100:00100000:3.0:1777497520.164795:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888320 00000100:00100000:3.0:1777497520.164856:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1777497520.164865:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564888320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497520.164894:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497520.164941:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564888320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497520.164948:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2022 00000100:00100000:3.0:1777497520.164994:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564888320:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497520.165199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497520.165852:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497520.165864:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564888448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497520.165903:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497520.166006:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888448 00000100:00100000:2.0:1777497520.166012:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888448 00000100:00100000:2.0:1777497520.166062:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:2.0:1777497520.166071:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564888448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497520.166091:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497520.166165:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564888448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497520.166171:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00100000:0.0:1777497520.166249:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564888448:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497520.166309:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777497520.295134:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1777497520.676866:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497520.676874:0:9460:0:(genops.c:906:class_export_put()) final put ffff9240aef6b800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1777497520.676934:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497520.676947:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378733 is committed 00000020:00000080:0.0:1777497520.676951:0:72699:0:(genops.c:906:class_export_put()) final put ffff924086e22000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497520.676977:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240aef6b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1777497520.677040:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e22000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1777497520.677070:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240aef68800 for lustre-OST0001 00000020:00000080:1.0:1777497520.677075:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e22800 for lustre-MDT0001 00000001:00100000:2.0:1777497520.677358:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497520.677370:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f88a8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497520.677423:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a8f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1777497520.677456:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a89800 for lustre-OST0000 00010000:00010000:1.0:1777497521.314372:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497522.338334:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497523.239895:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497523.239901:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497523.239906:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497523.239914:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1777497523.239919:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1777497523.239933:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497523.239958:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af501180 x1863837564888704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497523.239993:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497523.239997:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497523.240000:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497523.240003:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1777497523.240007:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1777497523.240010:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497523.240021:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af502300 x1863837564888960/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497523.240026:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564888576:0@lo:400:kworker.0 00000100:00080000:1.0:1777497523.240055:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497523.240059:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497523.240074:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497523.240079:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1777497523.240084:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000400:00000100:0.0:1777497523.240084:0:3657:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564888576 offset 0 length 224: 4 00000100:00080000:1.0:1777497523.240092:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497523.240166:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d09500 x1863837564889216/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497523.240171:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497523.240181:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564888832:0@lo:400:kworker.0 00000100:00080000:1.0:1777497523.240199:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497523.240202:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497523.240204:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497523.240208:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3647 00000100:00080000:1.0:1777497523.240211:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1777497523.240215:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497523.240220:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497523.240226:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d0a680 x1863837564889600/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497523.240251:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564889472:0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.240277:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497523.240286:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564889344:0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.240319:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888832 00000100:00100000:1.0:1777497523.240320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497523.240328:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888832 00000100:00100000:1.0:1777497523.240358:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497523.240365:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564889088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497523.240391:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497523.240419:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497523.240461:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889472 00000100:00100000:3.0:1777497523.240466:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889472 00000100:00100000:3.0:1777497523.240507:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889344 00000100:00100000:2.0:1777497523.240508:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564888704:0@lo:38:kworker.0 00000100:00100000:3.0:1777497523.240511:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889344 00000100:00100000:3.0:1777497523.240542:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:2.0:1777497523.240547:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497523.240554:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564889472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497523.240613:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564889472:12345-0@lo:400:kworker.0 Request processed in 62us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497523.240620:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:3.0:1777497523.240643:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:3.0:1777497523.240649:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564889344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497523.240683:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564889344:12345-0@lo:400:kworker.0 Request processed in 34us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497523.240688:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:0.0:1777497523.241291:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889088 00000100:00100000:0.0:1777497523.241306:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889088 00000100:00100000:0.0:1777497523.241351:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1777497523.241359:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564888832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.241400:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564888832:12345-0@lo:400:kworker.0 Request processed in 42us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497523.241406:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1777497523.241419:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1777497523.241424:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564889088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.241452:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564889088:12345-0@lo:400:kworker.0 Request processed in 29us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497523.241458:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1777497523.241499:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564889472:0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.241511:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564888832:0@lo:400:kworker.0 00000100:00080000:0.0:1777497523.241547:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497523.241551:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497523.241553:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497523.241573:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564889088:0@lo:400:kworker.0 00000100:00100000:0.0:1777497523.241582:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564889344:0@lo:400:kworker.0 00000100:00100000:2.0:1777497523.249412:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564888960:0@lo:38:kworker.0 00000100:00100000:2.0:1777497523.249478:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497523.249509:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564889216:0@lo:38:kworker.0 00000100:00100000:2.0:1777497523.249535:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497523.249559:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564889600:0@lo:38:kworker.0 00000100:00100000:2.0:1777497523.249592:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497523.249639:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889216 00000100:00100000:2.0:1777497523.249646:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889216 00000100:00100000:2.0:1777497523.249982:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3901 00000100:00100000:2.0:1777497523.249989:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564889216:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497523.250010:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497523.250053:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564889216:12345-0@lo:38:kworker.0 Request processed in 63us (517us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497523.250059:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3901 00000100:00080000:2.0:1777497523.250118:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497523.250123:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497523.250127:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564889216:0@lo:38:kworker.0 00000100:00100000:2.0:1777497523.250151:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888704 00000100:00100000:2.0:1777497523.250155:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888704 00000100:00100000:2.0:1777497523.250176:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564888960 00000100:00100000:2.0:1777497523.250178:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564888960 00000100:00100000:2.0:1777497523.250187:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889600 00000100:00100000:2.0:1777497523.250190:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889600 00000100:00100000:2.0:1777497523.250198:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1777497523.250203:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564888704:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497523.250214:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497523.250241:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564888704:12345-0@lo:38:kworker.0 Request processed in 37us (9696us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497523.250246:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1777497523.250257:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1777497523.250260:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564888960:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497523.250277:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497523.250298:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564888960:12345-0@lo:38:kworker.0 Request processed in 37us (821us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497523.250305:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:2.0:1777497523.250315:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1777497523.250318:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564889600:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497523.250326:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497523.250360:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564889600:12345-0@lo:38:kworker.0 Request processed in 40us (767us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497523.250366:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00080000:2.0:1777497523.250391:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497523.250396:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497523.250398:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564888704:0@lo:38:kworker.0 00000100:00080000:2.0:1777497523.250405:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497523.250408:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497523.250410:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564888960:0@lo:38:kworker.0 00000100:00080000:2.0:1777497523.250417:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497523.250419:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497523.250422:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564889600:0@lo:38:kworker.0 00010000:00010000:1.0:1777497523.362304:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1777497524.030941:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546290816 offset 0 length 224: 4 00000100:00100000:2.0:1777497524.030990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497524.031036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497524.031075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497524.031351:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291072 00000100:00100000:3.0:1777497524.031361:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291072 00000100:00100000:3.0:1777497524.031437:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1159 00000100:00100000:3.0:1777497524.031446:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546291072:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497524.031510:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546291072:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497524.031516:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1159 00000100:00100000:0.0:1777497524.031564:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291200 00000100:00100000:0.0:1777497524.031570:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291200 00000100:00100000:0.0:1777497524.031608:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291328 00000100:00100000:0.0:1777497524.031611:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291328 00000100:00100000:3.0:1777497524.031623:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2467 00000100:00080000:1.0:1777497524.031697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497524.031701:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497524.031704:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497524.031833:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2468 00000100:00100000:0.0:1777497524.031843:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546291328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497524.031883:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546291328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 42us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497524.031905:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2468 00000100:00100000:3.0:1777497524.032624:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546291200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497524.032672:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546291200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1041us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497524.032680:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2467 00000100:00100000:3.0:1777497524.035362:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497524.035556:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546290944 00000100:00100000:1.0:1777497524.035566:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546290944 00000100:00100000:1.0:1777497524.035617:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1181 00000100:00100000:1.0:1777497524.035639:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546290944:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:1.0:1777497524.035664:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497524.036117:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546290944:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 452us (737us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497524.036127:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1181 00010000:00010000:1.0:1777497524.386385:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497525.282348:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497525.282619:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564889728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497525.282708:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497525.282969:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889728 00000100:00100000:3.0:1777497525.282978:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889728 00000100:00100000:3.0:1777497525.283088:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1777497525.283118:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564889728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497525.283154:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497525.283178:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564889856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497525.283208:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564889728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 111us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497525.283226:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1777497525.283231:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497525.283247:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564889856 00000100:00100000:3.0:1777497525.283251:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564889856 00000100:00100000:2.0:1777497525.283307:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564889728:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497525.283416:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497525.283421:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497525.283489:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:3.0:1777497525.283496:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564889856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497525.283512:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8651456 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497525.283544:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564889856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497525.283550:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:2.0:1777497525.283817:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564889856:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777497525.410438:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497526.442927:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497527.458466:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497528.354977:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497528.354983:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497528.354988:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497528.354996:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3652 00000100:00080000:1.0:1777497528.355002:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497528.355009:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497528.355032:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f84365180 x1863837564890112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497528.355084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497528.355088:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497528.355090:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497528.355118:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3652 00000100:00080000:1.0:1777497528.355121:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497528.355139:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497528.355152:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fc700 x1863837564890368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497528.355168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497528.355170:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497528.355172:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497528.355175:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3652 00000100:00080000:1.0:1777497528.355177:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497528.355180:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497528.355189:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8e300 x1863837564890624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497528.355208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497528.355211:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497528.355213:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497528.355216:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3652 00000100:00080000:1.0:1777497528.355218:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497528.355222:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497528.355233:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82cb1880 x1863837564891008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497528.355267:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564890496:0@lo:400:kworker.0 00000100:00100000:1.0:1777497528.355342:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497528.355383:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497528.355389:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564890240:0@lo:400:kworker.0 00000100:00100000:1.0:1777497528.355411:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497528.355460:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890496 00000100:00100000:3.0:1777497528.355571:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564890112:0@lo:38:kworker.0 00000100:00100000:3.0:1777497528.355602:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497528.355621:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564890368:0@lo:38:kworker.0 00000100:00100000:3.0:1777497528.355641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497528.355658:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564890624:0@lo:38:kworker.0 00000100:00100000:3.0:1777497528.355682:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497528.355716:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564891008:0@lo:38:kworker.0 00000100:00100000:3.0:1777497528.355737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497528.355767:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890240 00000100:00100000:3.0:1777497528.355773:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890240 00000100:00100000:3.0:1777497528.355822:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890112 00000100:00100000:3.0:1777497528.355825:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890112 00000100:00100000:3.0:1777497528.355833:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890368 00000100:00100000:3.0:1777497528.355835:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890368 00000100:00100000:3.0:1777497528.355840:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891008 00000100:00100000:3.0:1777497528.355842:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891008 00000100:00100000:3.0:1777497528.355852:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1777497528.355861:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564890240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497528.355921:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564890240:12345-0@lo:400:kworker.0 Request processed in 61us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497528.355928:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1777497528.355945:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1777497528.355949:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564890112:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497528.355968:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497528.355999:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564890112:12345-0@lo:38:kworker.0 Request processed in 48us (396us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497528.356005:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:3.0:1777497528.356017:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1777497528.356021:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564890368:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497528.356031:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497528.356053:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564890368:12345-0@lo:38:kworker.0 Request processed in 30us (411us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497528.356058:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1777497528.356069:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1777497528.356072:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564891008:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497528.356081:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497528.356133:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564891008:12345-0@lo:38:kworker.0 Request processed in 59us (395us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497528.356138:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1777497528.356162:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890624 00000100:00100000:3.0:1777497528.356166:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890624 00000100:00100000:3.0:1777497528.356182:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3902 00000100:00100000:3.0:1777497528.356186:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564890624:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497528.356203:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497528.356226:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564890624:12345-0@lo:38:kworker.0 Request processed in 38us (543us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497528.356232:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3902 00000100:00080000:3.0:1777497528.356252:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497528.356282:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564890240:0@lo:400:kworker.0 00000100:00080000:3.0:1777497528.356325:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497528.356329:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497528.356332:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564890112:0@lo:38:kworker.0 00000100:00080000:3.0:1777497528.356340:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497528.356343:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497528.356343:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564890752:0@lo:400:kworker.0 00000100:00100000:3.0:1777497528.356346:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564890368:0@lo:38:kworker.0 00000100:00080000:3.0:1777497528.356352:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497528.356355:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497528.356357:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564890624:0@lo:38:kworker.0 00000100:00080000:3.0:1777497528.356363:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497528.356366:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497528.356368:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564891008:0@lo:38:kworker.0 00000100:00100000:2.0:1777497528.356373:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497528.356394:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1777497528.356400:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564889984:0@lo:400:kworker.0 00000400:00000100:2.0:1777497528.356417:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564889984 offset 0 length 224: 4 00000100:00100000:3.0:1777497528.356419:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890752 00000100:00100000:3.0:1777497528.356422:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890752 00000100:00100000:2.0:1777497528.356438:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564890880:0@lo:400:kworker.0 00000100:00100000:3.0:1777497528.356451:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:2.0:1777497528.356455:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497528.356457:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564890752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497528.356479:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564890880 00000100:00100000:2.0:1777497528.356482:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890880 00000100:00100000:2.0:1777497528.356524:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1777497528.356531:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564890880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497528.356563:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564890880:12345-0@lo:400:kworker.0 Request processed in 34us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497528.356569:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1777497528.356597:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564890880:0@lo:400:kworker.0 00000100:00080000:2.0:1777497528.356617:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497528.356619:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497528.356657:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564890752:12345-0@lo:400:kworker.0 Request processed in 200us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497528.356669:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00100000:2.0:1777497528.356683:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564890752:0@lo:400:kworker.0 00000100:00100000:1.0:1777497528.356949:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564890496 00000100:00100000:1.0:1777497528.356998:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1777497528.357005:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564890496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497528.357046:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564890496:12345-0@lo:400:kworker.0 Request processed in 41us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497528.357052:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:1.0:1777497528.357076:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564890496:0@lo:400:kworker.0 00000100:00080000:2.0:1777497528.357145:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1777497528.485787:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497529.160497:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497529.160555:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497529.160588:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291840 00000100:00100000:0.0:1777497529.160600:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291840 00000100:00100000:0.0:1777497529.160675:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5851 00000100:00100000:0.0:1777497529.160688:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546291840:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:0.0:1777497529.160729:0:25488:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c67f 00000100:00080000:0.0:1777497529.160741:0:25488:0:(import.c:65:import_set_state_nolock()) ffff92409f60d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777497529.160800:0:25488:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969452 00000100:00100000:2.0:1777497529.160921:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291584 00000100:00100000:2.0:1777497529.160942:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291584 00000100:00100000:2.0:1777497529.160976:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1185 00000100:00100000:2.0:1777497529.160982:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546291584:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497529.161020:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497529.161092:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546291584:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 108us (610us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497529.161176:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1185 00000100:00080000:2.0:1777497529.161202:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497529.161250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:2.0:1777497529.161395:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546291456 offset 0 length 224: 4 00000100:00100000:2.0:1777497529.161420:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497529.161443:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291968 00000100:00100000:2.0:1777497529.161448:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291968 00000100:00100000:2.0:1777497529.161482:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5852 00000100:00100000:2.0:1777497529.161489:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2411:x1863837546291968:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1777497529.161506:0:25489:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c686 00000100:00080000:2.0:1777497529.161514:0:25489:0:(import.c:65:import_set_state_nolock()) ffff9240849d7000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497529.161551:0:25489:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969448 00000100:00100000:2.0:1777497529.161707:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546291968:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 219us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497529.161714:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5852 00000100:00100000:2.0:1777497529.161733:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546291712 00000100:00100000:2.0:1777497529.161737:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546291712 00000100:00100000:2.0:1777497529.161768:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1162 00000100:00100000:2.0:1777497529.161775:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546291712:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497529.163659:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546291712:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1874us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497529.163692:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1162 00010000:00010000:2.0:1777497529.163748:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497529.168957:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546291840:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 8255us (8384us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497529.168974:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5851 00010000:00010000:0.0:1777497529.169037:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497529.183489:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497529.183504:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497529.506873:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497530.402799:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564891136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497530.402862:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497530.402911:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891136 00000100:00100000:2.0:1777497530.402918:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891136 00000100:00100000:2.0:1777497530.402963:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:2.0:1777497530.402970:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564891136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497530.402997:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497530.403030:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564891136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497530.403037:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00080000:2.0:1777497530.403056:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497530.403091:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564891136:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497530.404124:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564891264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497530.404166:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497530.404207:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891264 00000100:00100000:1.0:1777497530.404212:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891264 00000100:00100000:1.0:1777497530.404249:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:1.0:1777497530.404256:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564891264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497530.404288:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497530.404324:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564891264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497530.404330:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00080000:1.0:1777497530.404353:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497530.404393:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564891264:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497530.535550:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497531.554768:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497532.578808:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497533.479646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497533.479655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497533.479661:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497533.479671:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3657 00000100:00080000:3.0:1777497533.479678:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497533.479686:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497533.479714:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8f100 x1863837564891520/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497533.479743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497533.479747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497533.479748:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497533.479751:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3657 00000100:00080000:3.0:1777497533.479756:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497533.479759:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497533.479769:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8ca80 x1863837564891776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497533.479796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497533.479799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497533.479801:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497533.479804:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3657 00000100:00080000:3.0:1777497533.479807:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497533.479825:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497533.479841:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f84365180 x1863837564892032/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497533.479866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497533.479870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497533.479871:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497533.479875:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3657 00000100:00080000:3.0:1777497533.479878:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497533.479882:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497533.479894:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bce2f480 x1863837564892416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497533.479944:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564891520:0@lo:38:kworker.0 00000100:00100000:3.0:1777497533.480031:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497533.480071:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564891776:0@lo:38:kworker.0 00000100:00100000:3.0:1777497533.480121:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497533.480138:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564892032:0@lo:38:kworker.0 00000100:00100000:3.0:1777497533.480164:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497533.480181:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564892416:0@lo:38:kworker.0 00000100:00100000:0.0:1777497533.480587:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564891392:0@lo:400:kworker.0 00000400:00000100:0.0:1777497533.480629:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564891392 offset 0 length 224: 4 00000100:00100000:0.0:1777497533.480663:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564892288:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.480691:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497533.480726:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497533.480731:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564891648:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.480751:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497533.480789:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892288 00000100:00100000:0.0:1777497533.480797:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892288 00000100:00100000:0.0:1777497533.480866:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1777497533.480876:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564892288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.480950:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564892288:12345-0@lo:400:kworker.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497533.480958:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1777497533.480984:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891520 00000100:00100000:0.0:1777497533.480987:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891520 00000100:00100000:0.0:1777497533.481010:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891776 00000100:00100000:0.0:1777497533.481013:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891776 00000100:00100000:0.0:1777497533.481025:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891648 00000100:00100000:0.0:1777497533.481026:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891648 00000100:00100000:0.0:1777497533.481051:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1777497533.481056:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564891648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481083:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564891648:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497533.481088:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1777497533.481121:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1777497533.481125:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564891520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497533.481149:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497533.481179:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564891520:12345-0@lo:38:kworker.0 Request processed in 52us (1148us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497533.481185:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:0.0:1777497533.481211:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1777497533.481216:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564891776:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497533.481226:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497533.481261:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564891776:12345-0@lo:38:kworker.0 Request processed in 44us (1167us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497533.481267:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:0.0:1777497533.481292:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497533.481297:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497533.481329:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564892160:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481357:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497533.481382:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497533.481388:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564891904:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481588:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497533.481617:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892160 00000100:00100000:0.0:1777497533.481621:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892160 00000100:00100000:0.0:1777497533.481656:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:0.0:1777497533.481662:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481701:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564892160:12345-0@lo:400:kworker.0 Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497533.481707:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000100:00080000:0.0:1777497533.481725:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497533.481758:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564892160:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481790:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564891648:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481801:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564892288:0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481821:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564891904 00000100:00100000:0.0:1777497533.481824:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564891904 00000100:00100000:0.0:1777497533.481851:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1164 00000100:00100000:0.0:1777497533.481857:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564891904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497533.481889:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564891904:12345-0@lo:400:kworker.0 Request processed in 32us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497533.481895:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1164 00000100:00080000:0.0:1777497533.481910:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497533.481935:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564891904:0@lo:400:kworker.0 00000100:00100000:3.0:1777497533.482359:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497533.482400:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497533.482497:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497533.482503:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564891520:0@lo:38:kworker.0 00000100:00080000:3.0:1777497533.482517:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497533.482521:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497533.482532:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564891776:0@lo:38:kworker.0 00000100:00100000:3.0:1777497533.482566:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892416 00000100:00100000:3.0:1777497533.482570:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892416 00000100:00100000:3.0:1777497533.482595:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1777497533.482663:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564892416:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497533.482679:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497533.482716:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564892416:12345-0@lo:38:kworker.0 Request processed in 115us (358us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497533.482722:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1777497533.482750:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892032 00000100:00100000:3.0:1777497533.482755:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892032 00000100:00100000:3.0:1777497533.482776:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3903 00000100:00100000:3.0:1777497533.482780:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564892032:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497533.482789:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497533.482810:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564892032:12345-0@lo:38:kworker.0 Request processed in 29us (2645us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497533.482815:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3903 00000100:00080000:3.0:1777497533.482840:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497533.482844:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497533.482848:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564892032:0@lo:38:kworker.0 00000100:00080000:3.0:1777497533.482856:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497533.482860:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497533.482863:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564892416:0@lo:38:kworker.0 00010000:00010000:0.0:1777497533.602297:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1777497534.281363:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546292096 offset 0 length 520: 4 00000100:00100000:1.0:1777497534.281421:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497534.281537:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497534.281587:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292224 00000100:00100000:1.0:1777497534.281600:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292224 00000100:00100000:1.0:1777497534.281674:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292352 00000100:00100000:1.0:1777497534.281678:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292352 00000100:00100000:1.0:1777497534.281731:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1165 00000100:00100000:1.0:1777497534.281743:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546292352:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497534.281850:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546292352:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 110us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497534.281859:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1165 00000100:00100000:1.0:1777497534.281884:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1189 00000100:00100000:1.0:1777497534.281888:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546292224:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:1.0:1777497534.281912:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497534.282028:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546292224:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 137us (607us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497534.282036:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1189 00000100:00080000:1.0:1777497534.282068:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00000400:0.0:1777497534.499979:0:3658:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497518/real 1777497518] req@ffff924086d0ad80 x1863837564886656/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497534 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497534.500010:0:3658:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff924086d0ad80 x1863837564886656/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497534 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497534.500021:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1777497534.500025:0:3658:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1777497534.500028:0:3658:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1777497534.500031:0:3658:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1777497534.500035:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff924086d0ad80 x1863837564886656/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497534 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497534.500043:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240af500e00 x1863837564888576/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497539 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497534.500069:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f8410f100 x1863837564889984/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497534.500078:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f83cf1880 x1863837564891392/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497549 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1777497534.500086:0:3658:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1777497534.500089:0:3658:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1777497534.500090:0:3658:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1777497534.500111:0:3658:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1777497534.500138:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564886656:0@lo:400:kworker.0 00000100:00080000:0.0:1777497534.500174:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497534.500179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1777497534.500182:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497534.500192:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3605 00000100:00080000:0.0:1777497534.500210:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497534.500250:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af501500 x1863837564892544/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497534.500271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497534.500275:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497534.500276:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497534.500279:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3662 00000100:00080000:0.0:1777497534.500282:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497534.500286:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497534.500302:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8ca80 x1863837564892672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497534.500325:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497534.500329:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497534.500330:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497534.500334:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3662 00000100:00080000:0.0:1777497534.500336:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497534.500339:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497534.500350:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8e300 x1863837564892928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497534.500368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497534.500371:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497534.500373:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497534.500376:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3662 00000100:00080000:0.0:1777497534.500378:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497534.500382:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497534.500401:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fdc00 x1863837564893184/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497534.500424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497534.500427:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497534.500429:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497534.500433:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3662 00000100:00080000:0.0:1777497534.500435:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497534.500439:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497534.500451:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d0a680 x1863837564893568/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497534.500478:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564892800:0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500542:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497534.500577:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497534.500583:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564893440:0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500608:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497534.500636:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892800 00000100:00100000:0.0:1777497534.500642:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892800 00000100:00100000:0.0:1777497534.500686:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1777497534.500695:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500743:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564892800:12345-0@lo:400:kworker.0 Request processed in 50us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497534.500750:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:0.0:1777497534.500793:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564892800:0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500811:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564893312:0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500832:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497534.500858:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497534.500864:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564893056:0@lo:400:kworker.0 00000100:00100000:0.0:1777497534.500883:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497534.500992:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564891392:0@lo:400:kworker.0 00000100:00100000:1.0:1777497534.501000:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564889984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497534.501031:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893056 00000100:00100000:1.0:1777497534.501035:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893056 00000100:00100000:1.0:1777497534.501069:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1777497534.501076:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564893056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497534.501139:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564893056:12345-0@lo:400:kworker.0 Request processed in 64us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497534.501145:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:1.0:1777497534.501173:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564893056:0@lo:400:kworker.0 00000100:00100000:3.0:1777497534.501459:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564892544:0@lo:250:kworker.0 00000400:00000100:3.0:1777497534.501484:0:3656:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564892544 offset 0 length 520: 4 00000100:00100000:3.0:1777497534.501519:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564892672:0@lo:38:kworker.0 00000100:00100000:3.0:1777497534.501541:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497534.501568:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564892928:0@lo:38:kworker.0 00000100:00100000:3.0:1777497534.501587:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497534.501613:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564893184:0@lo:38:kworker.0 00000100:00100000:3.0:1777497534.501635:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497534.501653:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564893568:0@lo:38:kworker.0 00000100:00100000:3.0:1777497534.501671:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497534.501699:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893440 00000100:00100000:3.0:1777497534.501703:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893440 00000100:00100000:3.0:1777497534.501725:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893312 00000100:00100000:3.0:1777497534.501728:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893312 00000100:00100000:3.0:1777497534.501740:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:3.0:1777497534.501745:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564893440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497534.501780:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564893440:12345-0@lo:400:kworker.0 Request processed in 35us (1172us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497534.501785:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:3.0:1777497534.501797:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1777497534.501802:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564893312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497534.501825:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564893312:12345-0@lo:400:kworker.0 Request processed in 23us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497534.501829:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1777497534.501846:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893184 00000100:00100000:3.0:1777497534.501849:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893184 00000100:00100000:3.0:1777497534.501865:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1777497534.501868:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564893184:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497534.501892:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497534.501938:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564893184:12345-0@lo:38:kworker.0 Request processed in 68us (301us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497534.501944:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3904 00000100:00100000:3.0:1777497534.501963:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892672 00000100:00100000:3.0:1777497534.501966:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892672 00000100:00100000:3.0:1777497534.501982:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564892928 00000100:00100000:3.0:1777497534.501984:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564892928 00000100:00100000:3.0:1777497534.501992:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893568 00000100:00100000:3.0:1777497534.501995:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893568 00000100:00100000:3.0:1777497534.502003:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1777497534.502007:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564892672:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497534.502016:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497534.502039:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564892672:12345-0@lo:38:kworker.0 Request processed in 31us (497us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497534.502044:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:3.0:1777497534.502054:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1777497534.502058:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564892928:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497534.502066:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497534.502088:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564892928:12345-0@lo:38:kworker.0 Request processed in 28us (499us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497534.502121:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:3.0:1777497534.502133:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1777497534.502137:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564893568:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497534.502146:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497534.502169:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564893568:12345-0@lo:38:kworker.0 Request processed in 30us (497us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497534.502179:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:3.0:1777497534.502218:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564893440:0@lo:400:kworker.0 00000100:00080000:3.0:1777497534.502256:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497534.502262:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497534.502265:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564892672:0@lo:38:kworker.0 00000100:00080000:3.0:1777497534.502273:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497534.502276:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497534.502278:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564892928:0@lo:38:kworker.0 00000100:00080000:3.0:1777497534.502285:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497534.502288:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497534.502291:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564893184:0@lo:38:kworker.0 00000100:00080000:3.0:1777497534.502298:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497534.502300:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497534.502303:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564893568:0@lo:38:kworker.0 00000100:00100000:3.0:1777497534.502331:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564888576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497534.505683:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564893312:0@lo:400:kworker.0 00000001:00100000:3.0:1777497534.507160:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:2.0:1777497534.507160:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497534.507170:0:9460:0:(genops.c:906:class_export_put()) final put ffff9240849d2800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:2.0:1777497534.507170:0:8391:0:(genops.c:906:class_export_put()) final put ffff9240bcc6c000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:0.0:1777497534.511280:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcc6c000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0000 00000020:00000080:0.0:1777497534.511345:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d2800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0001 00000020:00000080:0.0:1777497534.511363:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409f60d800 for lustre-OST0000 00000020:00000080:0.0:1777497534.511368:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240849d7000 for lustre-OST0001 00010000:00010000:0.0:1777497534.629020:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497535.522627:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497535.522648:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564893696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497535.522724:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497535.524182:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893696 00000100:00100000:3.0:1777497535.524193:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893696 00000100:00100000:3.0:1777497535.524265:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1777497535.524275:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564893696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497535.524320:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497535.524383:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564893696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497535.524403:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1777497535.524461:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564893696:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497535.529127:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497535.535469:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497535.535494:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564893824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497535.535561:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497535.535651:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893824 00000100:00100000:3.0:1777497535.535673:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893824 00000100:00100000:3.0:1777497535.535735:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1777497535.535745:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564893824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497535.535775:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1777497535.535926:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497535.536027:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564893824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 283us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497535.536036:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1777497535.536158:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564893824:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497535.650742:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497536.674800:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497537.699670:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497538.722306:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1777497538.900445:0:85470:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1777497538.900450:0:85470:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1777497538.900452:0:85470:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1777497538.900575:0:85470:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff923f82ab5800 00000020:01000004:2.0:1777497538.900590:0:85470:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1777497538.900604:0:85470:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1777497538.900618:0:85470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff923f84b099c0) 00000020:00000080:2.0:1777497538.900636:0:85470:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1777497539.029921:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1777497539.031010:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.045013:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.046340:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.046978:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.048476:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.048909:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.049211:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.049490:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.049785:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1777497539.050056:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.050376:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.050671:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.050951:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.051246:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1777497539.054000:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.054352:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.054647:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.054904:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.055178:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.055678:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.056084:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.056714:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.056930:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.057229:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.057437:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.057726:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.057941:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.058261:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.058915:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.059231:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.059443:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.059735:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1777497539.059971:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.060236:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.060442:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.060729:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1777497539.060949:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1777497539.061447:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.061763:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.062259:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.062473:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.062780:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1777497539.062997:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.063339:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1777497539.065262:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1777497539.065914:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1777497539.067268:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1777497539.067944:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497539.068839:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497539.073350:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1777497539.074202:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1777497539.074880:0:85470:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:1.0:1777497539.077370:0:85470:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1777497539.079057:0:85470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1777497539.079066:0:85470:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:1.0:1777497539.079081:0:85470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c7dd 00000020:01000004:1.0:1777497539.079088:0:85470:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1777497539.079115:0:85470:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1777497539.079120:0:85470:0:(tgt_mount.c:101:server_register_mount()) register mount ffff923f82ab5800 from MGS 00000020:01000004:1.0:1777497539.079124:0:85470:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1777497539.079135:0:85470:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9240aecd8000) 00000020:00000080:1.0:1777497539.079147:0:85470:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:1.0:1777497539.079228:0:85470:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f82ab5800 from MGS, refs=2 00080000:01000000:1.0:1777497539.079233:0:85470:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:1.0:1777497539.079237:0:85470:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c7eb 00010000:00010000:1.0:1777497539.079395:0:85470:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:1.0:1777497539.086792:0:85470:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1777497539.096270:0:85474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1777497539.096353:0:85470:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1777497539.096404:0:85470:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777497539.097519:0:85470:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1777497539.097788:0:85470:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1777497539.097940:0:85470:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1777497539.097947:0:85470:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1777497539.104806:0:85470:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1777497539.104818:0:85470:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1777497539.108520:0:85470:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1777497539.108534:0:85470:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1777497539.109542:0:85470:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1777497539.109648:0:85470:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1777497539.109650:0:85470:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1777497539.109653:0:85470:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1777497539.109659:0:85470:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 66, was 0): CONNECTING 00000100:00100000:2.0:1777497539.109665:0:85470:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:0.0:1777497539.390308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497539.390494:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292480 00000100:00100000:3.0:1777497539.390504:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292480 00000100:00100000:3.0:1777497539.390551:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1193 00000100:00100000:3.0:1777497539.390559:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546292480:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497539.390593:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497539.390700:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546292480:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 140us (402us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497539.390723:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1193 00000100:00100000:1.0:1777497539.393973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497539.394481:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292608 00000100:00100000:3.0:1777497539.394491:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292608 00000100:00100000:3.0:1777497539.394564:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1168 00000100:00080000:1.0:1777497539.394744:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497539.394837:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546292608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497539.394927:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546292608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 94us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497539.400979:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1168 00000100:00080000:3.0:1777497539.618452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497539.618461:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1777497539.618463:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497539.618467:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497539.618472:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497539.618480:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1777497539.618484:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497539.618498:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497539.618542:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af500e00 x1863837564893952/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497539.618602:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497539.618606:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497539.618608:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497539.618612:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1777497539.618614:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497539.618617:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497539.618642:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fdc00 x1863837564894208/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497539.618667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497539.618670:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497539.618672:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497539.618675:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1777497539.618677:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497539.618681:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497539.618694:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d0ad80 x1863837564894464/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497539.618715:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497539.618730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497539.618732:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497539.618735:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3663 00000100:00080000:3.0:1777497539.618737:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497539.618741:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497539.618751:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bf480 x1863837564894848/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497539.618958:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564894720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619022:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497539.619059:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497539.619064:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564894080:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619088:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497539.619134:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564894336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619167:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497539.619196:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497539.619202:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564894592:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619222:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497539.619258:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894720 00000100:00100000:3.0:1777497539.619265:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894720 00000100:00100000:3.0:1777497539.619314:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894592 00000100:00100000:3.0:1777497539.619317:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894592 00000100:00100000:3.0:1777497539.619338:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1777497539.619348:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564894720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619400:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564894720:12345-0@lo:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497539.619406:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1777497539.619421:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1777497539.619428:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564894592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619459:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564894592:12345-0@lo:400:kworker.0 Request processed in 32us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497539.619464:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1777497539.619482:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894080 00000100:00100000:3.0:1777497539.619486:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894080 00000100:00100000:3.0:1777497539.619510:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894336 00000100:00100000:3.0:1777497539.619512:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894336 00000100:00100000:3.0:1777497539.619528:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1777497539.619533:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564894080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619561:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564894080:12345-0@lo:400:kworker.0 Request processed in 28us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497539.619566:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:3.0:1777497539.619584:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:3.0:1777497539.619590:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564894336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619617:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564894336:12345-0@lo:400:kworker.0 Request processed in 28us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497539.619622:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00080000:3.0:1777497539.619640:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497539.619643:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497539.619645:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497539.619672:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564894592:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619681:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564894336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619708:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564894080:0@lo:400:kworker.0 00000100:00100000:3.0:1777497539.619716:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564894720:0@lo:400:kworker.0 00000100:00100000:0.0:1777497539.620372:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564893952:0@lo:38:kworker.0 00000100:00100000:0.0:1777497539.620412:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497539.620445:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564894208:0@lo:38:kworker.0 00000100:00100000:0.0:1777497539.620462:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497539.620481:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564894464:0@lo:38:kworker.0 00000100:00100000:0.0:1777497539.620501:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497539.620522:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564894848:0@lo:38:kworker.0 00000100:00100000:0.0:1777497539.620541:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497539.620589:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564893952 00000100:00100000:0.0:1777497539.620595:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564893952 00000100:00100000:0.0:1777497539.620619:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894208 00000100:00100000:0.0:1777497539.620622:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894208 00000100:00100000:0.0:1777497539.620632:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894848 00000100:00100000:0.0:1777497539.620634:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894848 00000100:00100000:0.0:1777497539.620644:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1777497539.620649:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564893952:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497539.620668:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497539.620701:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564893952:12345-0@lo:38:kworker.0 Request processed in 51us (288us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497539.620707:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1777497539.620721:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1777497539.620724:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564894208:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497539.620734:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497539.620755:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564894208:12345-0@lo:38:kworker.0 Request processed in 29us (291us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497539.620772:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1777497539.620783:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:0.0:1777497539.620788:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564894848:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497539.620797:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497539.620820:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564894848:12345-0@lo:38:kworker.0 Request processed in 32us (279us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497539.620825:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00080000:0.0:1777497539.620856:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497539.620862:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497539.620865:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564893952:0@lo:38:kworker.0 00000100:00080000:0.0:1777497539.620875:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497539.620878:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497539.620880:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564894208:0@lo:38:kworker.0 00000100:00080000:0.0:1777497539.620887:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497539.620889:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497539.620892:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564894848:0@lo:38:kworker.0 00000100:00100000:2.0:1777497539.621131:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894464 00000100:00100000:2.0:1777497539.621137:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894464 00000100:00100000:2.0:1777497539.621170:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3905 00000100:00100000:2.0:1777497539.621175:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564894464:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497539.621196:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497539.621239:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564894464:12345-0@lo:38:kworker.0 Request processed in 63us (736us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497539.621245:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3905 00000100:00080000:1.0:1777497539.621320:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497539.621325:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497539.621328:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564894464:0@lo:38:kworker.0 00010000:00010000:0.0:1777497539.746627:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497540.643088:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564894976:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497540.643185:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497540.643309:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564894976 00000100:00100000:3.0:1777497540.643317:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564894976 00000100:00100000:3.0:1777497540.643368:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1777497540.643377:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564894976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497540.643418:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497540.643470:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564894976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497540.643477:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1777497540.643713:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564894976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497540.644259:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497540.644273:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564895104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497540.644311:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497540.644821:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895104 00000100:00100000:0.0:1777497540.644827:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895104 00000100:00100000:0.0:1777497540.644868:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1777497540.644877:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564895104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497540.644910:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497540.645241:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564895104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 365us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497540.645261:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:2.0:1777497540.649671:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564895104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497540.771296:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497541.798685:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497542.818490:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497543.845569:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497544.509263:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497544.509314:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497544.509348:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497544.509443:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292992 00000100:00100000:0.0:1777497544.509453:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292992 00000100:00100000:0.0:1777497544.509520:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292864 00000100:00100000:0.0:1777497544.509524:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292864 00000100:00100000:0.0:1777497544.509542:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1171 00000100:00100000:0.0:1777497544.509553:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546292992:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497544.509620:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546292992:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.509628:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1171 00000100:00100000:0.0:1777497544.509643:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1197 00000100:00100000:0.0:1777497544.509648:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546292864:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497544.509669:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497544.509695:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546292864:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 45us (346us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497544.509701:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1197 00000100:00080000:1.0:1777497544.510341:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497544.513909:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546292736 00000100:00100000:3.0:1777497544.513924:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546292736 00000100:00100000:3.0:1777497544.513986:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:3.0:1777497544.513995:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2411:x1863837546292736:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:3.0:1777497544.514038:0:85476:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 95f1b493-372d-4153-ad35-48e1115be1b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 3673 last 0 00000020:00000080:3.0:1777497544.514069:0:85476:0:(genops.c:1406:class_connect()) connect: client 95f1b493-372d-4153-ad35-48e1115be1b1, cookie 0x3e357265691c7f2 00000100:00080000:3.0:1777497544.514266:0:85476:0:(import.c:65:import_set_state_nolock()) ffff9240a6372000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497544.514388:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+4:2411:x1863837546292736:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 391us (5071us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.514397:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00080000:3.0:1777497544.738254:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.738264:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1777497544.738267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.738271:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497544.738276:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497544.738284:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1777497544.738290:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497544.738297:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497544.738344:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bfb80 x1863837564895232/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497544.738405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.738409:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497544.738411:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497544.738414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1777497544.738417:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497544.738421:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497544.738437:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50be680 x1863837564895488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497544.738489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.738493:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497544.738495:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497544.738498:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1777497544.738501:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497544.738505:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497544.738532:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50bf480 x1863837564895744/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497544.738556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.738559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497544.738561:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497544.738564:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3668 00000100:00080000:3.0:1777497544.738567:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497544.738571:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497544.738583:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d0ad80 x1863837564896128/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497544.738616:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564895616:0@lo:400:kworker.0 00000100:00100000:3.0:1777497544.738705:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.738748:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497544.738754:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564895872:0@lo:400:kworker.0 00000100:00100000:3.0:1777497544.738796:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.738835:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895616 00000100:00100000:3.0:1777497544.738842:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895616 00000100:00100000:3.0:1777497544.738898:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1172 00000100:00100000:3.0:1777497544.738916:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564895616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497544.738967:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564895616:12345-0@lo:400:kworker.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.738974:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1172 00000100:00080000:3.0:1777497544.738997:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497544.739029:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564895616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497544.739153:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564896000:0@lo:400:kworker.0 00000100:00100000:0.0:1777497544.739183:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497544.739221:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497544.739227:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564895360:0@lo:400:kworker.0 00000100:00100000:0.0:1777497544.739249:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497544.739275:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895360 00000100:00100000:0.0:1777497544.739279:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895360 00000100:00100000:0.0:1777497544.739311:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1777497544.739325:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564895360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497544.739359:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564895360:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.739366:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00080000:0.0:1777497544.739383:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497544.739400:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564895360:0@lo:400:kworker.0 00000100:00100000:1.0:1777497544.739653:0:3656:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497534/real 1777497534] req@ffff9240af501500 x1863837564892544/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497544 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497544.739672:0:3656:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9240af501500 x1863837564892544/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497544 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497544.739685:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564895232:0@lo:38:kworker.0 00000100:00100000:1.0:1777497544.739711:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497544.739738:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564895488:0@lo:38:kworker.0 00000100:00100000:1.0:1777497544.739760:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497544.739773:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564895744:0@lo:38:kworker.0 00000100:00100000:1.0:1777497544.739794:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497544.739811:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564896128:0@lo:38:kworker.0 00000100:00100000:1.0:1777497544.739830:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497544.739844:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.739857:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1777497544.739863:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564892544:0@lo:250:kworker.0 00000100:00100000:1.0:1777497544.739887:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895744 00000100:00100000:1.0:1777497544.739891:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895744 00000100:00100000:1.0:1777497544.739921:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1777497544.739926:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564895744:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497544.739945:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497544.739977:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564895744:12345-0@lo:38:kworker.0 Request processed in 50us (181us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497544.739983:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3906 00000100:00100000:1.0:1777497544.740002:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895232 00000100:00100000:1.0:1777497544.740006:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895232 00000100:00100000:1.0:1777497544.740020:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895488 00000100:00100000:1.0:1777497544.740023:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895488 00000100:00100000:1.0:1777497544.740032:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896128 00000100:00100000:1.0:1777497544.740034:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896128 00000100:00100000:1.0:1777497544.740044:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1777497544.740048:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564895232:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497544.740059:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497544.740080:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564895232:12345-0@lo:38:kworker.0 Request processed in 30us (368us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497544.740086:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:1.0:1777497544.740118:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1777497544.740122:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564895488:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497544.740132:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497544.740166:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564895488:12345-0@lo:38:kworker.0 Request processed in 42us (405us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497544.740172:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1777497544.740184:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:1.0:1777497544.740193:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564896128:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497544.740211:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497544.740238:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564896128:12345-0@lo:38:kworker.0 Request processed in 50us (408us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497544.740243:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00080000:1.0:1777497544.740267:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.740271:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497544.740274:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564895232:0@lo:38:kworker.0 00000100:00080000:1.0:1777497544.740281:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.740284:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497544.740287:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564895488:0@lo:38:kworker.0 00000100:00080000:1.0:1777497544.740293:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.740296:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497544.740298:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564895744:0@lo:38:kworker.0 00000100:00080000:1.0:1777497544.740305:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.740307:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497544.740310:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564896128:0@lo:38:kworker.0 00000100:00080000:1.0:1777497544.740337:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497544.740341:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1777497544.740343:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497544.740347:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3663 00000100:00080000:1.0:1777497544.740350:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1777497544.740354:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497544.740372:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d80e00 x1863837564896256/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00020000:1.0:1777497544.740409:0:3656:0:(client.c:1390:ptlrpc_import_delay_req()) @@@ invalidate in flight req@ffff9240a6d80e00 x1863837564896256/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl Rpc:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497544.743254:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564895872 00000100:00100000:3.0:1777497544.743269:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564895872 00000100:00100000:3.0:1777497544.743336:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896000 00000100:00100000:3.0:1777497544.743339:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896000 00000100:00100000:3.0:1777497544.743361:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:3.0:1777497544.743370:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564895872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497544.743453:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c97d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564895872:12345-0@lo:400:kworker.0 Request processed in 83us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.743460:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:3.0:1777497544.743633:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:3.0:1777497544.743640:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564896000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497544.743672:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564896000:12345-0@lo:400:kworker.0 Request processed in 33us (4488us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.743679:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:3.0:1777497544.743722:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564895872:0@lo:400:kworker.0 10000000:01000000:2.0:1777497544.743890:0:85470:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1777497544.743903:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.743914:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.743921:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1777497544.743937:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.743945:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e94c00/0x3e357265691c417 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c41e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.743962:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.743969:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.743974:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.743978:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.743981:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691c37d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c384 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.743989:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.743995:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744013:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744017:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744020:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c399 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3a0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744029:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744035:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744040:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744044:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744047:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e95a00/0x3e357265691c3c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3ca expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744054:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744061:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744067:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744070:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744073:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c3d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3d8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744081:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744123:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744129:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744161:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744166:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eeea00/0x3e357265691c3ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3f4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744175:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744181:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744185:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744188:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744191:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef400/0x3e357265691c3fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c402 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744198:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744203:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744207:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744210:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744213:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924086e94200/0x3e357265691c425 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c42c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744234:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744241:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744246:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744249:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744252:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c38b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c392 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744263:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744268:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744272:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497544.744275:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744278:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691c3a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3ae expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744287:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744293:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744297:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497544.744306:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744310:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691c3b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3bc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744317:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744322:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744326:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497544.744329:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744331:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dc400/0x3e357265691c3df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c3e6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.744337:0:85470:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497544.744342:0:85470:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497544.744346:0:85470:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497544.744348:0:85470:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497544.744351:0:85470:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dce00/0x3e357265691c409 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c410 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497544.747158:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497544.747168:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497544.747241:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564896000:0@lo:400:kworker.0 00000100:00080000:2.0:1777497544.778147:0:85470:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 67, was 0): CONNECTING 00000100:00080000:2.0:1777497544.778159:0:85470:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:1.0:1777497544.778323:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497544.778377:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-5) 00000100:00100000:1.0:1777497544.778391:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:0:1863837564896256:0@lo:250:kworker.0 00000100:00080000:3.0:1777497544.780951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497544.780961:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1777497544.780966:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497544.780974:0:8:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3674 00000100:00080000:3.0:1777497544.780980:0:8:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497544.781004:0:8:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497544.781039:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d08a80 x1863837564896384/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497544.781156:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564896384:0@lo:250:kworker.0 00000100:00100000:1.0:1777497544.781228:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497544.783275:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896384 00000100:00100000:0.0:1777497544.783289:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896384 00000100:00100000:0.0:1777497544.783329:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1777497544.783337:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3656:x1863837564896384:12345-0@lo:250:kworker.0 00010000:00080000:0.0:1777497544.783366:0:85478:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3674 last 0 00000020:00000080:0.0:1777497544.783397:0:85478:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691c7f9 00000100:00080000:0.0:1777497544.783507:0:85478:0:(import.c:65:import_set_state_nolock()) ffff9240bb682000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497544.788705:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837564896384:12345-0@lo:250:kworker.0 Request processed in 5357us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.788719:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1777497544.791841:0:3656:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 25 00000100:00080000:1.0:1777497544.791856:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:1.0:1777497544.791865:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1777497544.791871:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1777497544.791876:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1777497544.791880:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1777497544.791958:0:3656:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1777497544.791974:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564896384:0@lo:250:kworker.0 00000100:00080000:2.0:1777497544.792046:0:85470:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1777497544.792057:0:85470:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1777497544.792121:0:85470:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1777497544.792149:0:85470:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1777497544.792254:0:85470:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1777497544.792287:0:85470:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1777497544.792291:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1777497544.792292:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497544.792294:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497544.792295:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497544.792296:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497544.792297:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497544.792298:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497544.792300:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497544.792301:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497544.792303:0:85470:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497544.792305:0:85470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1777497544.792307:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497544.792309:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497544.792310:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497544.792311:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497544.792312:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497544.792313:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497544.792314:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497544.792315:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497544.792316:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497544.792317:0:85470:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497544.792350:0:85470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1777497544.792368:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564896512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777497544.792426:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497544.792458:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a900 going to sleep for 11 seconds 00000020:01000000:3.0:1777497544.792697:0:8:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:3.0:1777497544.792709:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777497544.792712:0:8:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497544.792713:0:8:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497544.792714:0:8:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497544.792715:0:8:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497544.792716:0:8:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497544.792717:0:8:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497544.792718:0:8:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497544.792719:0:8:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497544.792720:0:8:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497544.792755:0:8:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497544.792762:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777497544.792763:0:8:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497544.792764:0:8:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497544.792765:0:8:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497544.792766:0:8:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497544.792767:0:8:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497544.792768:0:8:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497544.792769:0:8:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497544.792770:0:8:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497544.792771:0:8:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497544.792792:0:8:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497544.792796:0:8:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1777497544.792798:0:8:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497544.792799:0:8:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497544.792800:0:8:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497544.792801:0:8:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497544.792802:0:8:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497544.792803:0:8:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497544.792804:0:8:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497544.792805:0:8:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497544.792806:0:8:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497544.792816:0:8:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1777497544.792846:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564896896:0@lo:253:kworker.0 00000100:00100000:3.0:1777497544.792877:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.792897:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497544.792903:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564896768:0@lo:253:kworker.0 00000100:00100000:3.0:1777497544.792930:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.792957:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896512 00000100:00100000:3.0:1777497544.792963:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896512 00000100:00100000:3.0:1777497544.792992:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896896 00000100:00100000:3.0:1777497544.792995:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896896 00000100:00100000:3.0:1777497544.793003:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896768 00000100:00100000:3.0:1777497544.793005:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896768 00000100:00100000:3.0:1777497544.793015:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1777497544.793022:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:85470:x1863837564896512:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1777497544.793062:0:85476:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1777497544.793065:0:85476:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1777497544.793068:0:85476:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 00000100:00100000:3.0:1777497544.793148:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497544.793157:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564896640:0@lo:253:kworker.0 00000100:00100000:3.0:1777497544.793189:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.793218:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564896640 00000100:00100000:3.0:1777497544.793222:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564896640 00000100:00100000:3.0:1777497544.793236:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777497544.793241:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564896896:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497544.793256:0:85478:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:3.0:1777497544.793382:0:85480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1777497544.793454:0:85476:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 108 20000000:01000000:3.0:1777497544.803898:0:85481:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1777497544.803907:0:85481:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1777497544.803910:0:85481:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1777497544.803913:0:85481:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1777497544.804335:0:85481:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1777497544.804515:0:85476:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1777497544.804548:0:85476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1777497544.804590:0:85478:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497544.805275:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85470:x1863837564896512:12345-0@lo:253:mount.lustre.0 Request processed in 12247us (12843us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.805291:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1777497544.805345:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1777497544.805358:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3658:x1863837564896768:12345-0@lo:253:kworker.0 20000000:01000000:1.0:1777497544.805387:0:85476:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:2.0:1777497544.806890:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564896512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497544.806907:0:85470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497544.806910:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497544.806911:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497544.806913:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497544.806914:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497544.806915:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497544.806916:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497544.806931:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497544.806932:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497544.806934:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497544.806935:0:85470:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1777497544.806957:0:85470:0:(tgt_mount.c:101:server_register_mount()) register mount ffff923f82ab5800 from lustre-MDT0000 10000000:01000000:2.0:1777497544.806988:0:85470:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1777497544.806991:0:85470:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497544.807000:0:85470:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff923f82ab5800 10000000:01000000:2.0:1777497544.807004:0:85470:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777497544.807009:0:85470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff923f82ab5800 10000000:01000000:2.0:1777497544.807012:0:85470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777497544.807015:0:85470:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff923f82ab5800 from 1 10000000:01000000:2.0:1777497544.807018:0:85470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497544.807052:0:85470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.807063:0:85470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.807072:0:85470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497544.807128:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497544.807191:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497544.807233:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497544.807999:0:85477:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1777497544.808011:0:85477:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1777497544.809531:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897024 00000100:00100000:1.0:1777497544.809553:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897024 00000100:00100000:3.0:1777497544.809702:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1777497544.809713:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564896640:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497544.809742:0:85482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777497544.812028:0:85478:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497544.812042:0:85478:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1777497544.812229:0:85480:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1777497544.812235:0:85480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1777497544.812258:0:85480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812275:0:85480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497544.812284:0:85480:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000050660s 00010000:00010000:3.0:1777497544.812288:0:85480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812293:0:85480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812313:0:85480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812319:0:85480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812325:0:85480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497544.812328:0:85480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812335:0:85480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812363:0:85480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812370:0:85480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497544.812376:0:85480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691c807 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497544.812404:0:85476:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497544.812961:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564896896:12345-0@lo:253:kworker.0 Request processed in 19714us (20078us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.812972:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1777497544.813013:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1777497544.813024:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:85470:x1863837564897024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497544.813036:0:85478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497544.813050:0:85478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38400/0x3e357265691c80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c800 expref: -99 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.813071:0:85478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38400/0x3e357265691c80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c800 expref: 7 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.813080:0:85478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38400/0x3e357265691c80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c800 expref: 7 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.813115:0:85478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38400, rc 0) 00000100:00100000:1.0:1777497544.813161:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85470:x1863837564897024:12345-0@lo:101:mount.lustre.0 Request processed in 141us (5969us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.813168:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1777497544.813218:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497544.813233:0:85470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.813242:0:85470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497544.813273:0:85470:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000020:01000004:3.0:1777497544.813346:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497544.813349:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497544.813350:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497544.813352:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497544.813353:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497544.813354:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497544.813356:0:3658:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497544.813357:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497544.813359:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497544.813362:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564896896:0@lo:253:kworker.0 00010000:00010000:1.0:1777497544.816130:0:85470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.816155:0:85470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497544.816163:0:85470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777497544.816169:0:85470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777497544.816176:0:85470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff923f82ab5800 10000000:01000000:1.0:1777497544.816180:0:85470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777497544.816185:0:85470:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777497544.816188:0:85470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497544.816227:0:85470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.816235:0:85470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497544.816245:0:85470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497544.816270:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897152:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497544.816347:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497544.816380:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c268540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497544.816570:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897152 00000100:00100000:0.0:1777497544.816579:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897152 00000100:00100000:0.0:1777497544.816630:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1777497544.816639:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85470:x1863837564897152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497544.816652:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497544.816666:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9600/0x3e357265691c81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c815 expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.816707:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9600/0x3e357265691c81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c815 expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.816717:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9600/0x3e357265691c81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c815 expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.816725:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9600, rc 0) 00000100:00100000:0.0:1777497544.816776:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564897152:12345-0@lo:101:mount.lustre.0 Request processed in 138us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.816782:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497544.816810:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497544.816824:0:85470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497544.816832:0:85470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497544.816912:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497544.816939:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497544.816961:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497544.817433:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897280 00000100:00100000:1.0:1777497544.817439:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897280 00000100:00100000:1.0:1777497544.817463:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1777497544.817471:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564897280:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497544.817614:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564897280:12345-0@lo:501:mount.lustre.0 Request processed in 144us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.817620:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1777497544.817735:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497544.817769:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897408:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497544.817810:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.825176:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897408 00000100:00100000:3.0:1777497544.825190:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897408 00000100:00100000:3.0:1777497544.825250:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777497544.825259:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564897408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497544.825634:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67ab40 going to sleep for 11 seconds 20000000:01000000:1.0:1777497544.825792:0:85476:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497544.825812:0:85476:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1777497544.825818:0:85482:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1777497544.826273:0:85480:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497544.826279:0:85480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497544.826303:0:85480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826328:0:85480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497544.826340:0:85480:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000061840s 00010000:00010000:0.0:1777497544.826345:0:85480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826351:0:85480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826357:0:85480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826363:0:85480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826381:0:85480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497544.826386:0:85480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826393:0:85480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826407:0:85480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826416:0:85480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.826422:0:85480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8600/0x3e357265691c823 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497544.828866:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:3658:x1863837564896768:12345-0@lo:253:kworker.0 Request processed in 23502us (35923us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.828882:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1777497544.829370:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777497544.829373:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777497544.829375:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497544.829376:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497544.829377:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497544.829379:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497544.829380:0:3658:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777497544.829382:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497544.829383:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777497544.829387:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564896768:0@lo:253:kworker.0 00000100:00100000:1.0:1777497544.829748:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564897408:12345-0@lo:503:mount.lustre.0 Request processed in 4489us (11936us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.829757:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1777497544.830364:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564897408:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497544.831885:0:85483:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85483:1863837564897536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497544.831969:0:85483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.832011:0:85483:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497544.832159:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897536 00000100:00100000:0.0:1777497544.832167:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897536 00000100:00100000:0.0:1777497544.832219:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777497544.832228:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85483:x1863837564897536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497544.834248:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85483:x1863837564897536:12345-0@lo:502:llog_process_th.0 Request processed in 2012us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.834273:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 20000000:01000000:2.0:1777497544.839901:0:85482:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777497544.839917:0:85482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1777497544.840532:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564896640:12345-0@lo:253:kworker.0 Request processed in 30816us (47336us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497544.840549:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:2.0:1777497544.840601:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1777497544.840603:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497544.840605:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497544.840606:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497544.840607:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497544.840609:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497544.840610:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497544.840612:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497544.840613:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1777497544.840616:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564896640:0@lo:253:kworker.0 20000000:01000000:0.0:1777497544.840734:0:85480:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497544.840739:0:85480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497544.840760:0:85480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840777:0:85480:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497544.840786:0:85480:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000061840s 00010000:00010000:0.0:1777497544.840791:0:85480:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840798:0:85480:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840805:0:85480:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840812:0:85480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840819:0:85480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497544.840824:0:85480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840831:0:85480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840844:0:85480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840869:0:85480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497544.840876:0:85480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9a00/0x3e357265691c82a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497544.843619:0:85483:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85483:1863837564897536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497544.843668:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497544.843684:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497544.843686:0:85483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1777497544.843693:0:85483:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1777497544.843696:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497544.843714:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9240a62eb380) 00000020:00000080:3.0:1777497544.843741:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:3.0:1777497544.843749:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1777497544.843844:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:3.0:1777497544.843851:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c838 00000020:00000080:3.0:1777497544.844071:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1777497544.844076:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497544.844080:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497544.844081:0:85483:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1777497544.844084:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497544.844087:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497544.844089:0:85483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1777497544.844122:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497544.844131:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9240a62ecd40) 00000020:00000080:3.0:1777497544.844153:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:3.0:1777497544.844158:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1777497544.844160:0:85483:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1777497544.844163:0:85483:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1777497544.844168:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1777497544.844212:0:85483:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f82ab5800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1777497544.844224:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9240a62e8000) 00000020:00000080:3.0:1777497544.844244:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:3.0:1777497544.844313:0:85483:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:3.0:1777497544.844318:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c84d 00000020:00000080:3.0:1777497544.844408:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1777497544.844414:0:85483:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1777497544.844418:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691c854 00080000:01000000:3.0:1777497544.844423:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:3.0:1777497544.844427:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c85b 00010000:00010000:0.0:1777497544.866249:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497544.936753:0:85483:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1777497544.936884:0:85483:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6d03493e-1218-49f3-bdd0-b10716c402e0 idx: 0 lr: 98784247817 srv lr: 103079215104 lx: 0 gen 22 00000001:00080000:2.0:1777497544.936923:0:85483:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 103079215104 lx: 0 gen 21 00000001:00000004:2.0:1777497544.936940:0:85483:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 103079215104 00000001:00080000:2.0:1777497544.937025:0:85483:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1777497544.937075:0:85483:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9240bb67a240: xid 1863837546285440, transno 103079215109, client gen 22, slot idx 0 00000001:00080000:2.0:1777497544.937085:0:85483:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9240bb67a780: xid 1863837546285696, transno 103079215110, client gen 22, slot idx 1 00000020:00000080:2.0:1777497544.937761:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff923f84b0cd40) 00000020:00000080:2.0:1777497544.937780:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1777497544.937842:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:2.0:1777497544.937847:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c877 00000020:00000080:2.0:1777497544.938640:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497544.958937:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691c87e 00000020:00000080:1.0:1777497544.961925:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777497544.961938:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497544.961947:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.961949:0:85483:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777497544.961952:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497544.961955:0:85483:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777497544.961957:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.961958:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.961960:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497544.961962:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.961964:0:85483:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497544.961966:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497544.961971:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.961973:0:85483:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777497544.961978:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777497544.962037:0:85483:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777497544.962060:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497544.962063:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.962064:0:85483:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777497544.962067:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497544.962070:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.962072:0:85483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777497544.962074:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497544.962122:0:85483:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:1.0:1777497544.962161:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497544.962177:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240aecdb380) 00000020:00000080:1.0:1777497544.962199:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1777497544.962215:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497544.962275:0:85483:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777497544.962281:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777497544.962287:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c88c 00010000:00080000:1.0:1777497544.963969:0:85483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92409c763800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497544.966835:0:85483:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:1.0:1777497544.975700:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497544.975713:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1777497544.975751:0:85483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1777497544.975771:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c893 00000100:00080000:1.0:1777497544.975780:0:85483:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497544.975787:0:85483:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff92409c763800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497544.975822:0:85483:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d82a00 x1863837564897664/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497544.975858:0:85483:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1777497544.975939:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497544.975943:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.975945:0:85483:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1777497544.975948:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497544.975951:0:85483:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1777497544.975952:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.975954:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.975955:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497544.975958:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.975959:0:85483:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497544.975962:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1777497544.975967:0:85483:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1777497544.975981:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.975983:0:85483:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1777497544.975986:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497544.975990:0:85483:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1777497544.976012:0:85483:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1777497544.976015:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497544.976026:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9240aecd99c0) 00000020:00000080:1.0:1777497544.976042:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1777497544.976046:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497544.976130:0:85483:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1777497544.976148:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:1.0:1777497544.976153:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c8a1 00010000:00080000:1.0:1777497544.976185:0:85483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924086e27000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00000100:00100000:3.0:1777497544.976456:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564897664:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777497544.976522:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497544.976592:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897664 00000100:00100000:3.0:1777497544.976600:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897664 00000100:00100000:3.0:1777497544.976625:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1777497544.976632:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564897664:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1777497544.976657:0:8406:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3674 last 0 00000020:00000080:3.0:1777497544.976684:0:8406:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c8a8 00000004:00100000:3.0:1777497544.976697:0:8406:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497544.976790:0:8406:0:(import.c:65:import_set_state_nolock()) ffff92409c46d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497544.976840:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564897664:12345-0@lo:38:llog_process_th.0 Request processed in 207us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497544.976847:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3907 00000100:00100000:3.0:1777497544.976881:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1777497544.976888:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:3.0:1777497544.976895:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1777497544.976899:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1777497544.976901:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c763800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1777497544.976907:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564897664:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1777497544.977157:0:85483:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1777497544.977625:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497544.977636:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564897792:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497544.979678:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497544.979734:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897792 00000100:00100000:1.0:1777497544.979741:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897792 00000100:00100000:1.0:1777497544.979782:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1777497544.979792:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564897792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497544.979826:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497544.979866:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564897792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497544.979873:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3908 00000100:00100000:1.0:1777497544.979920:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564897792:0@lo:41:osp-pre-1-0.0 00000040:01000000:0.0:1777497544.980953:0:85483:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1777497544.980984:0:85483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1777497544.981061:0:85483:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 23, last_idx 24 00000040:00080000:0.0:1777497544.982467:0:85483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497544.982496:0:85483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].25, 64 off9792 00000040:00080000:0.0:1777497544.982633:0:85483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x64:0x0].1, 64 off8256 00000040:00080000:0.0:1777497544.983776:0:85489:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1777497544.983783:0:85489:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1777497544.983935:0:85489:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1777497544.983952:0:85489:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x60:0x0] at index 24 of catalog [0x1:0x2:0x0] 00000040:00080000:0.0:1777497544.984058:0:85489:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1777497544.984061:0:85489:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1777497544.985076:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497544.985589:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777497544.985632:0:85483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1777497544.985652:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c8af 00000100:00080000:1.0:1777497544.985662:0:85483:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497544.985669:0:85483:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff924086e27000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497544.985713:0:85483:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d82a00 x1863837564897920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497544.985745:0:85483:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1777497544.985803:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497544.985807:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.985809:0:85483:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1777497544.985812:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497544.985815:0:85483:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1777497544.985816:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.985817:0:85483:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497544.985819:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497544.985822:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.985823:0:85483:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497544.985825:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1777497544.985829:0:85483:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1777497544.985833:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497544.985834:0:85483:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1777497544.985837:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497544.985841:0:85483:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1777497544.985861:0:85483:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1777497544.985864:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497544.985875:0:85483:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9240aecdcd40) 00000020:00000080:1.0:1777497544.985891:0:85483:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1777497544.985896:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497544.985950:0:85483:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1777497544.985956:0:85483:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:1.0:1777497544.985960:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691c8bd 00010000:00080000:1.0:1777497544.985989:0:85483:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f81a02000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497544.986239:0:85483:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1777497544.986306:0:85483:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777497544.986478:0:85483:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1777497544.986564:0:85483:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 23, last_idx 24 00000100:00100000:2.0:1777497544.988223:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564897920:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497544.988302:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497544.988512:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564897920 00000100:00100000:0.0:1777497544.988521:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564897920 00000100:00100000:0.0:1777497544.988558:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5853 00000100:00100000:0.0:1777497544.988565:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3656:x1863837564897920:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497544.988597:0:8717:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3674 last 0 00000020:00000080:0.0:1777497544.988623:0:8717:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c8c4 00002000:00100000:0.0:1777497544.988650:0:8717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff923f826cd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777497544.988655:0:8717:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777497544.988657:0:8717:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497544.988729:0:8717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777497544.988755:0:8717:0:(import.c:65:import_set_state_nolock()) ffff923f826ca000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497544.988819:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564897920:12345-0@lo:8:llog_process_th.0 Request processed in 253us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.988827:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5853 00000100:00100000:2.0:1777497544.990192:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497544.990212:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777497544.990221:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777497544.990226:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1777497544.990229:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1777497544.990248:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777497544.990255:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564897920:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1777497544.990336:0:85489:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777497544.990410:0:85489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3674331314572ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777497544.990415:0:85489:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1777497544.990494:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497544.990505:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564898048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497544.990556:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497544.990597:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898048 00000100:00100000:0.0:1777497544.990602:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898048 00000100:00100000:0.0:1777497544.990647:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1777497544.990655:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564898048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497544.990681:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497544.990719:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564898048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497544.990725:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00080000:0.0:1777497544.990745:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497544.990768:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564898048:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1777497544.994960:0:85483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497544.994994:0:85483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].25, 64 off9792 00000040:00080000:0.0:1777497544.995168:0:85483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x66:0x0].1, 64 off8256 00000004:00080000:2.0:1777497544.996304:0:85471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:0.0:1777497544.997648:0:85491:0:(llog.c:800:llog_process_thread()) index: 24, lh_last_idx: 25 synced_idx: 0 lgh_last_idx: 25 00000040:00080000:0.0:1777497544.997655:0:85491:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1777497544.997833:0:85491:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000040:00080000:0.0:1777497544.997850:0:85491:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x62:0x0] at index 24 of catalog [0x1:0x5:0x0] 00000040:00080000:0.0:1777497544.997953:0:85491:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 25 synced_idx: 25 lgh_last_idx: 25 00000040:00080000:0.0:1777497544.997956:0:85491:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1777497545.003844:0:85483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497545.003859:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1777497545.003901:0:85483:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1777497545.003921:0:85483:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c8cb 00000100:00080000:2.0:1777497545.003932:0:85483:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777497545.003939:0:85483:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff923f81a02000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497545.003976:0:85483:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ac700 x1863837564898176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497545.004009:0:85483:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1777497545.004061:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497545.004078:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497545.004080:0:85483:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1777497545.004084:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:3.0:1777497545.004217:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564898176:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1777497545.004292:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.004534:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898176 00000100:00100000:0.0:1777497545.004543:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898176 00000100:00100000:0.0:1777497545.004570:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5854 00000100:00100000:0.0:1777497545.004577:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3656:x1863837564898176:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497545.004607:0:25485:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3674 last 0 00000020:00000080:0.0:1777497545.004637:0:25485:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691c8d2 00002000:00100000:0.0:1777497545.004650:0:25485:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff923f826ce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1777497545.004655:0:25485:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1777497545.004658:0:25485:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497545.004734:0:25485:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1777497545.004754:0:25485:0:(import.c:65:import_set_state_nolock()) ffff923f826ca800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497545.004804:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564898176:12345-0@lo:8:llog_process_th.0 Request processed in 226us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.004811:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5854 00000020:00000080:2.0:1777497545.004893:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497545.004895:0:85483:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1777497545.004901:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1777497545.004903:0:85483:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1777497545.004906:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497545.004908:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497545.004909:0:85483:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1777497545.004912:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497545.004914:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497545.004915:0:85483:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1777497545.004919:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1777497545.004949:0:85483:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85483:1863837564898304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497545.004999:0:85483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497545.005026:0:85483:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568e780 going to sleep for 11 seconds 00000100:00100000:3.0:1777497545.005130:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1777497545.005149:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1777497545.005155:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1777497545.005160:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1777497545.005162:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81a02000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1777497545.005178:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:3.0:1777497545.005184:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564898176:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497545.006313:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497545.006474:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898304 00000100:00100000:0.0:1777497545.006483:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898304 00000100:00100000:0.0:1777497545.006523:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777497545.006532:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85483:x1863837564898304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497545.006681:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85483:x1863837564898304:12345-0@lo:502:llog_process_th.0 Request processed in 150us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.006688:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:0.0:1777497545.006741:0:85491:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777497545.006794:0:85491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3674347698843ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777497545.006799:0:85491:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1777497545.007594:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564898432:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497545.007644:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497545.007718:0:85483:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85483:1863837564898304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777497545.007755:0:85483:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497545.007762:0:85483:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497545.007764:0:85483:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1777497545.007768:0:85483:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:1.0:1777497545.008525:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898432 00000100:00100000:1.0:1777497545.008533:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898432 00000100:00100000:1.0:1777497545.008598:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1777497545.008607:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564898432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497545.008634:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497545.008688:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564898432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.008694:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000020:01000000:1.0:1777497545.008721:0:85470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1777497545.008749:0:85470:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1777497545.008764:0:85470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.008776:0:85470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497545.008784:0:85470:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff923f82ab5800 from 1 10000000:01000000:1.0:1777497545.008787:0:85470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497545.008818:0:85470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.008826:0:85470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.008836:0:85470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.008853:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898560:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497545.008901:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.008929:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.008958:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898560 00000100:00100000:1.0:1777497545.008962:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898560 00000100:00100000:1.0:1777497545.008985:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777497545.008992:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:85470:x1863837564898560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.009001:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497545.009014:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c8d9 expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.009035:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c8d9 expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.009045:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c8d9 expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.009054:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39200, rc 0) 00000100:00100000:1.0:1777497545.009082:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564898560:12345-0@lo:101:mount.lustre.0 Request processed in 90us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.009125:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1777497545.009172:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.009185:0:85470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.009194:0:85470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.009710:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898688:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1777497545.009754:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.009774:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.009794:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898688 00000100:00100000:1.0:1777497545.009798:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898688 00000100:00100000:1.0:1777497545.009824:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777497545.009830:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564898688:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1777497545.009844:0:85478:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1777497545.009861:0:85478:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1777497545.009865:0:85478:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1777497545.009867:0:85478:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1777497545.009870:0:85478:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 111 00000100:00100000:1.0:1777497545.009934:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564898688:12345-0@lo:256:mount.lustre.0 Request processed in 104us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.009941:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777497545.009975:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898688:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1777497545.010603:0:85470:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497545.010617:0:85470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010628:0:85470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497545.010635:0:85470:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f82ab5800 from 1 10000000:01000000:1.0:1777497545.010638:0:85470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777497545.010665:0:85470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010672:0:85470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010689:0:85470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.010705:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497545.010735:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.010751:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.010777:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898816 00000100:00100000:1.0:1777497545.010781:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898816 00000100:00100000:1.0:1777497545.010806:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777497545.010813:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:85470:x1863837564898816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.010822:0:85478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497545.010832:0:85478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38c00/0x3e357265691c8ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c8e7 expref: -99 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010850:0:85478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38c00/0x3e357265691c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c8e7 expref: 9 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010859:0:85478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38c00/0x3e357265691c8ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c8e7 expref: 9 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010865:0:85478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38c00, rc 0) 00000100:00100000:1.0:1777497545.010893:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564898816:12345-0@lo:101:mount.lustre.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.010899:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777497545.010937:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.010947:0:85470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.010966:0:85470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.011017:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.011038:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.011049:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.011061:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564898944 00000100:00100000:1.0:1777497545.011064:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564898944 00000100:00100000:1.0:1777497545.011083:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1777497545.011089:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564898944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.011240:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564898944:12345-0@lo:501:mount.lustre.0 Request processed in 150us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.011247:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1777497545.011278:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564898944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.011303:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497545.011339:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.011351:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b5661cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.011363:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899072 00000100:00100000:1.0:1777497545.011366:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899072 00000100:00100000:1.0:1777497545.011385:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777497545.011390:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564899072:12345-0@lo:503:mount.lustre.0 00000100:00080000:2.0:1777497545.011695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497545.012195:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564898432:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1777497545.016183:0:85471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1777497545.016757:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564899072:12345-0@lo:503:mount.lustre.0 Request processed in 5359us (5411us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.016772:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777497545.016884:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899072:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497545.021627:0:85493:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85493:1863837564899200:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497545.021709:0:85493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497545.021797:0:85493:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.032340:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899200 00000100:00100000:1.0:1777497545.032355:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899200 00000100:00100000:1.0:1777497545.032411:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777497545.032421:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85493:x1863837564899200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.033038:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85493:x1863837564899200:12345-0@lo:502:llog_process_th.0 Request processed in 616us (11326us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.033047:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1777497545.033496:0:85493:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85493:1863837564899200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777497545.033532:0:85493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497545.033542:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497545.033545:0:85493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1777497545.033552:0:85493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff923f82ab5800 00000020:00000080:0.0:1777497545.033555:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777497545.033563:0:85493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497545.033565:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497545.033567:0:85493:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1777497545.033569:0:85493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497545.033571:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497545.033572:0:85493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1777497545.033576:0:85493:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff923f82ab5800 00000020:00000080:0.0:1777497545.033578:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1777497545.033669:0:85493:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85493:1863837564899328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497545.033717:0:85493:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.035239:0:85493:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408ad1b780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.047560:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899328 00000100:00100000:1.0:1777497545.047575:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899328 00000100:00100000:1.0:1777497545.047632:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777497545.047642:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85493:x1863837564899328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.047796:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85493:x1863837564899328:12345-0@lo:502:llog_process_th.0 Request processed in 155us (14078us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.047803:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777497545.047874:0:85493:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85493:1863837564899328:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497545.047908:0:85493:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497545.047916:0:85493:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497545.047918:0:85493:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1777497545.047922:0:85493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1777497545.047988:0:85470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:1.0:1777497545.048012:0:85470:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777497545.048024:0:85470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048036:0:85470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497545.048141:0:85470:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1777497545.048144:0:85470:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff923f82ab5800 10000000:01000000:1.0:1777497545.048146:0:85470:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff923f82ab5800 10000000:01000000:1.0:1777497545.048150:0:85470:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777497545.048155:0:85470:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f82ab5800 from 1 10000000:01000000:1.0:1777497545.048158:0:85470:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497545.048186:0:85470:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048195:0:85470:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048216:0:85470:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.048236:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497545.048271:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.048298:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.048321:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899456 00000100:00100000:1.0:1777497545.048325:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899456 00000100:00100000:1.0:1777497545.048347:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1777497545.048353:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564899456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.048363:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497545.048375:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39400/0x3e357265691c8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c8f5 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048394:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39400/0x3e357265691c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c8f5 expref: 10 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048414:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39400/0x3e357265691c8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c8f5 expref: 10 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048422:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39400, rc 0) 00000100:00100000:1.0:1777497545.048450:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564899456:12345-0@lo:101:mount.lustre.0 Request processed in 97us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.048456:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1777497545.048488:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497545.048499:0:85470:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.048507:0:85470:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.048552:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.048573:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.048586:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.048598:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899584 00000100:00100000:1.0:1777497545.048602:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899584 00000100:00100000:1.0:1777497545.048621:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497545.048627:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564899584:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.048713:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564899584:12345-0@lo:501:mount.lustre.0 Request processed in 85us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.048719:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497545.048748:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497545.048783:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497545.048814:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.048825:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.048837:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899712 00000100:00100000:1.0:1777497545.048841:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899712 00000100:00100000:1.0:1777497545.048861:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497545.048867:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564899712:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497545.048933:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564899712:12345-0@lo:503:mount.lustre.0 Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.048938:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497545.048976:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564899712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497545.051524:0:85496:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564899840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497545.051602:0:85496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.051636:0:85496:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d44180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.051686:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899840 00000100:00100000:1.0:1777497545.051693:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899840 00000100:00100000:1.0:1777497545.051739:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1777497545.051747:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564899840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.051862:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed00050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564899840:12345-0@lo:502:llog_process_th.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.051868:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1777497545.051922:0:85496:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564899840:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1777497545.051975:0:85496:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1777497545.051989:0:85496:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9240a6bf0000) 00000020:00000080:1.0:1777497545.052012:0:85496:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1777497545.056585:0:85496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f82ab5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497545.056593:0:85496:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f82ab5800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497545.056596:0:85496:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f82ab5800 4 00010000:00080000:1.0:1777497545.056642:0:85496:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f839d0000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497545.063920:0:85496:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1777497545.064032:0:85496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1777497545.064075:0:85496:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1777497545.065868:0:85496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691c90a 00000100:00080000:1.0:1777497545.065885:0:85496:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497545.065891:0:85496:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff923f839d0000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497545.065927:0:85496:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d80e00 x1863837564899968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497545.065976:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564899968:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497545.066046:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.068309:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564899968 00000100:00100000:1.0:1777497545.068324:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564899968 00000100:00100000:1.0:1777497545.068364:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1777497545.068372:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564899968:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497545.068467:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564899968:12345-0@lo:38:llog_process_th.0 Request processed in 94us (2420us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497545.068475:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:1.0:1777497545.068515:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497545.068523:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497545.068540:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497545.068544:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564899968:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1777497545.068585:0:85496:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1777497545.072407:0:85496:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564900096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.072489:0:85496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.072527:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900096 00000100:00100000:1.0:1777497545.072541:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900096 00000100:00100000:1.0:1777497545.072586:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777497545.072595:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564900096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.072717:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed02450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564900096:12345-0@lo:502:llog_process_th.0 Request processed in 122us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.072724:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777497545.072771:0:85496:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.072797:0:85496:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564900096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.072840:0:85496:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564900224:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.072870:0:85496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.072893:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900224 00000100:00100000:1.0:1777497545.072897:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900224 00000100:00100000:1.0:1777497545.072922:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1777497545.072928:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564900224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497545.072986:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed03450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85496:x1863837564900224:12345-0@lo:502:llog_process_th.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.072992:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1777497545.073022:0:85496:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565f00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.073034:0:85496:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85496:1863837564900224:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497545.073050:0:85496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1777497545.073146:0:85470:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1777497545.073173:0:85470:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497545.073186:0:85470:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497545.073197:0:85470:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777497545.073254:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1777497545.073256:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497545.073257:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497545.073258:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497545.073260:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497545.073261:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497545.073262:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497545.073263:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497545.073266:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497545.073267:0:85470:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1777497545.073271:0:85470:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1777497545.073273:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1777497545.073274:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497545.073275:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497545.073276:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497545.073277:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497545.073278:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497545.073279:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497545.073280:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497545.073281:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497545.073282:0:85470:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1777497545.073294:0:85470:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1777497545.073303:0:85470:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564900352:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1777497545.073332:0:85470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.073345:0:85470:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091565b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497545.073367:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900352 00000100:00100000:1.0:1777497545.073371:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900352 00000100:00100000:1.0:1777497545.073391:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777497545.073397:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:85470:x1863837564900352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1777497545.073416:0:85477:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1777497545.073429:0:85477:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1777497545.090178:0:85477:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497545.090192:0:85477:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1777497545.090246:0:85480:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497545.090251:0:85480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497545.090278:0:85480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090318:0:85480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c8d9 expref: 10 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090326:0:85480:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090371:0:85480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 10 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090387:0:85480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 10 pid: 85477 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497545.090405:0:85480:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85480:1863837564900480:0@lo:104: 00000100:00100000:0.0:1777497545.090471:0:85480:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.090513:0:85480:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d44180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497545.090539:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900480 00000100:00100000:0.0:1777497545.090547:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900480 00000100:00100000:0.0:1777497545.090594:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1777497545.090603:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:85480:x1863837564900480:12345-0@lo:104: 00010000:00010000:0.0:1777497545.090615:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090659:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497545.090664:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:85480:x1863837564900480:12345-0@lo:104: Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.090670:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:0.0:1777497545.090694:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497545.090700:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090714:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38a00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497545.090718:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090726:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497545.090732:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497545.090738:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497545.090766:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090772:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497545.090792:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090798:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38a00/0x3e357265691c8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691c8e0 expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090816:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497545.090818:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497545.090819:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497545.090838:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564900608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497545.090865:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.090911:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900608 00000100:00100000:0.0:1777497545.090914:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900608 00010000:00010000:0.0:1777497545.090930:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 11 pid: 85477 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497545.090963:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1777497545.090970:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:3658:x1863837564900608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497545.090982:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497545.090986:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 11 pid: 85477 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.090995:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 11 pid: 85477 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091010:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091017:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497545.091028:0:6501:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000778964s 00010000:00010000:0.0:1777497545.091032:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091037:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091043:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091049:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091053:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497545.091063:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091070:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091078:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091088:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497545.091172:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:3658:x1863837564900608:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.091180:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1777497545.091217:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564900608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497545.091248:0:85480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39200/0x3e357265691c8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691c8d9 expref: 10 pid: 85477 timeout: 3774 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497545.091257:0:85480:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:85480:1863837564900480:0@lo:104: 00010000:00010000:0.0:1777497545.091269:0:85480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091277:0:85480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091282:0:85480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.091288:0:85480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9a00/0x3e357265691c911 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497545.096286:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed00850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:85470:x1863837564900352:12345-0@lo:253:mount.lustre.0 Request processed in 22881us (22945us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.096313:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1777497545.096810:0:85470:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:85470:1863837564900352:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497545.096826:0:85470:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497545.096829:0:85470:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497545.096831:0:85470:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497545.096832:0:85470:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497545.096834:0:85470:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497545.096835:0:85470:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497545.096836:0:85470:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497545.096837:0:85470:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497545.096839:0:85470:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497545.096840:0:85470:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497545.096841:0:85470:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1777497545.096859:0:85470:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1777497545.116709:0:85470:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:0.0:1777497545.116993:0:85470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1777497545.117545:0:85502:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777497545.117926:0:85470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1777497545.118231:0:85502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497545.120810:0:85502:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1777497545.120905:0:85502:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:3.0:1777497545.121556:0:85501:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:3.0:1777497545.121562:0:85501:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000100:00100000:0.0:1777497545.121700:0:85503:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900736:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497545.121767:0:85503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.121803:0:85503:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497545.121857:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900736 00000100:00100000:3.0:1777497545.121863:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900736 00000100:00100000:3.0:1777497545.121914:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3909 00000100:00100000:3.0:1777497545.121922:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900736:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497545.121996:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900736:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497545.122004:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3909 00000040:01000000:2.0:1777497545.122440:0:85470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1777497545.122477:0:85470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1777497545.122908:0:85470:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1777497545.122914:0:85470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1777497545.122943:0:85470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777497545.123959:0:85470:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1777497545.124569:0:85470:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1777497545.124607:0:85470:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1777497545.124691:0:85470:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1777497545.129623:0:85503:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900736:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1777497545.129673:0:85503:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1777497545.129726:0:85503:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497545.129785:0:85503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.129828:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900864 00000100:00100000:0.0:1777497545.129834:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900864 00000100:00100000:0.0:1777497545.129875:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3910 00000100:00100000:0.0:1777497545.129884:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900864:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497545.129997:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900864:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 113us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.130005:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3910 00000100:00100000:0.0:1777497545.130030:0:85503:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861edb40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497545.130043:0:85503:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900864:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497545.130143:0:85503:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900992:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497545.130169:0:85503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497545.130183:0:85503:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861edb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497545.130359:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564900992 00000100:00100000:3.0:1777497545.130364:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564900992 00000100:00100000:3.0:1777497545.130401:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3911 00000100:00100000:3.0:1777497545.130409:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900992:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497545.130459:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:85503:x1863837564900992:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 51us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497545.130466:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3911 00000100:00100000:0.0:1777497545.130620:0:85503:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:85503:1863837564900992:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1777497545.130670:0:85503:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497545.133037:0:85503:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1777497545.133165:0:85503:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1777497545.133171:0:85503:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00080000:10000000:2.0:1777497545.135632:0:85470:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4c:0x0] (8/32) registered 00010000:00080000:2.0:1777497545.137968:0:85470:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 103079215110 00010000:00080000:0.0:1777497545.141871:0:85504:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 85504 00010000:02000000:0.0:1777497545.142004:0:85504:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1777497545.142008:0:85504:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1777497545.142012:0:85504:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:3.0:1777497545.142662:0:85470:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1777497545.142683:0:85470:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1777497545.142717:0:85470:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:3.0:1777497545.142744:0:85470:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1777497545.143903:0:85470:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777497545.145526:0:85470:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1777497545.663340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497545.663722:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293120 00000100:00100000:2.0:1777497545.663733:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293120 00000100:00100000:2.0:1777497545.663829:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1777497545.663840:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+4:41987:x1863837546293120:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497545.663858:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497545.663882:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b34600/0x3e357265691c918 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c161 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.663927:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b34600/0x3e357265691c918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c161 expref: 5 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.663939:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b34600/0x3e357265691c918 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c161 expref: 5 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.663948:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34600, rc 0) 00000100:00100000:2.0:1777497545.664013:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed01450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546293120:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 175us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497545.664020:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:1.0:1777497545.677722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497545.678030:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293248 00000100:00100000:2.0:1777497545.678042:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293248 00000100:00100000:2.0:1777497545.678139:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:2.0:1777497545.678150:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546293248:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:2.0:1777497545.678177:0:85476:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:2.0:1777497545.678203:0:85476:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1777497545.678207:0:85476:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:2.0:1777497545.678210:0:85476:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:2.0:1777497545.678213:0:85476:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:2.0:1777497545.678215:0:85476:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:2.0:1777497545.682396:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed03050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546293248:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 4241us (4676us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497545.682409:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1777497545.696247:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497545.696293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497545.697675:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293376 00000100:00100000:0.0:1777497545.697687:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293376 00000100:00100000:0.0:1777497545.697741:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1202 00000100:00100000:0.0:1777497545.697750:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546293376:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 00010000:00080000:0.0:1777497545.697783:0:64885:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '6d03493e-1218-49f3-bdd0-b10716c402e0' at ffff9240bcc6c000, cookie 0x3e357265691c862 00010000:00080000:0.0:1777497545.697790:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp recovering/t103079215111 exp ffff9240bcc6c000 cur 3675 last 1777497544 00010000:02000400:0.0:1777497545.697799:0:64885:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:0.0:1777497545.697805:0:64885:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1777497545.697825:0:64885:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1777497545.697954:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240b5398000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497545.698026:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546293376:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 Request processed in 275us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.698034:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1202 00000100:00100000:0.0:1777497545.698211:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293504 00000100:00100000:0.0:1777497545.698216:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293504 00000100:00100000:0.0:1777497545.698248:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:0.0:1777497545.698255:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546293504:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497545.698265:0:85478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497545.698282:0:85478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9400/0x3e357265691c91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c168 expref: -99 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.698324:0:85478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9400/0x3e357265691c91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c168 expref: 6 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.698335:0:85478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9400/0x3e357265691c91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c168 expref: 6 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497545.698344:0:85478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9400, rc 0) 00000100:00100000:0.0:1777497545.698388:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed01850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546293504:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 134us (2094us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.698395:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1777497545.703741:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497545.704062:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546286592 00000100:00100000:3.0:1777497545.704073:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546286592 00000100:00100000:3.0:1777497545.704154:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1203 00000100:00100000:3.0:1777497545.704165:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546286592:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00080000:3.0:1777497545.704185:0:65418:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 103079215111, current: 103079215111, replaying 00000100:00100000:3.0:1777497545.704279:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546286592:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 117us (549us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497545.704286:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1203 00000100:00100000:1.0:1777497545.705860:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497545.705948:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293632 00000100:00100000:2.0:1777497545.705957:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293632 00000100:00100000:2.0:1777497545.706005:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:2.0:1777497545.706013:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546293632:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497545.706238:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed03c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546293632:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 225us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497545.706245:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00010000:00080000:2.0:1777497545.706765:0:85504:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1777497545.713493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497545.714200:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293760 00000100:00100000:0.0:1777497545.714212:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293760 00000100:00100000:0.0:1777497545.714266:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:0.0:1777497545.714276:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546293760:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497545.714449:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed00450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546293760:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 175us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.714458:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1777497545.725334:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497545.732892:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546293888 00000100:00100000:2.0:1777497545.732909:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546293888 00000100:00100000:2.0:1777497545.736194:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1777497545.736221:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546293888:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497545.736242:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497545.736262:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b34e00/0x3e357265691c926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c16f expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.736292:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b34e00/0x3e357265691c926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c16f expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.736303:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b34e00/0x3e357265691c926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c16f expref: 8 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497545.736662:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34e00, rc 0) 00000100:00100000:2.0:1777497545.736804:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed01c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546293888:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 597us (11718us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497545.736814:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:1.0:1777497545.749502:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497545.749870:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294016 00000100:00100000:0.0:1777497545.749881:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294016 00000100:00100000:0.0:1777497545.749991:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1777497545.750002:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546294016:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497545.750196:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546294016:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 196us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497545.750205:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:1.0:1777497545.759123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497545.759203:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294144 00000100:00100000:3.0:1777497545.759213:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294144 00000100:00100000:3.0:1777497545.759288:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1777497545.759298:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546294144:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497545.759429:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546294144:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 133us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497545.759436:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:2.0:1777497545.766189:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564901120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497545.766264:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497545.766322:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901120 00000100:00100000:2.0:1777497545.766330:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901120 00000100:00100000:2.0:1777497545.766384:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1777497545.766407:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564901120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497545.766430:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497545.766472:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564901120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497545.766477:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:2.0:1777497545.766524:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564901120:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497545.774836:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497545.774859:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564901248:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497545.774922:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497545.775080:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901248 00000100:00100000:1.0:1777497545.775088:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901248 00000100:00100000:1.0:1777497545.775170:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:1.0:1777497545.775179:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564901248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497545.775205:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497545.775249:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564901248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497545.775257:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:2.0:1777497545.776511:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564901248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497545.781834:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497545.781869:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294272 00000100:00100000:3.0:1777497545.781880:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294272 00000100:00100000:3.0:1777497545.781934:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1777497545.783640:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546294272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497545.783696:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497545.783720:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691c92d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c176 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497545.783752:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691c92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c176 expref: 9 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497545.783762:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeec00/0x3e357265691c92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c176 expref: 9 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497545.783772:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:3.0:1777497545.783843:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546294272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 1900us (2018us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497545.783852:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:2.0:1777497545.791520:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497545.791669:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294400 00000100:00100000:0.0:1777497545.791705:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294400 00000100:00100000:0.0:1777497545.791763:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1777497545.791773:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546294400:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497545.791887:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546294400:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 115us (376us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497545.791895:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00010000:00010000:2.0:1777497545.891770:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1777497546.665433:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777497546.665440:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff923f82ab5800 from 112 10000000:01000000:1.0:1777497546.665446:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497546.665498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.665510:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.665541:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.665568:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.665637:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.665687:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.665769:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901376 00000100:00100000:3.0:1777497546.665776:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901376 00000100:00100000:3.0:1777497546.665833:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777497546.665842:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837564901376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.665855:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.665868:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef200/0x3e357265691c93b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c934 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.665890:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef200/0x3e357265691c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c934 expref: 10 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.665900:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef200/0x3e357265691c93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c934 expref: 10 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.665909:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef200, rc 0) 00000100:00100000:3.0:1777497546.665965:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564901376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.665972:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1777497546.666141:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.666155:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.666164:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.666218:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.666249:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.666261:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.666341:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901504 00000100:00100000:0.0:1777497546.666346:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901504 00000100:00100000:0.0:1777497546.666382:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1777497546.666389:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564901504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777497546.666404:0:85476:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777497546.666421:0:85476:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777497546.666424:0:85476:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 112 00000100:00100000:0.0:1777497546.666496:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564901504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.666503:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1777497546.666608:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497546.666652:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497546.666657:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.666665:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497546.666674:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497546.666676:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:1.0:1777497546.666683:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497546.666701:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.666709:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.666717:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.666730:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.666753:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.666781:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.666832:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901632 00000100:00100000:3.0:1777497546.666836:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901632 00000100:00100000:3.0:1777497546.666865:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777497546.666870:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564901632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.666878:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.666886:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefa00/0x3e357265691c949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c942 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.666900:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefa00/0x3e357265691c949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c942 expref: 11 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.666908:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefa00/0x3e357265691c949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c942 expref: 11 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.666914:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefa00, rc 0) 00000100:00100000:3.0:1777497546.666947:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564901632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.666952:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1777497546.667047:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.667057:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.667064:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.667144:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.667168:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.667183:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.667240:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901760 00000100:00100000:0.0:1777497546.667244:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901760 00000100:00100000:0.0:1777497546.667271:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1777497546.667277:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564901760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.667381:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564901760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.667387:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1777497546.668174:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.668211:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.668257:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.668294:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.668363:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564901888 00000100:00100000:3.0:1777497546.668368:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564901888 00000100:00100000:3.0:1777497546.668401:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777497546.668408:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564901888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.668502:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564901888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.668509:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1777497546.670268:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564901888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497546.671273:0:85564:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1777497546.671438:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1777497546.671465:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497546.671474:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.671500:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497546.671510:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497546.671512:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 109 10000000:01000000:0.0:1777497546.671515:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497546.671552:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.671559:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.671569:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.671594:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.671656:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.671702:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.672355:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902016 00000100:00100000:1.0:1777497546.672363:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902016 00000100:00100000:1.0:1777497546.672421:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1777497546.672431:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564902016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.672446:0:85476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497546.672461:0:85476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38a00/0x3e357265691c957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c950 expref: -99 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.672486:0:85476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38a00/0x3e357265691c957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c950 expref: 12 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.672495:0:85476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38a00/0x3e357265691c957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c950 expref: 12 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.672504:0:85476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38a00, rc 0) 00000100:00100000:1.0:1777497546.672558:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564902016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.672565:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1777497546.679468:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.679508:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.679522:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.679610:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902144:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.679672:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.679735:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.679966:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902144 00000100:00100000:3.0:1777497546.679974:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902144 00000100:00100000:3.0:1777497546.680020:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777497546.680030:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564902144:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777497546.680049:0:85477:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777497546.680067:0:85477:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777497546.680070:0:85477:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:3.0:1777497546.680073:0:85477:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:3.0:1777497546.680075:0:85477:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:3.0:1777497546.680078:0:85477:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 112 00000100:00100000:3.0:1777497546.680191:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564902144:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 162us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.680198:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1777497546.680600:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902144:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1777497546.680684:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777497546.680691:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.680700:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497546.680709:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1777497546.680711:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1777497546.680714:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497546.680739:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.680746:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.680754:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.680781:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.680810:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.680841:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.680899:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902272 00000100:00100000:1.0:1777497546.680905:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902272 00000100:00100000:1.0:1777497546.680943:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1777497546.680951:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564902272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.680961:0:85476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497546.680974:0:85476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38600/0x3e357265691c965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c95e expref: -99 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.680993:0:85476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38600/0x3e357265691c965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c95e expref: 13 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.681012:0:85476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38600/0x3e357265691c965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c95e expref: 13 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.681019:0:85476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38600, rc 0) 00000100:00100000:1.0:1777497546.681060:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.681066:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1777497546.681708:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.681724:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.681734:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.681814:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.681846:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.681877:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.681930:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902400 00000100:00100000:1.0:1777497546.681936:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902400 00000100:00100000:1.0:1777497546.681971:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1777497546.681978:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.682143:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84aca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.682150:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777497546.682216:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.682243:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.682294:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497546.682329:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f860040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.682684:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902528 00000100:00100000:1.0:1777497546.682689:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902528 00000100:00100000:1.0:1777497546.682723:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1777497546.682730:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.684002:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1267us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.684012:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777497546.684156:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497546.688870:0:85565:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1777497546.690030:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1777497546.690062:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1777497546.690084:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.690142:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497546.690152:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1777497546.690155:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:1.0:1777497546.690158:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1777497546.690198:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.690205:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.690215:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.690239:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.690316:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.690354:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.690791:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902656 00000100:00100000:3.0:1777497546.690799:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902656 00000100:00100000:3.0:1777497546.690856:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1777497546.690865:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564902656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.690879:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.690893:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee600/0x3e357265691c973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c96c expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.690928:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee600/0x3e357265691c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c96c expref: 14 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.690938:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee600/0x3e357265691c973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c96c expref: 14 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.690947:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee600, rc 0) 00000100:00100000:3.0:1777497546.691001:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564902656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.691008:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1777497546.693034:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.693059:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.693072:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497546.693143:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777497546.693149:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.693156:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497546.693165:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777497546.693168:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:0.0:1777497546.693170:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497546.693204:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.693211:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.693219:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.693257:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.693307:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.693346:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.693401:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902784 00000100:00100000:3.0:1777497546.693407:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902784 00000100:00100000:3.0:1777497546.693453:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777497546.693462:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564902784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.693476:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.693500:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef800/0x3e357265691c981 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c97a expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.693518:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef800/0x3e357265691c981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c97a expref: 15 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.693526:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef800/0x3e357265691c981 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c97a expref: 15 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.693534:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef800, rc 0) 00000100:00100000:3.0:1777497546.693569:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84aca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564902784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.693576:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497546.694361:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.694378:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.694388:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.694452:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.694485:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.694515:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.695128:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564902912 00000100:00100000:3.0:1777497546.695135:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564902912 00000100:00100000:3.0:1777497546.695173:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1777497546.695181:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564902912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.695324:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564902912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.695330:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1777497546.698363:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564902912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.698436:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.698527:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497546.698562:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408795e600 going to sleep for 11 seconds 00000100:00100000:2.0:1777497546.698795:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903040 00000100:00100000:2.0:1777497546.698803:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903040 00000100:00100000:2.0:1777497546.698857:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1777497546.698867:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564903040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.698983:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564903040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497546.698991:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1777497546.699044:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497546.700170:0:85566:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497546.707799:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497546.707838:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497546.707850:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.707863:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497546.707896:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497546.707899:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:2.0:1777497546.707902:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497546.707940:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.707948:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.707958:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.707984:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.708051:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.708223:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240912266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.709943:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903168 00000100:00100000:1.0:1777497546.709955:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903168 00000100:00100000:1.0:1777497546.710053:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1777497546.710062:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564903168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.710078:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497546.710127:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39800/0x3e357265691c98f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c988 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.710170:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39800/0x3e357265691c98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c988 expref: 16 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.710181:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39800/0x3e357265691c98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c988 expref: 16 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.710190:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39800, rc 0) 00000100:00100000:1.0:1777497546.710243:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.710250:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1777497546.710339:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497546.710356:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.710365:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.710433:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.710460:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.712654:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240912266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.713206:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903296 00000100:00100000:0.0:1777497546.713216:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903296 00000100:00100000:0.0:1777497546.713285:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1777497546.713294:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.713443:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (2981us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.713450:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1777497546.713939:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.713991:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.714055:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.714080:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240912266c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.716379:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903424 00000100:00100000:0.0:1777497546.716394:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903424 00000100:00100000:0.0:1777497546.716449:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777497546.716459:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.716626:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.716639:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1777497546.721342:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497546.724060:0:85567:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1777497546.727674:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1777497546.727718:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497546.727728:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.727740:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497546.733435:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1777497546.733445:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1777497546.733451:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497546.733503:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.733515:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.733525:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.733552:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.733618:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.733684:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.733777:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903552 00000100:00100000:1.0:1777497546.733785:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903552 00000100:00100000:1.0:1777497546.733842:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1777497546.733852:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564903552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.733865:0:85478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497546.733879:0:85478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39000/0x3e357265691c99d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c996 expref: -99 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.733902:0:85478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39000/0x3e357265691c99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c996 expref: 17 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.733929:0:85478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39000/0x3e357265691c99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c996 expref: 17 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.733937:0:85478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39000, rc 0) 00000100:00100000:1.0:1777497546.733986:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.733993:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1777497546.734292:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.734306:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.734315:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497546.734373:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.734397:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.734435:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.734494:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903680 00000100:00100000:3.0:1777497546.734499:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903680 00000100:00100000:3.0:1777497546.734537:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1777497546.734544:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.734679:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.734686:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1777497546.734752:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.734781:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.734825:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.734844:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.734858:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903808 00000100:00100000:3.0:1777497546.734862:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903808 00000100:00100000:3.0:1777497546.734893:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777497546.734901:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.736204:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1298us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.736216:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1777497546.736522:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497546.740035:0:85568:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1777497546.740199:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1777497546.740225:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1777497546.740235:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.740247:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497546.740256:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777497546.740259:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:1.0:1777497546.740262:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777497546.740299:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.740307:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.740323:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.740349:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.740412:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.740454:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82e0be40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.740763:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564903936 00000100:00100000:3.0:1777497546.740771:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564903936 00000100:00100000:3.0:1777497546.740846:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1777497546.740855:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564903936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.740869:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.740881:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef400/0x3e357265691c9ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9a4 expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.740903:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef400/0x3e357265691c9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9a4 expref: 18 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.740913:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef400/0x3e357265691c9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9a4 expref: 18 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.740921:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef400, rc 0) 00000100:00100000:3.0:1777497546.740964:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564903936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.740970:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497546.740998:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564903936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497546.741905:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.741917:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.741995:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.742039:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.746878:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.749730:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904064 00000100:00100000:0.0:1777497546.749746:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904064 00000100:00100000:0.0:1777497546.749817:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497546.749827:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a63ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564904064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.749986:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a63ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564904064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (7945us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.749993:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777497546.750059:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.750152:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.750204:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.750230:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.750961:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904192 00000100:00100000:0.0:1777497546.750968:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904192 00000100:00100000:0.0:1777497546.750999:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777497546.751006:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564904192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.751148:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85ddc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564904192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.751154:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777497546.751163:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497546.756239:0:85569:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497546.756527:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497546.756553:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497546.756563:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.756576:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497546.756586:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497546.756603:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:2.0:1777497546.756606:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497546.756646:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.756655:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.756665:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.756700:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.756765:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.756805:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.756907:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904320 00000100:00100000:0.0:1777497546.756914:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904320 00000100:00100000:0.0:1777497546.756963:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1777497546.756973:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564904320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.756985:0:85476:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497546.756997:0:85476:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8400/0x3e357265691c9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9b2 expref: -99 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.757018:0:85476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8400/0x3e357265691c9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9b2 expref: 19 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.757028:0:85476:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8400/0x3e357265691c9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9b2 expref: 19 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.757044:0:85476:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8400, rc 0) 00000100:00100000:0.0:1777497546.757131:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.757138:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1777497546.757234:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.757254:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.757264:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.757324:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.757352:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.757379:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82e0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497546.757433:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904448 00000100:00100000:2.0:1777497546.757437:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904448 00000100:00100000:2.0:1777497546.757472:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777497546.757479:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.757597:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a738ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497546.757604:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1777497546.757685:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.757715:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.757754:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.757779:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82e0b780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497546.757892:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904576 00000100:00100000:2.0:1777497546.757897:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904576 00000100:00100000:2.0:1777497546.757929:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1777497546.757936:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.758019:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a738e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497546.758026:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1777497546.758147:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497546.759284:0:85570:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1777497546.759467:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1777497546.759487:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497546.759498:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.759508:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497546.759518:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1777497546.759521:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1777497546.759524:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1777497546.759559:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.759568:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.759578:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.759599:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.759654:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.759706:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.759914:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904704 00000100:00100000:0.0:1777497546.759922:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904704 00000100:00100000:0.0:1777497546.759973:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1777497546.759985:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564904704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.760001:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497546.760015:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8600/0x3e357265691c9c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9c0 expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.760039:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8600/0x3e357265691c9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9c0 expref: 20 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.760051:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8600/0x3e357265691c9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9c0 expref: 20 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.760060:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8600, rc 0) 00000100:00100000:0.0:1777497546.760137:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a738e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564904704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.760143:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1777497546.760295:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497546.760312:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.760321:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.760403:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.760429:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.760460:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.760502:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904832 00000100:00100000:0.0:1777497546.760506:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904832 00000100:00100000:0.0:1777497546.760533:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1777497546.760540:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564904832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.760849:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a738c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564904832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.760863:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1777497546.760929:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.760957:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.760995:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.761051:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091226c00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.764849:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564904960 00000100:00100000:1.0:1777497546.764865:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564904960 00000100:00100000:2.0:1777497546.767910:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1777497546.767928:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564904960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.770184:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564904960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2252us (9178us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497546.770196:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1777497546.770235:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564904960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497546.777744:0:85571:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1777497546.777857:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1777497546.777880:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1777497546.777890:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.777902:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497546.777911:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497546.777914:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:2.0:1777497546.777916:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497546.777955:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.777978:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.777989:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.778015:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.778076:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.778155:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497546.778309:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905088 00000100:00100000:0.0:1777497546.778317:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905088 00000100:00100000:0.0:1777497546.778363:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1777497546.778373:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564905088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497546.778388:0:85482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497546.778401:0:85482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9a00/0x3e357265691c9d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9ce expref: -99 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.778425:0:85482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9a00/0x3e357265691c9d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9ce expref: 21 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.778436:0:85482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9a00/0x3e357265691c9d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9ce expref: 21 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.778445:0:85482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9a00, rc 0) 00000100:00100000:0.0:1777497546.778483:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8601ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497546.778489:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1777497546.778574:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497546.778587:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.778596:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.778651:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.778691:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.778717:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.779603:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905216 00000100:00100000:3.0:1777497546.779610:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905216 00000100:00100000:3.0:1777497546.779656:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1777497546.779666:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.779796:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86019450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.779803:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1777497546.779967:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.780004:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497546.780051:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497546.780086:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497546.780219:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905344 00000100:00100000:1.0:1777497546.780230:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905344 00000100:00100000:1.0:1777497546.780265:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1777497546.780271:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.780749:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 476us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497546.780755:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1777497546.782982:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497546.784445:0:85572:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497546.784671:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497546.784796:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497546.784808:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.784820:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497546.784845:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1777497546.784848:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497546.784851:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1777497546.784899:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.784907:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497546.784918:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497546.784944:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497546.785012:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497546.785052:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.785059:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905472 00000100:00100000:3.0:1777497546.785084:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905472 00000100:00100000:3.0:1777497546.785162:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777497546.785172:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564905472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.785189:0:85477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.785204:0:85477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeea00/0x3e357265691c9e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9dc expref: -99 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.785230:0:85477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeea00/0x3e357265691c9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9dc expref: 22 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.785241:0:85477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeea00/0x3e357265691c9e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9dc expref: 22 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.785249:0:85477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeea00, rc 0) 00000100:00100000:3.0:1777497546.785305:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564905472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.785313:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1777497546.785727:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.785742:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.785750:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497546.785769:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1777497546.785772:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.785779:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497546.785786:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1777497546.785788:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:1.0:1777497546.785790:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1777497546.785807:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.785814:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.785832:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.785845:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.785876:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.785915:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82e0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.786201:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905600 00000100:00100000:3.0:1777497546.786206:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905600 00000100:00100000:3.0:1777497546.786237:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1777497546.786244:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564905600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497546.786254:0:85478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497546.786436:0:85478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee800/0x3e357265691c9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691c9ea expref: -99 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.786457:0:85478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee800/0x3e357265691c9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691c9ea expref: 23 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.786466:0:85478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee800/0x3e357265691c9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691c9ea expref: 23 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.786567:0:85478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee800, rc 0) 00000100:00100000:3.0:1777497546.786614:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564905600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 371us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497546.786621:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1777497546.786778:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497546.786792:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497546.786799:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497546.786855:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497546.786880:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497546.786914:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82e0b480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497546.786958:0:85476:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905728 00000100:00100000:3.0:1777497546.786963:0:85476:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905728 00000100:00100000:3.0:1777497546.787631:0:85476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1777497546.787642:0:85476:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564905728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497546.787744:0:85476:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564905728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (863us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497546.787752:0:85476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1777497546.790970:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564905728:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1777497546.791025:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1777497546.791035:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497546.791053:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497546.914290:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497547.945355:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497548.962213:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497549.636323:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497549.636412:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294528 00000100:00100000:0.0:1777497549.636423:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294528 00000100:00100000:0.0:1777497549.636485:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1777497549.636494:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546294528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497549.636560:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce93450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546294528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 67us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497549.636567:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:2.0:1777497549.644456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497549.644591:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294656 00000100:00100000:0.0:1777497549.644602:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294656 00000100:00100000:0.0:1777497549.644675:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1174 00000100:00100000:0.0:1777497549.644687:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546294656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497549.644763:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546294656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497549.644770:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1174 00000100:00080000:3.0:1777497549.644859:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1777497549.848715:0:85738:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1777497549.988692:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497550.373547:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497550.373554:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497550.373558:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497550.373566:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1777497550.373570:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497550.373576:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497550.373599:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ac700 x1863837564905984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497550.373620:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497550.373634:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497550.373636:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497550.373639:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1777497550.373641:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497550.373645:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497550.373657:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd34380 x1863837564906240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497550.373679:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497550.373683:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497550.373684:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497550.373687:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1777497550.373689:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497550.373692:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497550.373702:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd35f80 x1863837564906496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497550.373720:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497550.373723:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497550.373724:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497550.373727:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3674 00000100:00080000:2.0:1777497550.373729:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497550.373732:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497550.373741:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409c182680 x1863837564906880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497550.373764:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1777497550.373772:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497550.373774:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497550.373778:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff923f839d0000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497550.373790:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50b1500 x1863837564907392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497550.373817:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564906368:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.373883:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.373911:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564907136:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.373937:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.373961:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1777497550.373966:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564906624:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.373985:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.374000:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564907264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.374018:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.376292:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564906112:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.376364:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.376414:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564907008:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.376448:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.376482:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1777497550.376489:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564905856:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.376516:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.376541:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564906752:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.376563:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.376790:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906368 00000100:00100000:2.0:1777497550.376813:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906368 00000100:00100000:2.0:1777497550.376861:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906112 00000100:00100000:2.0:1777497550.376864:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906112 00000100:00100000:2.0:1777497550.376886:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1777497550.376895:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564906368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.376950:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564906368:12345-0@lo:400:kworker.0 Request processed in 56us (3066us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.376956:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00100000:2.0:1777497550.376973:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1777497550.376979:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564906112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377008:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564906112:12345-0@lo:400:kworker.0 Request processed in 29us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377013:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1176 00000100:00100000:2.0:1777497550.377034:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907136 00000100:00100000:2.0:1777497550.377038:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907136 00000100:00100000:2.0:1777497550.377064:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906624 00000100:00100000:2.0:1777497550.377067:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906624 00000100:00100000:2.0:1777497550.377125:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907264 00000100:00100000:2.0:1777497550.377128:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907264 00000100:00100000:2.0:1777497550.377149:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906752 00000100:00100000:2.0:1777497550.377151:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906752 00000100:00100000:2.0:1777497550.377170:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1777497550.377175:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377208:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564907136:12345-0@lo:400:kworker.0 Request processed in 33us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377214:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:2.0:1777497550.377225:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1777497550.377230:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564906624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377264:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564906624:12345-0@lo:400:kworker.0 Request processed in 35us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377270:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:2.0:1777497550.377282:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:2.0:1777497550.377287:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564907264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377312:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564907264:12345-0@lo:400:kworker.0 Request processed in 25us (3293us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377317:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:2.0:1777497550.377327:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1777497550.377332:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564906752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377356:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564906752:12345-0@lo:400:kworker.0 Request processed in 24us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377361:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:2.0:1777497550.377401:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564906752:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377413:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564906112:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377430:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497550.377438:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564907520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497550.377461:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497550.377486:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497550.377490:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497550.377493:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497550.377517:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564906624:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377529:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564907264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377540:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564906368:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377624:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907008 00000100:00100000:2.0:1777497550.377628:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907008 00000100:00100000:2.0:1777497550.377659:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907520 00000100:00100000:2.0:1777497550.377661:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907520 00000100:00100000:2.0:1777497550.377678:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1777497550.377684:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3658:x1863837564907008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377717:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:3658:x1863837564907008:12345-0@lo:400:kworker.0 Request processed in 33us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377722:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3912 00000100:00100000:2.0:1777497550.377733:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1777497550.377738:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564907520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497550.377759:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497550.377787:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564907520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.377792:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3913 00000100:00100000:2.0:1777497550.377812:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564907136:0@lo:400:kworker.0 00000100:00100000:2.0:1777497550.377840:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564907520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497550.377848:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564907008:0@lo:400:kworker.0 00000100:00100000:1.0:1777497550.378074:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564905984:0@lo:38:kworker.0 00000100:00100000:1.0:1777497550.382699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497550.382749:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564906240:0@lo:38:kworker.0 00000100:00100000:1.0:1777497550.382776:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497550.382795:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564906496:0@lo:38:kworker.0 00000100:00100000:1.0:1777497550.382823:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497550.382837:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564906880:0@lo:38:kworker.0 00000100:00100000:1.0:1777497550.382855:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497550.382886:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564907392:0@lo:38:kworker.0 00000100:00100000:1.0:1777497550.382906:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497550.382958:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905856 00000100:00100000:1.0:1777497550.382966:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905856 00000100:00100000:1.0:1777497550.383021:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1777497550.383030:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564905856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497550.383109:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c0fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564905856:12345-0@lo:400:kworker.0 Request processed in 54us (6564us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.383116:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1777497550.383154:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564905984 00000100:00100000:1.0:1777497550.383158:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564905984 00000100:00100000:1.0:1777497550.383169:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906240 00000100:00100000:1.0:1777497550.383171:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906240 00000100:00100000:1.0:1777497550.383178:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906880 00000100:00100000:1.0:1777497550.383180:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906880 00000100:00100000:1.0:1777497550.383185:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907392 00000100:00100000:1.0:1777497550.383187:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907392 00000100:00100000:1.0:1777497550.383197:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1777497550.383201:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564905984:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.383225:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1777497550.383262:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691c9f8 00000004:00100000:1.0:1777497550.383278:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497550.383416:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f839d6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497550.383458:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837564905984:12345-0@lo:38:kworker.0 Request processed in 255us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.383466:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:1.0:1777497550.383481:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1777497550.383485:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564906240:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.383506:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1777497550.383529:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691c9ff 00000004:00100000:1.0:1777497550.383535:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497550.383554:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f839d2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497550.383581:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837564906240:12345-0@lo:38:kworker.0 Request processed in 95us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.383587:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1777497550.383600:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1777497550.383603:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564906880:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.383613:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1777497550.383634:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691ca06 00000004:00100000:1.0:1777497550.383640:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497550.383656:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc69800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497550.383681:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837564906880:12345-0@lo:38:kworker.0 Request processed in 76us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.383686:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:1.0:1777497550.383698:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:1.0:1777497550.383701:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564907392:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.383712:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3679 last 0 00000020:00000080:1.0:1777497550.383730:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691ca0d 00000004:00100000:1.0:1777497550.383735:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497550.383748:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497550.383773:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564907392:12345-0@lo:38:kworker.0 Request processed in 70us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.383779:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00010000:00080000:1.0:1777497550.383839:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240867ac700 x1863837564905984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.383854:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 25 00000100:00080000:1.0:1777497550.384696:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9240867ac700 x1863837564905984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.384705:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497550.384709:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497550.384712:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497550.384719:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564905984:0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.384741:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240bcd34380 x1863837564906240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.384751:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 25 00000100:00080000:1.0:1777497550.385524:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9240bcd34380 x1863837564906240/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.385533:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497550.385537:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497550.385540:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497550.385545:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564906240:0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.385565:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92409c182680 x1863837564906880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.385576:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 25 00000100:00100000:2.0:1777497550.387728:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564906496 00000100:00100000:2.0:1777497550.387745:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564906496 00000100:00100000:2.0:1777497550.387788:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3914 00000100:00100000:2.0:1777497550.387797:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564906496:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497550.387829:0:80394:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9240911d3800, cookie 0x3e357265691c869 00010000:00080000:2.0:1777497550.387835:0:80394:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9240911d3800 cur 3679 last 1777497544 00000004:00100000:2.0:1777497550.387873:0:80394:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497550.387909:0:80394:0:(import.c:65:import_set_state_nolock()) ffff924086e2b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497550.387999:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564906496:12345-0@lo:38:kworker.0 Request processed in 202us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.388008:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3914 00010000:00080000:2.0:1777497550.388280:0:85504:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:2.0:1777497550.388285:0:85504:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 103079215111 00000020:00080000:2.0:1777497550.388290:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497550.388296:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 103079215111, next_transno: 103079215111 00010000:00080000:2.0:1777497550.388299:0:85504:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (103079215111) 00000020:00080000:2.0:1777497550.388301:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497550.388312:0:85504:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546286592 t103079215111 from 192.168.202.4@tcp req@ffff9240a6d80e00 x1863837546286592/t0(103079215111) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:301/0 lens 528/0 e 0 to 0 dl 1777497556 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1777497550.388871:0:85504:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 505us 00000100:00080000:1.0:1777497550.394036:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff92409c182680 x1863837564906880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497575 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.394051:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497550.394067:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497550.394073:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:1.0:1777497550.394078:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564906880:0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.394144:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b50b1500 x1863837564907392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497560 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497550.394160:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 25 00000100:00080000:1.0:1777497550.394168:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1777497550.394173:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1777497550.394175:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497550.394180:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564907392:0@lo:38:kworker.0 00000100:00080000:1.0:1777497550.394218:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 25 00000100:00080000:1.0:1777497550.394226:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:1.0:1777497550.394229:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:1.0:1777497550.394232:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:1.0:1777497550.394236:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:1.0:1777497550.394239:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1777497550.394355:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564905856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497550.394411:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564906496:0@lo:38:kworker.0 00010000:00080000:1.0:1777497550.394426:0:85766:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:1.0:1777497550.394430:0:85766:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:1.0:1777497550.394435:0:85766:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:1.0:1777497550.396054:0:85766:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:1.0:1777497550.396138:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564907648:0@lo:400:ldlm_lock_repla.0 00000100:00100000:1.0:1777497550.396260:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.397709:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907648 00000100:00100000:0.0:1777497550.397721:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907648 00000100:00100000:0.0:1777497550.397834:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3915 00000100:00100000:0.0:1777497550.397844:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564907648:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:0.0:1777497550.397874:0:23359:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff92408a0ed500 x1863837564907648/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:306/0 lens 224/0 e 0 to 0 dl 1777497561 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497550.397885:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564907648:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 44us (1625us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497550.397892:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3915 00000001:00100000:1.0:1777497550.398302:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1777497550.410497:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1777497550.414640:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777497550.417311:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417333:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417348:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417360:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417366:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417385:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417858:0:85504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417871:0:85504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417878:0:85504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417886:0:85504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.417890:0:85504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417916:0:85504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417932:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5db00) 00010000:00010000:1.0:1777497550.417936:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497550.417940:0:85504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417948:0:85504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e800/0x3e357265691ca14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497550.417965:0:85504:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001f9a85bc reply state 00000000d3bce53e transno 103079215111 ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417974:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.417980:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d200) 00010000:00010000:1.0:1777497550.417982:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497550.417985:0:85504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497550.418140:0:85504:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1777497550.418162:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.418166:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000020:00080000:1.0:1777497550.418170:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.418172:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215112 00000100:00100000:0.0:1777497550.426296:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497550.426378:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546287104 00000100:00100000:2.0:1777497550.426388:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546287104 00000100:00100000:2.0:1777497550.426455:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1208 00000100:00100000:2.0:1777497550.426467:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546287104:12345-192.168.202.4@tcp:36:rm.0 00010000:00080000:2.0:1777497550.426487:0:73210:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 103079215112, current: 103079215112, replaying 00000100:00100000:2.0:1777497550.426498:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546287104:12345-192.168.202.4@tcp:36:rm.0 Request processed in 36us (212us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497550.426506:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1208 00000020:00080000:1.0:1777497550.426799:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.426804:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215112, next_transno: 103079215112 00010000:00080000:1.0:1777497550.426808:0:85504:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (103079215112) 00000020:00080000:1.0:1777497550.426811:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.426829:0:85504:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546287104 t103079215112 from 192.168.202.4@tcp req@ffff9240af500e00 x1863837546287104/t0(103079215112) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 512/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777497550.426913:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.426929:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.426941:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.426952:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.426960:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.426968:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427052:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427060:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427067:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427373:0:85504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427381:0:85504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427395:0:85504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427400:0:85504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.427404:0:85504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427412:0:85504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427424:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x7:0x0].0x0 (ffff9240a3b5d500) 00010000:00010000:1.0:1777497550.427428:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497550.427432:0:85504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427438:0:85504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408164f800/0x3e357265691ca30 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x7:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427457:0:85504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427463:0:85504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427469:0:85504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427474:0:85504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.427477:0:85504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427494:0:85504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427503:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240a3b5d100) 00010000:00010000:1.0:1777497550.427505:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497550.427508:0:85504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427514:0:85504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408164ec00/0x3e357265691ca22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497550.427525:0:85504:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f80002f3 reply state 00000000e888bcae transno 103079215112 ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427535:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.427541:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240a3b5d200) 00010000:00010000:1.0:1777497550.427544:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497550.427546:0:85504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497550.427621:0:85504:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497550.427637:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.427640:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000020:00080000:1.0:1777497550.427643:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497550.427645:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215113 00000100:00100000:3.0:1777497550.435606:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497550.435636:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288512 00000100:00100000:3.0:1777497550.435645:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288512 00000100:00100000:3.0:1777497550.435693:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1209 00000100:00100000:3.0:1777497550.435701:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546288512:12345-192.168.202.4@tcp:36:dd.0 00010000:00080000:3.0:1777497550.435722:0:65418:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 103079215113, current: 103079215114, replaying 00000100:00100000:3.0:1777497550.435734:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546288512:12345-192.168.202.4@tcp:36:dd.0 Request processed in 35us (137us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497550.435741:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1209 00000020:00080000:3.0:1777497550.435760:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.435763:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215114, next_transno: 103079215113 00010000:00080000:3.0:1777497550.435768:0:85504:0:(ldlm_lib.c:2244:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 103079215113, ql: 1, comp: 1, conn: 2, next: 103079215114, next_update 0 last_committed: 103079215110) 00000020:00080000:3.0:1777497550.435784:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.435792:0:85504:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546288512 t103079215114 from 192.168.202.4@tcp req@ffff924086d09880 x1863837546288512/t0(103079215114) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 488/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1777497550.435991:0:85504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.436006:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.436018:0:85504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497550.436155:0:85504:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003535bfd2 reply state 00000000e8c97da7 transno 103079215114 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.436167:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.436174:0:85504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:3.0:1777497550.436177:0:85504:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497550.436180:0:85504:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1777497550.436270:0:85504:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1777497550.436283:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.436285:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000020:00080000:3.0:1777497550.436288:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.436290:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215115 00000100:00100000:3.0:1777497550.440868:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497550.440908:0:63742:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546288768 00000100:00100000:3.0:1777497550.440918:0:63742:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546288768 00000100:00100000:3.0:1777497550.440986:0:63742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:3.0:1777497550.440995:0:63742:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546288768:12345-192.168.202.4@tcp:10:dd.0 00010000:00080000:3.0:1777497550.441027:0:63742:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 103079215115, current: 103079215115, replaying 00000100:00100000:3.0:1777497550.441041:0:63742:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2411:x1863837546288768:12345-192.168.202.4@tcp:10:dd.0 Request processed in 48us (183us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497550.441048:0:63742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000020:00080000:3.0:1777497550.441067:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.441070:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 103079215115, next_transno: 103079215115 00010000:00080000:3.0:1777497550.441074:0:85504:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (103079215115) 00000020:00080000:3.0:1777497550.441078:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.441113:0:85504:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546288768 t103079215115 from 192.168.202.4@tcp req@ffff924086d09f80 x1863837546288768/t0(103079215115) o10->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 440/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497550.441358:0:85504:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:3.0:1777497550.441372:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.441375:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000020:00080000:3.0:1777497550.441378:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497550.441380:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 103079215116 00000100:00100000:3.0:1777497550.450448:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497550.450661:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294784 00000100:00100000:2.0:1777497550.450671:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294784 00000100:00100000:2.0:1777497550.450735:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1210 00000100:00100000:2.0:1777497550.450751:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546294784:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777497550.450778:0:63727:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff924086d0b480 x1863837546294784/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 328/0 e 0 to 0 dl 1777497561 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497550.450797:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546294784:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 50us (359us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497550.450804:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1210 00000020:00080000:2.0:1777497550.450823:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497550.450827:0:85504:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 103079215116 00010000:00080000:2.0:1777497550.450830:0:85504:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1777497550.450833:0:85504:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497550.450839:0:85504:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497550.450842:0:85504:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497550.450847:0:85504:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff924086d0b480 x1863837546294784/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 328/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777497550.450863:0:85504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497550.450888:0:85504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 2/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c153 expref: -99 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.450912:0:85504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 14 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.450929:0:85504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 14 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.450940:0:85504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34800, rc 0) 00010000:00080000:2.0:1777497550.450999:0:85504:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:2.0:1777497550.451011:0:85504:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777497550.456194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497550.457384:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546294912 00000100:00100000:2.0:1777497550.457398:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546294912 00000100:00100000:2.0:1777497550.457473:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1177 00000100:00100000:2.0:1777497550.457484:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+14:2411:x1863837546294912:12345-192.168.202.4@tcp:400:ptlrpcd_rcv.0 00010000:00080000:2.0:1777497550.457508:0:73210:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240af503800 x1863837546294912/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 224/0 e 0 to 0 dl 1777497561 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497550.457539:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+14:2411:x1863837546294912:12345-192.168.202.4@tcp:400:ptlrpcd_rcv.0 Request processed in 57us (1357us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497550.457546:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1177 00010000:00080000:1.0:1777497550.457620:0:85504:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1777497550.457732:0:85504:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 25, last_transno is 107374182400 00000001:00100000:2.0:1777497550.461462:0:85471:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:2.0:1777497550.461474:0:85471:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:2.0:1777497550.461506:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 103079215115 is committed 00010000:00010000:1.0:1777497550.461594:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461623:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461631:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461637:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.461642:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461650:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461666:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461672:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e200/0x3e357265691ca1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461693:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461698:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461704:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461709:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.461712:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461724:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461732:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461737:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408164e000/0x3e357265691ca29 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461757:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461763:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461768:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461773:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497550.461776:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461782:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461790:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.461796:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691ca37 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 85504 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497550.461834:0:85504:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1777497550.461879:0:85504:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1777497550.461893:0:85504:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff92408a0ed500 x1863837564907648/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:306/0 lens 224/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777497550.462016:0:85504:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff9240af503800 x1863837546294912/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 224/0 e 0 to 0 dl 1777497561 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1777497550.462125:0:85504:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1777497550.467723:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1777497550.467739:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff92408a0ef480 x1863837564907648/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497566 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497550.467750:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff92408a0ef480 x1863837564907648/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497566 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497550.467757:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497550.467775:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777497550.467780:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564907648:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1777497550.471629:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497550.471678:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497550.471715:0:63741:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289792 00000100:00100000:3.0:1777497550.471724:0:63741:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289792 00002000:00100000:3.0:1777497550.471772:0:63741:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff924086d08380 x1863837546289792/t0(0) o4->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 496/0 e 0 to 0 dl 1777497561 ref 1 fl New:/602/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497550.471784:0:63741:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff924086d08380 with x1863837546289792 00002000:00010000:3.0:1777497550.471796:0:63741:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 7 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497550.471844:0:63741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:3.0:1777497550.471854:0:63741:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546289792:12345-192.168.202.4@tcp:4:dd.0 00000100:00100000:0.0:1777497550.472333:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546289920 00000100:00100000:0.0:1777497550.472338:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546289920 00000100:00100000:0.0:1777497550.472368:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1211 00000100:00100000:0.0:1777497550.472385:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2413:x1863837546289920:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:2.0:1777497550.476774:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182401 is committed 00000100:00100000:3.0:1777497550.477008:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546289920:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 4618us (5382us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497550.477020:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1211 00000100:00100000:2.0:1777497550.478544:0:63741:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546289792:12345-192.168.202.4@tcp:4:dd.0 Request processed in 6683us (6856us total) trans 107374182401 rc 0/0 00000100:00100000:2.0:1777497550.478559:0:63741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00002000:00100000:2.0:1777497550.478573:0:63741:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_001: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff924086d08380 x1863837546289792/t107374182401(0) o4->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:306/0 lens 496/448 e 0 to 0 dl 1777497561 ref 1 fl Complete:/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497550.478593:0:63741:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff924086d08380 with x1863837546289792 00002000:00010000:2.0:1777497550.478604:0:63741:0:(mdt_io.c:38:mdt_dom_resource_prolong()) ### DOM lock to prolong ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 7 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497550.484139:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497550.484171:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564907776:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497550.484250:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497550.484753:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907776 00000100:00100000:3.0:1777497550.484762:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907776 00000100:00100000:3.0:1777497550.484822:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1777497550.484832:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564907776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497550.484868:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1777497550.484921:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564907776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497550.484928:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3916 00000100:00100000:3.0:1777497550.484977:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564907776:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1777497550.508045:0:85504:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef07233e10 00100000:10000000:0.0:1777497550.508058:0:85504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1777497550.510664:0:85490:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x282:0x0] 00000100:00100000:0.0:1777497550.510716:0:85490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85490:1863837564907904:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497550.510783:0:85490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.510859:0:85490:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c7b13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497550.510906:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564907904 00000100:00100000:1.0:1777497550.510914:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564907904 00000100:00100000:1.0:1777497550.510993:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5855 00000004:00080000:3.0:1777497550.510999:0:85492:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x90:0x0] 00000100:00100000:1.0:1777497550.511004:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:85490:x1863837564907904:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777497550.511018:0:85492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85492:1863837564908032:0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1777497550.511042:0:25496:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -127 00000100:00100000:3.0:1777497550.511044:0:85492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:02000040:1.0:1777497550.511046:0:25496:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:643 to 0x280000401:769) 00000100:00100000:0.0:1777497550.513546:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908032 00000100:00100000:0.0:1777497550.513560:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908032 00000100:00100000:0.0:1777497550.513640:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:0.0:1777497550.513651:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:85492:x1863837564908032:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1777497550.513682:0:8398:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 769 -> diff = -625 00002000:02000040:0.0:1777497550.513686:0:8398:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:145 to 0x2c0000401:769) 00000100:00100000:3.0:1777497550.517908:0:85492:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83ed3600 going to sleep for 11 seconds 00002000:00010000:1.0:1777497550.523129:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.523143:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523162:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523164:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523169:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523187:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523197:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523220:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523238:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.523424:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.523430:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523438:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.523455:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523465:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523483:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523490:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691ca45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523513:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523515:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523524:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.523597:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.523603:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523611:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523612:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523615:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523624:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523632:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523638:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523660:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.523695:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.523700:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.523700:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.523705:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523708:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.523711:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523719:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523722:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523723:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523726:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523730:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523735:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523737:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691ca4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523743:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523750:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.523750:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523752:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523753:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.523766:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.523772:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.523775:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523782:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.523785:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523802:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.523804:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.523808:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523813:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523815:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523816:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523819:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523820:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691ca53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523828:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523833:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523835:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523837:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.523844:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523851:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523872:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.523911:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777497550.523911:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497550.523916:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523916:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523924:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.523925:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.523926:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.523927:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523929:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523935:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523938:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523945:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523946:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523953:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523962:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691ca5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523969:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.523977:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.523980:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.523981:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.523986:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.523989:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.523997:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.524006:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.524013:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691ca61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.524024:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.524026:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.524027:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.525171:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.525182:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525196:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525197:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525201:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525212:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525219:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525225:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525242:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497550.525250:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.525255:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525261:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.525640:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525661:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525676:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525684:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691ca68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525703:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.525705:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.525707:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.525797:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.525802:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525810:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525812:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525815:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525824:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525832:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525848:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525866:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497550.525875:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.525878:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525885:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.525887:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525895:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525905:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525912:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691ca6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525925:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.525926:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.525928:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.525971:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.525983:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.525990:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525991:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.525994:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526002:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526008:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526014:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526831:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497550.526842:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.526848:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526855:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.526859:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526866:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526890:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526896:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691ca76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526913:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.526915:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.526916:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.526974:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.526979:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.526988:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.526989:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.526992:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.527002:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.527010:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528160:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528248:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497550.528551:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.528557:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528568:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528570:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528574:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528586:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528595:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528601:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528620:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497550.528631:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497550.528636:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528644:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.528648:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528663:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528678:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528686:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691ca7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528705:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.528708:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528714:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.528717:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528725:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528733:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528740:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691ca84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528761:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.528762:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.528764:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.528807:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.528813:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528820:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528821:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528823:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528831:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528839:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528846:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528860:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497550.528866:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.528870:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528887:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.528889:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528896:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528906:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528912:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691ca8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528925:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.528927:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.528929:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.528966:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.528971:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528978:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528980:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.528982:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.528990:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.529003:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.529010:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.530338:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.531455:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.532283:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.532292:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532317:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164fa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.532322:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532332:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532350:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532358:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691ca92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.532397:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.532404:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.532415:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.532417:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.532423:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.532434:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.532443:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.532450:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532529:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.532533:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532539:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.532542:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532550:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532560:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.532574:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.532576:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.532696:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.532696:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497550.532707:0:25496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691ca99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.532727:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.532774:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.532778:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533565:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533567:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533572:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533586:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533592:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533597:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533614:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.533638:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.533644:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533651:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.533655:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533662:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.533670:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.533673:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533675:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533681:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.533683:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097f2bb00/0x3e357265691caa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533683:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533694:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533698:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.533699:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.533701:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.533703:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533710:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533717:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533733:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.533749:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.533754:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.533770:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497550.533771:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902be00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.533774:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533774:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533782:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.533783:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533784:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533786:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533793:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533794:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533802:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0f6451/0x3e357265691caa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533803:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.533814:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.533816:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.533817:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.533820:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533839:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.533858:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.533863:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.533875:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.533880:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533881:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902bc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.533885:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533887:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533889:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.533892:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533892:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533901:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533904:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533909:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533911:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2a068a8/0x3e357265691caae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533916:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533925:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.533927:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533933:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ae00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.533933:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777497550.533936:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533942:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533952:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533964:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003de919e1/0x3e357265691cab5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.533964:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.533969:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.533977:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.533979:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.533980:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.533984:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533986:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.533989:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.533997:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.534005:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.534009:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.534012:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.535250:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497550.535458:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.536090:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.536129:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.536131:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.536137:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.536150:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.536177:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.536184:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.536203:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497550.536257:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.536262:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537587:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537588:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537594:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537595:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497550.537603:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537607:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537611:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.537616:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537616:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537624:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537626:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537642:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537642:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497550.537648:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b82373f/0x3e357265691cabc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537675:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497550.537678:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537690:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.537693:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537700:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537710:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537716:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000263f223d/0x3e357265691cac3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.537726:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.537728:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.537731:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537731:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537738:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.537739:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537740:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.537741:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537743:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537748:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537752:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537757:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537760:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537768:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000749df11a/0x3e357265691caca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537768:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537781:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.537782:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1777497550.537784:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537789:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.537792:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537799:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537808:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.537811:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.537815:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537816:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d14c5034/0x3e357265691cad1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537822:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537824:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537826:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537827:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.537829:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.537831:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.537835:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537838:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.537847:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537853:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537869:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.537877:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.537881:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537895:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ba00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.537898:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.537904:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.537906:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537908:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537916:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537916:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537917:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.537920:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537923:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075de0c03/0x3e357265691cad8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537929:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537935:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.537935:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.537937:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.537939:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.537942:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.537970:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497550.538014:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.538018:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538026:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538027:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538030:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538038:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538045:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538052:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.538052:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538055:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538062:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902aa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.538063:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.538065:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538072:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538117:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.538123:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.538125:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000357fcc87/0x3e357265691cadf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538127:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538134:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538136:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.538138:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497550.538139:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538141:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538148:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497550.538148:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538151:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538159:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538161:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538168:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538169:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538176:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7b9ed16/0x3e357265691cae6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538182:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.538186:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.538189:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538189:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538200:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.538203:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538210:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538220:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.538222:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.538226:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538227:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee840810/0x3e357265691caed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538234:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538236:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538238:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538239:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538241:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538242:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538247:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497550.538247:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538255:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538262:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538292:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.538307:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.538312:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538319:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.538322:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.538327:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.538331:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538339:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.538340:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538340:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538343:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538351:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538351:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538359:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a49e392/0x3e357265691caf4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538360:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538367:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538375:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.538385:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.538388:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538394:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.538397:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538404:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497550.538407:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.538411:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.538414:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538418:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.538419:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.538421:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001931d686/0x3e357265691cafb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538427:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538436:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538442:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538449:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.538459:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.538631:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.538636:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538643:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.538646:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538663:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538675:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538681:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d972efc5/0x3e357265691cb02 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.538694:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538696:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538698:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538703:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.538706:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.539354:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.539473:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.539476:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.539477:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497550.540397:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.540406:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540421:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.540423:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.540428:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540440:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540448:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540863:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540890:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497550.540947:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.540952:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540960:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.540961:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.540964:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540973:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540981:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.540988:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541011:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497550.541051:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.541056:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541072:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.541073:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.541077:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541117:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541125:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541132:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541143:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1777497550.541173:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497550.541177:0:25496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541184:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.541186:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497550.541189:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541197:0:25496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541215:0:25496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541222:0:25496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497550.541231:0:25496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00080000:1.0:1777497550.542960:0:25496:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:642 00000100:00100000:1.0:1777497550.543069:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:85490:x1863837564907904:12345-0@lo:5:osp-pre-0-0.0 Request processed in 32064us (32282us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.543079:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5855 00010000:00010000:2.0:1777497550.543692:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777497550.543701:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543716:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.543720:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543730:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543753:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543760:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfeb0d40/0x3e357265691cb09 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543785:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497550.543789:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543796:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.543812:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543820:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543831:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543838:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691cb10 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543851:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497550.543854:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543861:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.543864:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543871:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543880:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543887:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691cb17 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543906:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.543910:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543916:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.543919:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543927:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543937:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543945:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691cb1e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.543957:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.543959:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.543961:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497550.544627:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x301:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497550.544635:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544648:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.544655:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.544660:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544674:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544682:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544689:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544704:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497550.544713:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.544717:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544724:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497550.544727:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544734:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544743:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.544759:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083611d0/0x3e357265691cb25 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x301:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497550.544764:0:85490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85490:1863837564907904:0@lo:5:osp-pre-0-0.0 00010000:00010000:2.0:1777497550.544772:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.544774:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.544775:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1777497550.544800:0:85490:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x301:0x0] from OST, last_created [0x280000401:0x301:0x0]last_used is [0x280000401:0x282:0x0] 00000100:00100000:2.0:1777497550.544861:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497550.544867:0:85490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85490:1863837564908288:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497550.544947:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.544953:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.544958:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497550.545383:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.545404:0:85490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.545420:0:85490:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c7b13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497550.545755:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908288 00000100:00100000:2.0:1777497550.545762:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908288 00000100:00100000:2.0:1777497550.545800:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5857 00000100:00100000:2.0:1777497550.545808:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:85490:x1863837564908288:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1777497550.545844:0:25487:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 770 00000100:00100000:3.0:1777497550.546606:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908160 00000100:00100000:3.0:1777497550.546611:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908160 00000100:00100000:3.0:1777497550.546683:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1777497550.546690:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564908160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497550.546707:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497550.546768:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564908160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1386us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497550.546775:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1777497550.546799:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497550.548169:0:85490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:85490:1863837564908288:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1777497550.548198:0:85490:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x301:0x0]-[0x280000401:0x321:0x0] 00002000:00010000:3.0:1777497550.550815:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x300:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.550827:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550844:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.550846:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.550851:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550865:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550875:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550883:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550912:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.550979:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.550984:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.550991:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.550993:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.550995:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551011:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551019:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551025:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551041:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777497550.551056:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497550.551064:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551072:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.551076:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.551079:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551108:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551110:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551116:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551117:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551120:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551127:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551127:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551135:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007af19434/0x3e357265691cb2c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x300:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551136:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551143:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551153:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.551155:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551162:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.551170:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.551170:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.551174:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551174:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551181:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.551182:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551184:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551191:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551192:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551199:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b44505dc/0x3e357265691cb33 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551202:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551209:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000770ef400/0x3e357265691cb3a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551209:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551211:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551213:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551220:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551222:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551223:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.551262:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551267:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551275:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551282:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551286:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551295:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551302:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551310:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551331:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.551370:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551375:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551383:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551384:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551386:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551395:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551403:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551421:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551421:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.551425:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551432:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.551434:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.551435:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551442:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551454:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.551458:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551459:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551465:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.551468:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551475:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d8df46/0x3e357265691cb41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551476:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551486:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551488:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551490:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551491:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551492:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691cb48 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551504:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551505:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551507:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.551547:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551558:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551566:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551567:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551570:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551579:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551586:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551592:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551612:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.551649:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2fa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551653:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551657:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.551661:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.551661:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551663:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551666:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551669:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.551672:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551675:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551679:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551688:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551690:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551696:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551697:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cb4f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551708:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497550.551714:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.551717:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551721:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551723:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.551723:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551725:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551726:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551733:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551743:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551750:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca47b811/0x3e357265691cb56 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551761:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551769:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551771:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.551810:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551815:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551823:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551824:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551827:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551835:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551842:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551848:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551867:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.551902:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.551906:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551914:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551915:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.551918:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551936:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551944:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551944:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.551949:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551952:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551956:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.551960:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551964:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.551967:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551970:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.551973:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551977:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551979:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.551983:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551984:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cb5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.551990:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551997:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.551998:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.551998:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.551999:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552005:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691cb64 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552023:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552025:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552027:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.552064:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552069:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552077:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552078:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552092:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552116:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552123:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552130:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552143:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.552177:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552181:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552194:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.552198:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552198:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552200:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552203:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552212:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552213:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552216:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552220:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552224:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552228:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552234:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552240:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.552241:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee840810/0x3e357265691cb6b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552245:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.552248:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552253:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552254:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552255:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552256:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552258:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552265:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552286:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552293:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691cb72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552306:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552308:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552310:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.552351:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552355:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552363:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552364:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552367:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552375:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552383:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552389:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552419:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.552434:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.552438:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552445:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902aa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552448:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.552454:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497550.552455:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552458:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552465:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552466:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552469:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552479:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552482:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552486:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552489:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000357fcc87/0x3e357265691cb79 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552493:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552503:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.552505:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777497550.552505:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552510:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552511:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ba00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552514:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552521:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552530:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552537:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075de0c03/0x3e357265691cb80 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.552540:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552544:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552549:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552551:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552551:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552558:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552558:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552561:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552570:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552577:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552583:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552600:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.552636:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552641:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552648:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552650:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552650:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.552653:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552654:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552661:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.552662:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552665:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552669:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552672:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552682:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552686:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552689:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d14c5034/0x3e357265691cb87 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552698:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.552701:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.552704:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552704:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552709:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552712:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552718:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552733:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.552737:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f1:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497550.552740:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691cb8e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552741:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552749:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552750:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552753:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552753:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552754:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552756:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552762:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552769:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552776:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552795:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.552825:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777497550.552829:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497550.552829:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552833:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552837:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552840:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552845:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552846:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552847:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552850:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552857:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552858:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552865:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691cb95 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552866:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552874:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552887:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.552888:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.552891:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552894:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552897:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.552900:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552907:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552917:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552923:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691cb9c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.552925:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.552929:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.552934:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.552935:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552936:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.552937:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.552937:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.552940:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552949:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552967:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552973:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.552992:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.553030:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553034:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553042:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553043:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553045:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553054:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553061:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553067:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553077:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777497550.553144:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497550.553148:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497550.553151:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ed:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553156:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553156:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ae00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.553163:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497550.553164:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553165:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553168:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553172:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553177:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553181:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553184:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553188:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691cba3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553192:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553201:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497550.553204:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497550.553204:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553209:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.553211:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902bc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.553212:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553214:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553220:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dce00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.553221:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553222:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553230:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553231:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553238:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691cbaa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553245:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553252:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e712ba16/0x3e357265691cbb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553255:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553256:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553258:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553263:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553265:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553267:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553274:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.553303:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553308:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553315:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553316:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553319:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553327:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553334:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553341:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553373:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.553409:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2eb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553413:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553419:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553421:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553424:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553432:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553439:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553446:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553456:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777497550.553490:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553494:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553501:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553502:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553511:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553519:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553527:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553534:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553544:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1777497550.553578:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553583:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553590:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553591:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553594:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553600:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497550.553603:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553604:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553611:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553611:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.553614:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553621:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553629:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553632:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553639:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691cbb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553641:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777497550.553647:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497550.553650:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553652:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497550.553654:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553657:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.553660:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553661:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dde00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.553667:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553668:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553675:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553677:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553684:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a79cdd5/0x3e357265691cbbf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553685:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553692:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691cbc6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553695:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.553698:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.553702:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553703:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553705:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553709:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.553712:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553714:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.553717:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553724:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553734:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553740:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8e6d55e/0x3e357265691cbcd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553752:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553754:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.553755:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497550.553792:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553797:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553804:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553805:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553807:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553815:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553827:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553833:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553853:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.553888:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553892:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553900:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553901:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553903:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553911:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553918:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553925:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553934:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1777497550.553970:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.553975:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553982:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553983:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.553986:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.553994:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.554001:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.554007:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.554017:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1777497550.554049:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.554053:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.554060:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.554061:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.554064:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.554072:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554221:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777497550.554226:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497550.554232:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:85490:x1863837564908288:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2268us (2670us total) trans 4294969453 rc 0/0 00010000:00010000:0.0:1777497550.554234:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dcc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.554237:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554244:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497550.554248:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5857 00010000:00010000:0.0:1777497550.554275:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554282:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691cbd4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.554283:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497550.554288:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.554295:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866ddc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.554296:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497550.554298:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554299:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.554306:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554306:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.554308:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554316:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.554322:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554323:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.554330:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691cbdb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554331:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691cbe2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.554340:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.554342:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.554344:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.554345:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.554346:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.554347:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.554352:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.554354:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.555817:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.555828:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.555949:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497550.556041:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497550.556047:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.556059:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.556061:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.556066:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.556078:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.556110:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.556117:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556162:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497550.556169:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556176:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.556179:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556188:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556203:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556210:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691cbe9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556230:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497550.556234:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556246:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497550.556249:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556256:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556265:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.556272:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.556273:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497550.556275:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.556308:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497550.556312:0:8398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000138b77c8/0x3e357265691cbf0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497550.556367:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.557001:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497550.557032:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.557043:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.557045:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497550.557048:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.557059:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.557067:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497550.557073:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557143:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497550.557195:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x2e2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497550.557201:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557209:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.557210:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497550.557213:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557222:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557241:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557248:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497550.557261:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777497550.559391:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497550.559402:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559415:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.559420:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559430:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559449:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559457:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b5f250/0x3e357265691cbf7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559485:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497550.559489:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559494:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dca00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497550.559497:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559522:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559533:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559540:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691cbfe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497550.559556:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.559557:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.559559:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497550.559568:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1777497550.567872:0:8398:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:144 00000100:00100000:3.0:1777497550.567965:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:85492:x1863837564908032:12345-0@lo:5:osp-pre-1-0.0 Request processed in 54314us (56916us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497550.567973:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00000100:00100000:2.0:1777497550.568144:0:85492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85492:1863837564908032:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497550.568159:0:85492:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x301:0x0] from OST, last_created [0x2c0000401:0x301:0x0]last_used is [0x2c0000401:0x90:0x0] 00000100:00100000:0.0:1777497550.568232:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497550.568236:0:85492:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85492:1863837564908544:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1777497550.568244:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497550.568277:0:85492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.568288:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.568304:0:85492:0:(client.c:2691:ptlrpc_set_wait()) set ffff924084c2e900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497550.568334:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908416 00000100:00100000:0.0:1777497550.568341:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908416 00000100:00100000:0.0:1777497550.568391:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1777497550.568400:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564908416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497550.568426:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 213696 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497550.568608:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564908416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 209us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497550.568615:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908544 00000100:00100000:0.0:1777497550.568615:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:3.0:1777497550.568619:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908544 00000100:00100000:2.0:1777497550.568685:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497550.568728:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5858 00000100:00100000:3.0:1777497550.568736:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:85492:x1863837564908544:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777497550.568766:0:25489:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 770 00000100:00100000:3.0:1777497550.569980:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:85492:x1863837564908544:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1243us (1700us total) trans 4294969449 rc 0/0 00000100:00100000:3.0:1777497550.569986:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5858 00000100:00100000:2.0:1777497550.570091:0:85492:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:85492:1863837564908544:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497550.570140:0:85492:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x301:0x0]-[0x2c0000401:0x321:0x0] 00000100:00100000:1.0:1777497550.673726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497550.673780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497550.673825:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295296 00000100:00100000:1.0:1777497550.673836:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295296 00000100:00100000:2.0:1777497550.673875:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295424 00000100:00100000:2.0:1777497550.673879:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295424 00000100:00100000:1.0:1777497550.673886:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:1.0:1777497550.673894:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546295296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497550.673928:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1178 00000100:00100000:2.0:1777497550.673934:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546295424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497550.673962:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546295424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497550.673962:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c0fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546295296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 68us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.673971:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1178 00000100:00100000:1.0:1777497550.673971:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000020:00000004:2.0:1777497550.862688:0:85793:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497550.863927:0:85793:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1777497550.882298:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564908672:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497550.882371:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497550.885479:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908672 00000100:00100000:2.0:1777497550.885496:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908672 00000100:00100000:2.0:1777497550.885561:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1777497550.885573:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564908672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497550.885600:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497550.885703:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564908672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497550.885710:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1777497550.885793:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564908672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497550.885818:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497550.885828:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564908800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497550.885871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497550.887121:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908800 00000100:00100000:0.0:1777497550.887136:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908800 00000100:00100000:0.0:1777497550.887204:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:0.0:1777497550.887215:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564908800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497550.887238:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 212800 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497550.887312:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564908800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497550.887319:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1777497550.887368:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564908800:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497551.023450:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1777497551.871745:0:85843:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497551.872545:0:85843:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497552.035346:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497553.058395:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497554.076886:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497554.077318:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295552 00000100:00100000:2.0:1777497554.077329:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295552 00000100:00100000:2.0:1777497554.077407:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1212 00000100:00100000:2.0:1777497554.077417:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:67556:x1863837546295552:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497554.077445:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497554.077470:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cc05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c17d expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077544:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077560:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077574:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497554.077635:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497554.077639:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497554.077674:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077697:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cc05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c17d expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077731:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c17d expref: 8 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497554.077739:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240817a3000) 00010000:00010000:2.0:1777497554.077742:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497554.077746:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34a00, rc 0) 00000100:00080000:3.0:1777497554.082294:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497554.083215:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67556:x1863837546295552:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 5789us (6328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497554.083228:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1212 00010000:00010000:0.0:1777497554.083814:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497554.097039:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497554.097177:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295680 00000100:00100000:2.0:1777497554.097187:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295680 00000100:00100000:2.0:1777497554.097254:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1213 00000100:00100000:2.0:1777497554.097267:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67556:x1863837546295680:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497554.097309:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497554.097388:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:67556:x1863837546295680:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 125us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497554.097395:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1213 00000100:00100000:1.0:1777497554.102287:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497554.102398:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295808 00000100:00100000:2.0:1777497554.102408:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295808 00000100:00100000:2.0:1777497554.102563:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1214 00000100:00100000:2.0:1777497554.102575:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546295808:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497554.102615:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497554.102685:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546295808:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 112us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497554.102692:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1214 00000100:00080000:3.0:1777497554.104057:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497554.111041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497554.114604:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546295936 00000100:00100000:1.0:1777497554.114622:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546295936 00000100:00100000:1.0:1777497554.114687:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5859 00000100:00100000:1.0:1777497554.114706:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2411:x1863837546295936:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:1.0:1777497554.114740:0:25488:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3683 last 0 00000020:00000080:1.0:1777497554.114775:0:25488:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691cc13 00002000:00100000:1.0:1777497554.114785:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff923f826cb800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1777497554.114800:0:25488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1777497554.114993:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1777497554.115026:0:25488:0:(import.c:65:import_set_state_nolock()) ffff92408a0a7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497554.115583:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546295936:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 874us (4554us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497554.115591:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5859 00000100:00100000:1.0:1777497554.120643:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497554.120988:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296064 00000100:00100000:2.0:1777497554.120997:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296064 00000100:00100000:2.0:1777497554.121091:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2040 00000100:00100000:2.0:1777497554.121232:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546296064:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497554.121260:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497554.121327:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546296064:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 99us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497554.121334:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2040 00000100:00080000:3.0:1777497554.121560:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497554.125283:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497554.125389:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296192 00000100:00100000:0.0:1777497554.125405:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296192 00000100:00100000:0.0:1777497554.125476:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5860 00000100:00100000:0.0:1777497554.125486:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2411:x1863837546296192:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:0.0:1777497554.125526:0:25491:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp t0 exp 0000000000000000 cur 3683 last 0 00000020:00000080:0.0:1777497554.125556:0:25491:0:(genops.c:1406:class_connect()) connect: client 6d03493e-1218-49f3-bdd0-b10716c402e0, cookie 0x3e357265691cc1a 00002000:00100000:0.0:1777497554.125568:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d03493e-1218-49f3-bdd0-b10716c402e0/ffff9240b521c000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1777497554.125586:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1777497554.125654:0:25491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1777497554.125687:0:25491:0:(import.c:65:import_set_state_nolock()) ffff9240b521c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497554.125774:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546296192:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 288us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497554.125782:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5860 00000100:00100000:3.0:1777497554.129816:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497554.130635:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296320 00000100:00100000:0.0:1777497554.130651:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296320 00000100:00100000:0.0:1777497554.130741:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2041 00000100:00100000:0.0:1777497554.130751:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546296320:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:0.0:1777497554.130777:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497554.132810:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:67556:x1863837546296320:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 2051us (3001us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497554.132837:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2041 00000100:00080000:3.0:1777497554.132953:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497555.108383:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497555.490645:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497555.490712:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497555.490778:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564908928 00000100:00100000:3.0:1777497555.490786:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564908928 00000100:00100000:3.0:1777497555.490828:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1777497555.490835:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564908928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497555.490867:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497555.490908:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564908928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497555.490915:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3917 00000100:00100000:3.0:1777497555.490960:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564908928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497555.498594:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564909056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497555.498680:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499357:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564909184:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499396:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499427:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564909696:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499453:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499473:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910208:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499496:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499520:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1777497555.499527:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564909312:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499547:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499564:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564909824:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499584:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499601:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910336:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499621:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.499655:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909184 00000100:00100000:0.0:1777497555.499662:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909184 00000100:00100000:0.0:1777497555.499705:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1777497555.499714:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f851d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564909184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499761:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f851d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564909184:12345-0@lo:400:kworker.0 Request processed in 49us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497555.499769:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1777497555.499802:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909696 00000100:00100000:0.0:1777497555.499806:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909696 00000100:00100000:0.0:1777497555.499841:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909312 00000100:00080000:3.0:1777497555.499850:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497555.499855:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909312 00000100:00100000:3.0:1777497555.499865:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564909568:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499882:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1777497555.499889:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564909696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.499892:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497555.499910:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564910080:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.499918:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564909696:12345-0@lo:400:kworker.0 Request processed in 31us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497555.499924:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:3.0:1777497555.499927:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497555.499945:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777497555.499951:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564909440:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.499982:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497555.499991:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909056 00000100:00100000:1.0:1777497555.500139:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910208 00000100:00100000:1.0:1777497555.500144:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910208 00000100:00100000:1.0:1777497555.500171:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909824 00000100:00100000:1.0:1777497555.500174:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909824 00000100:00100000:1.0:1777497555.500194:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910336 00000100:00100000:1.0:1777497555.500196:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910336 00000100:00100000:1.0:1777497555.500215:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1777497555.500221:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497555.500255:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910208:12345-0@lo:400:kworker.0 Request processed in 34us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.500261:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1777497555.500273:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1777497555.500279:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564909824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497555.500306:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564909824:12345-0@lo:400:kworker.0 Request processed in 28us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.500322:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1777497555.500335:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1777497555.500341:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497555.500370:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910336:12345-0@lo:400:kworker.0 Request processed in 29us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.500375:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:2.0:1777497555.500440:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909056 00000100:00100000:2.0:1777497555.500471:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3918 00000100:00100000:2.0:1777497555.500479:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564909056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497555.500506:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497555.500542:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564909056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497555.500549:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3918 00000100:00100000:0.0:1777497555.500985:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909568 00000100:00100000:0.0:1777497555.500990:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909568 00000100:00100000:0.0:1777497555.501008:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910080 00000100:00100000:0.0:1777497555.501010:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910080 00000100:00100000:0.0:1777497555.501022:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1777497555.501029:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564909312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501078:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564909312:12345-0@lo:400:kworker.0 Request processed in 50us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497555.501083:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1777497555.501120:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1777497555.501127:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564909568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501157:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564909568:12345-0@lo:400:kworker.0 Request processed in 30us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497555.501163:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1777497555.501175:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1777497555.501181:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564910080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501205:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564910080:12345-0@lo:400:kworker.0 Request processed in 25us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497555.501210:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1777497555.501266:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564909312:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501290:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564909824:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501293:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564909952:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501300:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910336:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501309:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564909184:0@lo:400:kworker.0 00000100:00100000:0.0:1777497555.501319:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564909696:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497555.501328:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910208:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501339:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564910464:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501362:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497555.501385:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564909568:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501394:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564910080:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501409:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564909056:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1777497555.501431:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497555.501435:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497555.501437:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497555.501447:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909440 00000100:00100000:3.0:1777497555.501450:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909440 00000100:00100000:3.0:1777497555.501475:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910464 00000100:00100000:3.0:1777497555.501477:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910464 00000100:00100000:3.0:1777497555.501488:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1777497555.501493:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564909440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501527:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564909440:12345-0@lo:400:kworker.0 Request processed in 33us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497555.501532:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:3.0:1777497555.501545:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1777497555.501550:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564910464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501573:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564910464:12345-0@lo:400:kworker.0 Request processed in 23us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497555.501578:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:3.0:1777497555.501612:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564909952 00000100:00100000:3.0:1777497555.501615:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564909952 00000100:00100000:3.0:1777497555.501639:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:3.0:1777497555.501644:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564909952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501673:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564909952:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497555.501679:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00080000:3.0:1777497555.501693:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497555.501695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497555.501811:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564909440:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501820:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564909952:0@lo:400:kworker.0 00000100:00100000:3.0:1777497555.501828:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564910464:0@lo:400:kworker.0 00000100:00100000:1.0:1777497555.773279:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497555.773332:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497555.773361:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497555.773386:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497555.773420:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497555.773451:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296832 00000100:00100000:1.0:1777497555.773460:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296832 00000100:00100000:1.0:1777497555.773501:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296960 00000100:00100000:1.0:1777497555.773504:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296960 00000100:00100000:1.0:1777497555.773522:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2487 00000100:00100000:1.0:1777497555.773530:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546296832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497555.773600:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546296832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.773609:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2487 00000100:00100000:1.0:1777497555.773637:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2488 00000100:00100000:1.0:1777497555.773644:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546296960:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497555.773670:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546296960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.773676:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2488 00000100:00100000:1.0:1777497555.773707:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296576 00000100:00100000:1.0:1777497555.773710:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296576 00000100:00100000:1.0:1777497555.773734:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296704 00000100:00100000:1.0:1777497555.773736:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296704 00000100:00100000:1.0:1777497555.773754:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1185 00000100:00100000:1.0:1777497555.773760:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2412:x1863837546296576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497555.773788:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2412:x1863837546296576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.773795:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1185 00000100:00100000:1.0:1777497555.773806:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1186 00000100:00100000:1.0:1777497555.773812:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546296704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497555.773835:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546296704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497555.773841:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1186 00000100:00100000:2.0:1777497555.774144:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546296448 00000100:00100000:2.0:1777497555.774150:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546296448 00000100:00100000:2.0:1777497555.774185:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:2.0:1777497555.774192:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546296448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497555.774227:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546296448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 36us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497555.774234:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:2.0:1777497556.002358:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564910592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497556.002431:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497556.002487:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497556.002522:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497556.002572:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910592 00000100:00100000:2.0:1777497556.002581:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910592 00000100:00100000:2.0:1777497556.002622:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910720 00000100:00100000:2.0:1777497556.002625:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910720 00000100:00100000:2.0:1777497556.002647:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:2.0:1777497556.002654:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564910592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497556.002684:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497556.002727:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564910592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497556.002734:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:2.0:1777497556.002751:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1777497556.002758:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497556.002772:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497556.002802:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564910720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497556.002808:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:2.0:1777497556.002857:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564910720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497556.002890:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564910592:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497556.002988:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497556.002997:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564910848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497556.003023:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497556.003057:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910848 00000100:00100000:1.0:1777497556.003061:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910848 00000100:00100000:1.0:1777497556.003086:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1777497556.003118:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564910848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497556.003131:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497556.003161:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564910848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497556.003167:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:1.0:1777497556.003198:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564910848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497556.014395:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497556.014419:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564910976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497556.014491:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497556.014538:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564910976 00000100:00100000:1.0:1777497556.014546:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564910976 00000100:00100000:1.0:1777497556.014591:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1777497556.014599:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564910976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497556.014622:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497556.014665:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564910976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497556.014671:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:1.0:1777497556.014720:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564910976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777497556.132025:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497556.524857:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497556.524875:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969453 is committed 00000001:00100000:1.0:1777497556.534046:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497556.534065:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969449 is committed 00010000:00010000:3.0:1777497557.157327:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497558.196992:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497558.314814:0:85940:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:0.0:1777497559.202494:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497560.226690:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497560.343648:0:85988:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:2.0:1777497560.610502:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497560.610540:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564911232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497560.610623:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497560.610733:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911232 00000100:00100000:3.0:1777497560.610743:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911232 00000100:00100000:3.0:1777497560.610803:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1777497560.610814:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564911232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497560.610855:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1777497560.610905:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564911232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497560.610914:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3919 00000100:00100000:3.0:1777497560.610977:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564911232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497560.611140:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564911104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497560.611175:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497560.611247:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911104 00000100:00100000:2.0:1777497560.611268:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911104 00000100:00100000:2.0:1777497560.611307:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3920 00000100:00100000:2.0:1777497560.611314:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564911104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497560.611334:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497560.611377:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564911104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497560.611383:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3920 00000100:00100000:1.0:1777497560.611596:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564911104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497560.611914:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497560.612005:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497560.612015:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564911744:0@lo:400:kworker.0 00000100:00100000:3.0:1777497560.612054:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497560.612114:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911744 00000100:00100000:3.0:1777497560.612118:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911744 00000100:00100000:3.0:1777497560.612163:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:3.0:1777497560.612170:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564911744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497560.612207:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564911744:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497560.612214:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00080000:3.0:1777497560.612231:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497560.612251:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564911744:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612312:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564911488:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612345:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.612377:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497560.612383:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564911616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612406:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.612436:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911488 00000100:00100000:0.0:1777497560.612440:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911488 00000100:00100000:0.0:1777497560.612473:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911616 00000100:00100000:0.0:1777497560.612476:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911616 00000100:00100000:0.0:1777497560.612499:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1777497560.612517:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564911488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612558:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564911488:12345-0@lo:400:kworker.0 Request processed in 53us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.612564:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1777497560.612578:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1777497560.612584:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564911616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612611:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564911616:12345-0@lo:400:kworker.0 Request processed in 27us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.612628:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00080000:0.0:1777497560.612652:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497560.612655:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497560.612673:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564911616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.612682:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564911488:0@lo:400:kworker.0 00000100:00100000:3.0:1777497560.613288:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564911872:0@lo:400:kworker.0 00000100:00100000:3.0:1777497560.613322:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497560.613381:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911872 00000100:00100000:1.0:1777497560.613386:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911872 00000100:00100000:1.0:1777497560.613428:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1777497560.613447:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564911872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.613529:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564911360:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.613566:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.613608:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564911360 00000100:00100000:0.0:1777497560.613612:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564911360 00000100:00100000:0.0:1777497560.613644:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1777497560.613650:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564911360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.613688:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564911360:12345-0@lo:400:kworker.0 Request processed in 38us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.613695:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1777497560.613740:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564911360:0@lo:400:kworker.0 00000100:00080000:0.0:1777497560.613769:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497560.613895:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564912128:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.613925:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.613962:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497560.613968:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564912000:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614000:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.614028:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912128 00000100:00100000:0.0:1777497560.614032:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912128 00000100:00100000:0.0:1777497560.614064:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912000 00000100:00100000:0.0:1777497560.614067:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912000 00000100:00100000:0.0:1777497560.614127:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1777497560.614134:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564912128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614171:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564912128:12345-0@lo:400:kworker.0 Request processed in 38us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.614177:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000100:00100000:0.0:1777497560.614190:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:0.0:1777497560.614196:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564912000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614221:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564912000:12345-0@lo:400:kworker.0 Request processed in 26us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.614227:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00080000:0.0:1777497560.614242:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497560.614244:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497560.614265:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564912000:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614275:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564912128:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614293:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564912256:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614317:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497560.614343:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912256 00000100:00100000:0.0:1777497560.614346:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912256 00000100:00100000:0.0:1777497560.614371:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1777497560.614377:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564912256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.614414:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564912256:12345-0@lo:400:kworker.0 Request processed in 37us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.614420:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1777497560.614448:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564912256:0@lo:400:kworker.0 00000100:00100000:1.0:1777497560.614788:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564911872:12345-0@lo:400:kworker.0 Request processed in 1343us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497560.614796:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:2.0:1777497560.614980:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564912640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.615027:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497560.615050:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497560.615056:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564912512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.615079:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497560.615123:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912512 00000100:00100000:2.0:1777497560.615128:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912512 00000100:00100000:2.0:1777497560.615169:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1777497560.615175:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564912512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.615212:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564912512:12345-0@lo:400:kworker.0 Request processed in 38us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497560.615218:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1777497560.615240:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912640 00000100:00100000:2.0:1777497560.615243:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912640 00000100:00100000:2.0:1777497560.615269:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:2.0:1777497560.615274:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564912640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.615304:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089389180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564912640:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497560.615310:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:2.0:1777497560.615329:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497560.615362:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 2 00000100:00100000:2.0:1777497560.615381:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564912512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.615392:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564912640:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.615779:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497560.615798:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564912384:0@lo:400:kworker.0 00000100:00100000:0.0:1777497560.615829:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497560.615910:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912384 00000100:00100000:2.0:1777497560.615915:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912384 00000100:00100000:2.0:1777497560.616078:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2492 00000100:00100000:2.0:1777497560.616086:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564912384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497560.616162:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564912384:12345-0@lo:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497560.616169:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2492 00000100:00100000:1.0:1777497560.616257:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 2 00000100:00100000:1.0:1777497560.616274:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564912384:0@lo:400:kworker.0 00000100:00100000:3.0:1777497560.616358:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564911872:0@lo:400:kworker.0 00000100:00080000:0.0:1777497560.616425:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497560.894700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497560.894759:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497560.894878:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297088 00000100:00100000:2.0:1777497560.894891:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297088 00000100:00100000:2.0:1777497560.894981:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:2.0:1777497560.895002:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546297088:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497560.895167:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546297088:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 166us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497560.895175:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:1.0:1777497560.895852:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497560.909365:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497560.909406:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497560.910156:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297472 00000100:00100000:3.0:1777497560.910172:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297472 00000100:00100000:3.0:1777497560.910278:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297600 00000100:00100000:3.0:1777497560.910282:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297600 00000100:00100000:3.0:1777497560.910314:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2493 00000100:00100000:3.0:1777497560.910325:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546297472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497560.910664:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546297472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 340us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497560.910673:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2493 00000100:00100000:3.0:1777497560.910699:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2494 00000100:00100000:3.0:1777497560.910708:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546297600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497560.910740:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2412:x1863837546297600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (1334us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497560.910767:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2494 00000100:00080000:1.0:1777497560.911192:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497560.911199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497560.913468:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297216 00000100:00100000:0.0:1777497560.913487:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297216 00000100:00100000:0.0:1777497560.913649:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297344 00000100:00100000:0.0:1777497560.913653:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297344 00000100:00100000:0.0:1777497560.913687:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1193 00000100:00100000:0.0:1777497560.913698:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546297216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497560.913804:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546297216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 109us (19044us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.913812:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1193 00000100:00100000:0.0:1777497560.913831:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1194 00000100:00100000:0.0:1777497560.913838:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546297344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497560.913863:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546297344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (18015us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497560.913870:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1194 00000100:00080000:1.0:1777497560.914450:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497560.914458:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497561.122838:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564912768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497561.122868:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564912896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497561.123008:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497561.123027:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564913024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497561.123152:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497561.123163:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564913152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497561.131504:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497561.131631:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912768 00000100:00100000:1.0:1777497561.131644:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912768 00000100:00100000:1.0:1777497561.131712:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:1.0:1777497561.131727:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564912768:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497561.131741:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1777497561.131778:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497561.131821:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564912896 00000100:00100000:3.0:1777497561.131828:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564912896 00000100:00100000:1.0:1777497561.131849:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564912768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497561.131857:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:3.0:1777497561.131865:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:3.0:1777497561.131874:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564912896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497561.131896:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497561.131930:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564912768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497561.132132:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564912896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 172us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497561.132140:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:3.0:1777497561.132179:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564912896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497561.135384:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497561.135534:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913024 00000100:00100000:1.0:1777497561.135548:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913024 00000100:00100000:1.0:1777497561.135629:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:1.0:1777497561.135641:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564913024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497561.135676:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497561.135761:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564913024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497561.135768:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1777497561.139765:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564913024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497561.139967:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497561.140370:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913152 00000100:00100000:1.0:1777497561.140381:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913152 00000100:00100000:1.0:1777497561.140459:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1777497561.140470:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564913152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497561.140504:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497561.146752:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564913152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6270us (6783us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497561.146774:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:0.0:1777497561.160315:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564913152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777497561.253009:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497562.274795:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497562.348380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497562.348489:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297728 00000100:00100000:2.0:1777497562.348507:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297728 00000100:00100000:2.0:1777497562.348599:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1215 00000100:00100000:2.0:1777497562.348612:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:68003:x1863837546297728:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497562.348653:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497562.348751:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:68003:x1863837546297728:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 143us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497562.348758:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1215 00000100:00080000:1.0:1777497562.349434:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497562.353030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497562.353207:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297856 00000100:00100000:2.0:1777497562.353217:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297856 00000100:00100000:2.0:1777497562.353298:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1216 00000100:00100000:2.0:1777497562.353308:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68003:x1863837546297856:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497562.353344:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497562.353419:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68003:x1863837546297856:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497562.353426:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1216 00000100:00080000:1.0:1777497562.354130:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497562.356896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497562.357198:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546297984 00000100:00100000:1.0:1777497562.357209:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546297984 00000100:00100000:1.0:1777497562.357289:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2050 00000100:00100000:1.0:1777497562.357301:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68003:x1863837546297984:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1777497562.357327:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497562.357398:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68003:x1863837546297984:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 99us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497562.357405:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2050 00000100:00080000:0.0:1777497562.357493:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497562.366627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497562.366849:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298112 00000100:00100000:3.0:1777497562.366860:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298112 00000100:00100000:3.0:1777497562.366942:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2051 00000100:00100000:3.0:1777497562.366954:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68003:x1863837546298112:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497562.366990:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497562.367068:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68003:x1863837546298112:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 117us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497562.367076:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2051 00000100:00080000:0.0:1777497562.368182:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497562.478201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497562.478505:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298368 00000100:00100000:0.0:1777497562.478522:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298368 00000100:00100000:0.0:1777497562.478593:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1217 00000100:00100000:0.0:1777497562.478604:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:68020:x1863837546298368:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1777497562.478624:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497562.478644:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c184 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.478769:0:65418:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 9 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.478787:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.478801:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.478812:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.478912:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479358:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479368:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479374:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497562.479378:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479399:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479412:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:0.0:1777497562.479415:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497562.479420:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479426:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc28 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479495:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc21 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c184 expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479507:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240817a3000) 00010000:00010000:0.0:1777497562.479508:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497562.479512:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c184 expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.479521:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9e00, rc 0) 00000100:00100000:0.0:1777497562.479616:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68020:x1863837546298368:12345-192.168.202.4@tcp:101:cat.0 Request processed in 1015us (1425us total) trans 107374182402 rc 301/301 00000100:00100000:0.0:1777497562.479626:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1217 00000100:00100000:2.0:1777497562.485062:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497562.485354:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298496 00000100:00100000:0.0:1777497562.485364:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298496 00000100:00100000:0.0:1777497562.485428:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1218 00000100:00100000:0.0:1777497562.485438:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68020:x1863837546298496:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1777497562.485465:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497562.485499:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c18b expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.485569:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.485584:0:63728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.485592:0:63728:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 4/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.485627:0:63728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 85504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.485640:0:63728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 10 pid: 85504 timeout: 3791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497562.485654:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837564913280:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497562.485756:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497562.494403:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837564913280:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497562.494437:0:63728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497562.496561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497562.496978:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298624 00000100:00100000:3.0:1777497562.496988:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298624 00010000:00010000:3.0:1777497562.497027:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 85504 timeout: 3791 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497562.497070:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2539 00000100:00100000:3.0:1777497562.497079:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2415:x1863837546298624:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497562.497122:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00010000:3.0:1777497562.497145:0:6500:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 0 -> 8 00000004:00010000:3.0:1777497562.497148:0:6500:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 0 -> 1777497513 00000004:00010000:3.0:1777497562.497151:0:6500:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 0 -> 1777497504 00000004:00010000:3.0:1777497562.497153:0:6500:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 0 -> 1777497513 00010000:00010000:3.0:1777497562.497158:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 4/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 85504 timeout: 3791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497172:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 85504 timeout: 3791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497193:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34800/0x3e357265691ca3e lrc: 0/0,0 mode: --/PW res: [0x20000a811:0x6:0x0].0x0 bits 0x59/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c153 expref: 11 pid: 85504 timeout: 3791 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497209:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:3.0:1777497562.497214:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497225:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497249:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 4/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497562.497286:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497562.497354:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2415:x1863837546298624:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 276us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497562.497362:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2539 00010000:00010000:0.0:1777497562.498492:0:63728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.498504:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497562.498567:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497562.498590:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.498628:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c18b expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.498645:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c18b expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.498652:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:0.0:1777497562.498655:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497562.498658:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00000100:00100000:0.0:1777497562.498731:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68020:x1863837546298496:12345-192.168.202.4@tcp:101:cat.0 Request processed in 13294us (13678us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497562.498739:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1218 00000100:00100000:2.0:1777497562.508078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497562.508252:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298752 00000100:00100000:0.0:1777497562.508261:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298752 00000100:00100000:0.0:1777497562.508324:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1219 00000100:00100000:0.0:1777497562.508334:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68020:x1863837546298752:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1777497562.508358:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497562.508381:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691cc44 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c192 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.508441:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691cc44 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c192 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.508475:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691cc44 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c192 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.508494:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:0.0:1777497562.508497:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497562.508501:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9800, rc 0) 00000100:00100000:0.0:1777497562.508570:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68020:x1863837546298752:12345-192.168.202.4@tcp:101:cat.0 Request processed in 237us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497562.508577:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1219 00000100:00100000:2.0:1777497562.517190:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497562.517295:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546298880 00000100:00100000:0.0:1777497562.517306:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546298880 00000100:00100000:0.0:1777497562.517372:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1220 00000100:00100000:0.0:1777497562.517383:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2413:x1863837546298880:12345-192.168.202.4@tcp:101:cat.0 00010000:00010000:0.0:1777497562.517405:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497562.517426:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc4b lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c199 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.517461:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc4b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c199 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497562.517487:0:65418:0:(mdt_lvb.c:89:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb size from disk: 8 -> 8 00000004:00010000:0.0:1777497562.517489:0:65418:0:(mdt_lvb.c:96:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb mtime from disk: 1777497513 -> 1777497513 00000004:00010000:0.0:1777497562.517492:0:65418:0:(mdt_lvb.c:102:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb atime from disk: 1777497504 -> 1777497504 00000004:00010000:0.0:1777497562.517494:0:65418:0:(mdt_lvb.c:108:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb ctime from disk: 1777497513 -> 1777497513 00000004:00010000:0.0:1777497562.517496:0:65418:0:(mdt_lvb.c:114:mdt_dom_disk_lvbo_update()) res: [0x20000a811:0x6:0x0] updating lvb blocks from disk: 18427282363563114435 -> 8 00002000:00010000:0.0:1777497562.517516:0:65418:0:(mdt_io.c:1550:mdt_lvb2reply()) size 8 00010000:00010000:0.0:1777497562.517525:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc4b lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c199 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497562.517538:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x6:0x0].0x0 (ffff9240939c2f00) 00010000:00010000:0.0:1777497562.517541:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1777497562.517545:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9e00, rc 0) 00000100:00100000:0.0:1777497562.517615:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2413:x1863837546298880:12345-192.168.202.4@tcp:101:cat.0 Request processed in 233us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497562.517621:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1220 00000100:00100000:2.0:1777497562.521145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497562.521373:0:63742:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299008 00000100:00100000:3.0:1777497562.521384:0:63742:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299008 00002000:00100000:3.0:1777497562.521434:0:63742:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9240b50b1500 x1863837546299008/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:318/0 lens 488/0 e 0 to 0 dl 1777497573 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497562.521446:0:63742:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9240b50b1500 with x1863837546299008 00000100:00100000:3.0:1777497562.521515:0:63742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1777497562.521524:0:63742:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2414:x1863837546299008:12345-192.168.202.4@tcp:3:cat.0 00000100:00100000:3.0:1777497562.521716:0:63742:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_io00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2414:x1863837546299008:12345-192.168.202.4@tcp:3:cat.0 Request processed in 193us (579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1777497562.521723:0:63742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00002000:00100000:3.0:1777497562.521730:0:63742:0:(mdt_io.c:150:mdt_rw_hpreq_check()) @@@ lustre-MDT0000 mdt_io00_002: refresh rw locks for [0x20000a811:0x6:0x0] req@ffff9240b50b1500 x1863837546299008/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:318/0 lens 488/4536 e 0 to 0 dl 1777497573 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497562.521738:0:63742:0:(mdt_io.c:66:mdt_prolong_dom_lock()) Prolong DOM lock for req ffff9240b50b1500 with x1863837546299008 00000100:00100000:3.0:1777497562.531395:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497562.532140:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299264 00000100:00100000:0.0:1777497562.532156:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299264 00000100:00100000:0.0:1777497562.532216:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 227 00000100:00100000:0.0:1777497562.532226:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:68020:x1863837546299264:12345-192.168.202.4@tcp:35:cat.0 00000100:00100000:0.0:1777497562.532500:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68020:x1863837546299264:12345-192.168.202.4@tcp:35:cat.0 Request processed in 275us (1115us total) trans 107374182403 rc 0/0 00000100:00100000:0.0:1777497562.532508:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 227 00010000:00010000:2.0:1777497563.298400:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497564.322401:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497565.346386:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497565.730369:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497565.730405:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564913408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497565.730499:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497565.730529:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564913664:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.730549:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564913536:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.730577:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.730612:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497565.730612:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564914176:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.730639:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.730674:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564914048:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.730704:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497565.730730:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913408 00000100:00100000:3.0:1777497565.730741:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564914560:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.730749:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913408 00000100:00100000:3.0:1777497565.730769:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.730790:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564915072:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.730806:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914176 00000100:00100000:2.0:1777497565.730810:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914176 00000100:00100000:3.0:1777497565.730829:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497565.730833:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3921 00000100:00100000:2.0:1777497565.730842:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564913408:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497565.730854:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1777497565.730861:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564913920:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.730885:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1777497565.730886:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1777497565.730918:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564914432:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.730947:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837564913408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497565.730955:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3921 00000100:00100000:3.0:1777497565.730966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497565.730983:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3922 00000100:00100000:2.0:1777497565.730991:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564914176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.731001:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564914944:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731029:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564914176:12345-0@lo:400:kworker.0 Request processed in 39us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497565.731038:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3922 00000100:00100000:3.0:1777497565.731039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.731127:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564913408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497565.731159:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564913792:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.731185:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.731211:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564914304:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.731232:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497565.731249:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564914816:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731268:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913664 00000100:00100000:2.0:1777497565.731273:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913664 00000100:00100000:3.0:1777497565.731283:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497565.731327:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914048 00000100:00100000:3.0:1777497565.731328:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914560 00000100:00100000:2.0:1777497565.731331:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914048 00000100:00100000:3.0:1777497565.731334:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914560 00000100:00100000:2.0:1777497565.731348:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915072 00000100:00100000:2.0:1777497565.731352:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915072 00000100:00100000:3.0:1777497565.731365:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913920 00000100:00100000:2.0:1777497565.731371:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913792 00000100:00100000:2.0:1777497565.731373:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913792 00000100:00100000:3.0:1777497565.731380:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913920 00000100:00100000:2.0:1777497565.731392:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1777497565.731401:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564913664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.731414:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:3.0:1777497565.731423:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564914048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731441:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564913664:12345-0@lo:400:kworker.0 Request processed in 41us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497565.731448:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:2.0:1777497565.731466:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1777497565.731467:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564914048:12345-0@lo:400:kworker.0 Request processed in 44us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.731477:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:2.0:1777497565.731478:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564914560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.731494:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1777497565.731501:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564915072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731513:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564914560:12345-0@lo:400:kworker.0 Request processed in 40us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497565.731520:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:3.0:1777497565.731533:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564915072:12345-0@lo:400:kworker.0 Request processed in 34us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497565.731540:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:1.0:1777497565.731616:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914432 00000100:00100000:1.0:1777497565.731620:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914432 00000100:00100000:1.0:1777497565.731648:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914944 00000100:00100000:1.0:1777497565.731650:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914944 00000100:00100000:1.0:1777497565.731666:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914304 00000100:00100000:1.0:1777497565.731669:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914304 00000100:00100000:1.0:1777497565.731686:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914816 00000100:00100000:1.0:1777497565.731689:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914816 00000100:00100000:1.0:1777497565.731711:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1777497565.731717:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564914432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731812:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564913792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.731852:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564913792:12345-0@lo:400:kworker.0 Request processed in 306us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732208:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1777497565.732223:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1777497565.732230:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564913920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.732258:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564913920:12345-0@lo:400:kworker.0 Request processed in 31us (1374us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732262:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1777497565.732393:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564913536 00000100:00100000:3.0:1777497565.732399:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564913536 00000100:00100000:3.0:1777497565.732430:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777497565.732434:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564913536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.732461:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564913536:12345-0@lo:400:kworker.0 Request processed in 27us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732465:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777497565.732508:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1777497565.732512:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564914944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.732531:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564914944:12345-0@lo:400:kworker.0 Request processed in 20us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732542:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2496 00000100:00100000:3.0:1777497565.732553:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:3.0:1777497565.732557:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564914304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.732576:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564914304:12345-0@lo:400:kworker.0 Request processed in 19us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732579:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:3.0:1777497565.732585:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1777497565.732589:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564914816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.732603:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564914816:12345-0@lo:400:kworker.0 Request processed in 14us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497565.732607:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:3.0:1777497565.733542:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564913920:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.733563:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564914944:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.733571:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564913536:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.733580:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564914048:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.733589:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564914560:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.733597:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564915072:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.733961:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564914176:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.733974:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564914688:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.734043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497565.734125:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564913664:0@lo:400:kworker.0 00000100:00100000:1.0:1777497565.734922:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564914432:12345-0@lo:400:kworker.0 Request processed in 3201us (3953us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497565.734947:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2495 00000100:00100000:1.0:1777497565.735068:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564915200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497565.735121:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497565.735165:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564914688 00000100:00100000:1.0:1777497565.735174:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564914688 00000100:00100000:1.0:1777497565.735215:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915200 00000100:00100000:1.0:1777497565.735218:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915200 00000100:00100000:1.0:1777497565.735239:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3923 00000100:00100000:1.0:1777497565.735248:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564914688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497565.735319:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564914688:12345-0@lo:400:kworker.0 Request processed in 72us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497565.735326:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3923 00000100:00100000:1.0:1777497565.735338:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1777497565.735345:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564915200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497565.735373:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497565.735403:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564915200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497565.735421:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3924 00000100:00100000:1.0:1777497565.735471:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564915200:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497565.735487:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564914688:0@lo:400:kworker.0 00000100:00100000:3.0:1777497565.735511:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564914432:0@lo:400:kworker.0 00000100:00080000:0.0:1777497565.735974:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497565.735980:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497565.735984:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497565.735988:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497565.736028:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564913792:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.736044:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564914304:0@lo:400:kworker.0 00000100:00100000:0.0:1777497565.736058:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564914816:0@lo:400:kworker.0 00000100:00100000:2.0:1777497565.738157:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1777497566.013172:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497566.013227:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497566.013265:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497566.013631:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299776 00000100:00100000:0.0:1777497566.013645:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299776 00000100:00100000:0.0:1777497566.013731:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2499 00000100:00100000:0.0:1777497566.013744:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546299776:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497566.013843:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546299776:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 103us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497566.013851:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2499 00000100:00080000:0.0:1777497566.013880:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497566.014070:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497566.014214:0:85482:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299392 00000100:00100000:1.0:1777497566.014220:0:85482:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299392 00000100:00100000:1.0:1777497566.014263:0:85482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:1.0:1777497566.014271:0:85482:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546299392:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497566.014550:0:85482:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546299392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 278us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497566.014558:0:85482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 79 00000100:00100000:2.0:1777497566.014659:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497566.014767:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299520 00000100:00100000:0.0:1777497566.014773:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299520 00000100:00100000:0.0:1777497566.014827:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299648 00000100:00100000:0.0:1777497566.014831:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299648 00000100:00100000:0.0:1777497566.014855:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1201 00000100:00100000:0.0:1777497566.014862:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2413:x1863837546299520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497566.014907:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+12:2413:x1863837546299520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 46us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497566.014914:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1201 00000100:00100000:0.0:1777497566.014927:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1202 00000100:00100000:0.0:1777497566.014933:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546299648:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497566.014995:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546299648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 61us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497566.015001:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1202 00000100:00080000:2.0:1777497566.015320:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497566.015325:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497566.015628:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546299904 00000100:00100000:1.0:1777497566.015635:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546299904 00000100:00100000:1.0:1777497566.015690:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2500 00000100:00100000:1.0:1777497566.015700:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546299904:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497566.015740:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546299904:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497566.015747:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2500 00000100:00080000:0.0:1777497566.015818:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497566.242410:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497566.242441:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564915328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497566.242532:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497566.242597:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915328 00000100:00100000:0.0:1777497566.242607:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915328 00000100:00100000:0.0:1777497566.242668:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1777497566.242679:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564915328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497566.242720:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497566.242785:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564915328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497566.242793:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:0.0:1777497566.242866:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564915328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497566.245064:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564915456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497566.245169:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497566.245237:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915456 00000100:00100000:3.0:1777497566.245254:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915456 00000100:00100000:3.0:1777497566.245312:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1777497566.245324:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564915456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497566.245354:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497566.245406:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564915456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497566.245413:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1777497566.245469:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564915456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497566.245633:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497566.245643:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497566.245676:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497566.245706:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915584 00000100:00100000:0.0:1777497566.245710:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915584 00000100:00100000:0.0:1777497566.245739:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1777497566.245746:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564915584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497566.245787:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497566.245821:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564915584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497566.245839:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1777497566.245879:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497566.254276:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497566.254310:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564915712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497566.254416:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497566.254479:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915712 00000100:00100000:3.0:1777497566.254490:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915712 00000100:00100000:3.0:1777497566.254551:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:3.0:1777497566.254562:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564915712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497566.254595:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497566.254645:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564915712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497566.254653:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:3.0:1777497566.254717:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564915712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497566.370675:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497567.394475:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497568.423222:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1777497568.814903:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182403 is committed 00010000:00010000:0.0:1777497569.443201:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497570.475279:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497570.820034:0:86184:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: replay-single test_131b skipping excluded test 131b 00000100:00100000:0.0:1777497570.853257:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564916224:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853325:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853357:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564916736:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853379:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853397:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564917248:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853416:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853440:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1777497570.853446:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564915840:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853472:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853499:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564916352:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853518:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853531:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564916864:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853548:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853562:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564917376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853586:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853625:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564915968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853646:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853661:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564916480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853682:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853709:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564916992:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853728:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853743:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1777497570.853748:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564916096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853767:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853784:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564916608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853815:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853833:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564917120:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.853853:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.853886:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916224 00000100:00100000:0.0:1777497570.853905:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916224 00000100:00100000:0.0:1777497570.853953:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916352 00000100:00100000:0.0:1777497570.853957:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916352 00000100:00100000:0.0:1777497570.853970:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916864 00000100:00100000:0.0:1777497570.853972:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916864 00000100:00100000:0.0:1777497570.853982:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917376 00000100:00100000:0.0:1777497570.853984:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917376 00000100:00100000:0.0:1777497570.853992:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915968 00000100:00100000:0.0:1777497570.853994:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915968 00000100:00100000:0.0:1777497570.854004:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916096 00000100:00100000:0.0:1777497570.854006:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916096 00000100:00100000:0.0:1777497570.854019:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1777497570.854027:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564916224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854081:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564916224:12345-0@lo:400:kworker.0 Request processed in 54us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854088:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:0.0:1777497570.854126:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1777497570.854132:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564916352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854170:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564916352:12345-0@lo:400:kworker.0 Request processed in 38us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854176:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1777497570.854189:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1777497570.854195:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564916864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854221:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564916864:12345-0@lo:400:kworker.0 Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854226:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:0.0:1777497570.854237:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1777497570.854242:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564917376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854266:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564917376:12345-0@lo:400:kworker.0 Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854271:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1777497570.854283:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1777497570.854289:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564915968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854316:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564915968:12345-0@lo:400:kworker.0 Request processed in 28us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854321:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1777497570.854331:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1777497570.854337:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564916096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854361:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564916096:12345-0@lo:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854366:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:0.0:1777497570.854385:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916736 00000100:00100000:0.0:1777497570.854388:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916736 00000100:00100000:0.0:1777497570.854422:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917248 00000100:00100000:0.0:1777497570.854426:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917248 00000100:00100000:0.0:1777497570.854443:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916608 00000100:00100000:0.0:1777497570.854445:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916608 00000100:00100000:0.0:1777497570.854460:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917120 00000100:00100000:0.0:1777497570.854463:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917120 00000100:00100000:0.0:1777497570.854480:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:0.0:1777497570.854486:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564916736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854517:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564916736:12345-0@lo:400:kworker.0 Request processed in 32us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854522:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:0.0:1777497570.854532:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1777497570.854538:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564917248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854561:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564917248:12345-0@lo:400:kworker.0 Request processed in 24us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854567:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1777497570.854577:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1777497570.854583:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564916608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854606:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564916608:12345-0@lo:400:kworker.0 Request processed in 24us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854611:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1777497570.854621:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:0.0:1777497570.854627:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564917120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854650:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564917120:12345-0@lo:400:kworker.0 Request processed in 24us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854655:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:0.0:1777497570.854674:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564915840 00000100:00100000:0.0:1777497570.854684:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564915840 00000100:00100000:0.0:1777497570.854712:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1777497570.854718:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564915840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854750:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564915840:12345-0@lo:400:kworker.0 Request processed in 33us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.854756:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1777497570.854799:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497570.854803:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497570.854805:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497570.854807:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497570.854851:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564916096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854863:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564916608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854873:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564917120:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854881:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564915968:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854930:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564915840:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854941:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564916352:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854950:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564916864:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854958:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564917376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854969:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564916224:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854978:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564916736:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.854988:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564917248:0@lo:400:kworker.0 00000100:00100000:1.0:1777497570.855520:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916480 00000100:00100000:1.0:1777497570.855526:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916480 00000100:00100000:1.0:1777497570.855572:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564916992 00000100:00100000:1.0:1777497570.855575:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564916992 00000100:00100000:1.0:1777497570.855607:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1777497570.855614:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564916480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497570.855660:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564916480:12345-0@lo:400:kworker.0 Request processed in 47us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497570.855673:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3925 00000100:00100000:1.0:1777497570.855687:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3926 00000100:00100000:1.0:1777497570.855693:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564916992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497570.855721:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564916992:12345-0@lo:400:kworker.0 Request processed in 29us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497570.855726:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3926 00000100:00100000:0.0:1777497570.856796:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564917504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497570.856853:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497570.856907:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564916480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.856917:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564916992:0@lo:400:kworker.0 00000100:00100000:0.0:1777497570.856960:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917504 00000100:00100000:0.0:1777497570.856964:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917504 00000100:00100000:0.0:1777497570.856995:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1777497570.857000:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564917504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497570.857026:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497570.857062:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564917504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497570.857068:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3927 00000100:00100000:0.0:1777497570.857131:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564917504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497570.865777:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497570.865800:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564917632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497570.865870:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497570.865930:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917632 00000100:00100000:2.0:1777497570.865937:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917632 00000100:00100000:2.0:1777497570.865981:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1777497570.865990:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564917632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497570.866024:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497570.866070:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564917632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497570.866076:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3928 00000100:00100000:2.0:1777497570.866133:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564917632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497571.139562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497571.139617:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497571.139649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497571.139683:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497571.139714:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497571.139729:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300288 00000100:00100000:2.0:1777497571.139729:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300032 00000100:00100000:0.0:1777497571.139740:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300544 00000100:00100000:3.0:1777497571.139741:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300288 00000100:00100000:2.0:1777497571.139741:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300032 00000100:00100000:0.0:1777497571.139745:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300544 00000100:00100000:2.0:1777497571.139802:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:3.0:1777497571.139803:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300160 00000100:00100000:3.0:1777497571.139807:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300160 00000100:00100000:2.0:1777497571.139813:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546300032:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497571.139815:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300416 00000100:00100000:1.0:1777497571.139820:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300416 00000100:00100000:2.0:1777497571.139906:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82bfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546300032:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 96us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497571.139914:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:2.0:1777497571.140078:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1209 00000100:00100000:2.0:1777497571.140086:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546300288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497571.140154:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546300288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497571.140161:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1209 00000100:00100000:0.0:1777497571.142921:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2505 00000100:00100000:0.0:1777497571.142938:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546300544:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497571.143021:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546300544:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 90us (3370us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497571.143029:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2505 00000100:00100000:3.0:1777497571.151808:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1210 00000100:00100000:3.0:1777497571.151853:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2413:x1863837546300160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497571.152005:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2413:x1863837546300160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 173us (12320us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497571.152014:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1210 00000100:00100000:1.0:1777497571.155720:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2506 00000100:00100000:1.0:1777497571.155738:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546300416:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497571.155832:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2413:x1863837546300416:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 101us (16116us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497571.155849:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2506 00000100:00080000:2.0:1777497571.156208:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497571.156216:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497571.156219:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497571.156222:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497571.362361:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564917760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497571.362442:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497571.362597:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917760 00000100:00100000:3.0:1777497571.362606:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917760 00000100:00100000:3.0:1777497571.362665:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1777497571.362688:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564917760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497571.362718:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497571.362747:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497571.362783:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497571.362822:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918016 00000100:00100000:2.0:1777497571.362826:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918016 00000100:00100000:2.0:1777497571.362849:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1777497571.362855:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564918016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497571.362871:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497571.362912:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564918016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497571.362919:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:2.0:1777497571.362979:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497571.362994:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497571.362999:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564918144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497571.363032:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497571.363051:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918144 00000100:00100000:2.0:1777497571.363054:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918144 00000100:00100000:2.0:1777497571.363071:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1777497571.363077:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564918144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497571.363088:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497571.363142:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564918144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497571.363148:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:2.0:1777497571.363185:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564918144:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497571.363215:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564917888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497571.363235:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497571.363256:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564917888 00000100:00100000:2.0:1777497571.363259:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564917888 00000100:00100000:2.0:1777497571.363276:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1777497571.363281:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564917888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497571.363291:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497571.363315:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564917888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497571.363322:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1777497571.363354:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564917888:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497571.366707:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564917760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497571.366776:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564917760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4087us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497571.366787:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00010000:00010000:2.0:1777497571.490364:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497572.531211:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497573.151806:0:86232:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 132a: PFL new component instantiate replay ========================================================== 17:19:31 (1777497571) 00000100:00100000:0.0:1777497573.272167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497573.276809:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300672 00000100:00100000:2.0:1777497573.276828:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300672 00000100:00100000:2.0:1777497573.276989:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1221 00000100:00100000:2.0:1777497573.277003:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68752:x1863837546300672:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497573.277031:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497573.277058:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cc52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1a0 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277169:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277188:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277203:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277218:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277225:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277231:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277286:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277293:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277300:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277314:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277320:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497573.277325:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277335:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277349:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240817a3000) 00010000:00010000:2.0:1777497573.277352:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497573.277358:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277364:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691cc59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277376:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277382:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277388:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277394:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497573.277397:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277413:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277421:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff924093ca0400) 00010000:00010000:2.0:1777497573.277423:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497573.277425:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277430:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cc60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277467:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cc52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a0 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277478:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240817a3000) 00010000:00010000:2.0:1777497573.277481:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497573.277485:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cc52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a0 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.277494:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35c00, rc 0) 00000100:00100000:2.0:1777497573.277584:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68752:x1863837546300672:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 585us (5435us total) trans 0 rc 301/301 00000100:00100000:2.0:1777497573.277593:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1221 00000100:00080000:0.0:1777497573.280496:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497573.288198:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497573.288284:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546300928 00000100:00100000:0.0:1777497573.288299:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546300928 00000100:00100000:0.0:1777497573.288375:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1222 00000100:00100000:0.0:1777497573.288388:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68752:x1863837546300928:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497573.288419:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497573.288423:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1777497573.288465:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cc0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c17d expref: 10 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288485:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240817a3000) 00010000:00010000:0.0:1777497573.288502:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497573.288523:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691cc67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1a7 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288673:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288690:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288702:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288717:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288724:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.288730:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289266:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289276:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289284:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497573.289296:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:0.0:1777497573.289327:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289334:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289341:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289347:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289354:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497573.289359:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289369:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289378:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885eb600) 00010000:00010000:0.0:1777497573.289381:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497573.289392:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289399:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691cc6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497573.289411:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a60f8361 reply state 00000000b34d1973 transno 107374182404 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289423:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289430:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240885eb200) 00010000:00010000:0.0:1777497573.289432:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497573.289435:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497573.289471:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691cc67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 12 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289488:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.289496:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9240885ebd00) 00010000:00010000:0.0:1777497573.289498:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497573.289501:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8000, rc 0) 00000100:00100000:0.0:1777497573.289598:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68752:x1863837546300928:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1212us (1410us total) trans 107374182404 rc 0/0 00000100:00100000:0.0:1777497573.289606:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1222 00000100:00100000:3.0:1777497573.294466:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497573.295022:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546301184 00000100:00100000:0.0:1777497573.295034:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546301184 00000100:00100000:0.0:1777497573.295115:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1223 00000100:00100000:0.0:1777497573.295127:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68752:x1863837546301184:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497573.295169:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497573.295194:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691cc8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1ae expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.295324:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.295339:0:65418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 13 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.295346:0:65418:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 4/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.295382:0:65418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 13 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497573.295392:0:65418:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 13 pid: 63727 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497573.295405:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837564918272:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497573.295502:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497573.298440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497573.298481:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837564918272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1777497573.298512:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546301312 00010000:00010000:3.0:1777497573.298520:0:65418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497573.298521:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546301312 00010000:00010000:2.0:1777497573.298570:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 14 pid: 63727 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497573.298629:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2540 00000100:00100000:2.0:1777497573.298637:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+14:2415:x1863837546301312:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777497573.298656:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497573.298663:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 14 pid: 63727 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298673:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 14 pid: 63727 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298702:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691cc7c lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1a7 expref: 14 pid: 63727 timeout: 3802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298721:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9240885ebd00) 00010000:00010000:2.0:1777497573.298727:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298737:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298746:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 4/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497573.298778:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497573.298803:0:65418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.298809:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497573.298840:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2415:x1863837546301312:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 203us (416us total) trans 0 rc 0/0 00000004:00200000:3.0:1777497573.298842:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00000100:00100000:2.0:1777497573.298848:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2540 00000004:00080000:3.0:1777497573.299061:0:65418:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x91:0x0], count =625 00000004:00080000:3.0:1777497573.299072:0:65418:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000401:0x91:0x0]+625 in llog 00000004:00080000:3.0:1777497573.299143:0:65418:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x302:0x0], index 1: 0 00010000:00010000:3.0:1777497573.299291:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299308:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299314:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299320:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497573.299325:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299334:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299344:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff9240885ebd00) 00010000:00010000:3.0:1777497573.299349:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777497573.299353:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299359:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691cc91 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299430:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691cc8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ae expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299441:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240885eb500) 00010000:00010000:3.0:1777497573.299444:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497573.299447:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691cc8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ae expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497573.299460:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeee00, rc 0) 00000100:00100000:3.0:1777497573.299501:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68752:x1863837546301184:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4377us (5054us total) trans 107374182405 rc 301/301 00000100:00100000:3.0:1777497573.299509:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1223 00000100:00100000:3.0:1777497573.302545:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497573.302711:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546301568 00000100:00100000:0.0:1777497573.302725:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546301568 00000100:00100000:0.0:1777497573.302799:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 228 00000100:00100000:0.0:1777497573.302811:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68752:x1863837546301568:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1777497573.303243:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:68752:x1863837546301568:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 432us (708us total) trans 107374182406 rc 0/0 00000100:00100000:0.0:1777497573.303271:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 228 00000100:00100000:3.0:1777497573.307999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497573.308590:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546301824 00000100:00100000:1.0:1777497573.308604:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546301824 00000100:00100000:1.0:1777497573.308670:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 229 00000100:00100000:1.0:1777497573.308683:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+13:68752:x1863837546301824:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1777497573.308995:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+14:68752:x1863837546301824:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 316us (1009us total) trans 107374182407 rc 0/0 00000100:00100000:1.0:1777497573.309004:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 229 00010000:00010000:1.0:1777497573.542041:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777497574.327501:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182407 is committed 00010000:00010000:1.0:1777497574.327590:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327606:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327615:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327622:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497574.327628:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327637:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327661:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240885eb200) 00010000:00010000:1.0:1777497574.327665:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497574.327671:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.327678:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691cc75 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497574.410486:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497574.410759:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546301952 00000100:00100000:3.0:1777497574.410773:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546301952 00000100:00100000:3.0:1777497574.410852:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1224 00000100:00100000:3.0:1777497574.410875:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68761:x1863837546301952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497574.410907:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497574.410939:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cc9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1b5 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411034:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411064:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411080:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497574.411180:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497574.411185:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497574.411215:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411248:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cc9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1b5 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411299:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1b5 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.411310:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fc100) 00010000:00010000:3.0:1777497574.411314:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497574.411318:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc200, rc 0) 00000100:00100000:3.0:1777497574.412661:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68761:x1863837546301952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1777us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497574.412675:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1224 00000100:00100000:3.0:1777497574.422553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497574.422666:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302080 00000100:00100000:0.0:1777497574.422680:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302080 00000100:00100000:0.0:1777497574.422773:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1225 00000100:00100000:0.0:1777497574.422785:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68761:x1863837546302080:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497574.422846:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1777497574.422959:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68761:x1863837546302080:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 176us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497574.422967:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1225 00000100:00100000:0.0:1777497574.433883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497574.433965:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302208 00000100:00100000:2.0:1777497574.433992:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302208 00000100:00080000:0.0:1777497574.434244:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497574.434423:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1226 00000100:00100000:2.0:1777497574.434436:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68761:x1863837546302208:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497574.434489:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497574.434589:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68761:x1863837546302208:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 156us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497574.434597:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1226 00000100:00100000:0.0:1777497574.440587:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497574.443285:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302336 00000100:00100000:3.0:1777497574.443309:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302336 00000100:00100000:3.0:1777497574.444259:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2060 00000100:00100000:3.0:1777497574.444276:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68761:x1863837546302336:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497574.444321:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1777497574.444681:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497574.445251:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68761:x1863837546302336:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 974us (4672us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497574.445265:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2060 00000100:00100000:0.0:1777497574.450995:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497574.451075:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302464 00000100:00100000:2.0:1777497574.451090:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302464 00000100:00100000:2.0:1777497574.451191:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2061 00000100:00100000:2.0:1777497574.451205:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68761:x1863837546302464:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497574.451253:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497574.451337:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68761:x1863837546302464:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 135us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497574.451345:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2061 00000100:00080000:0.0:1777497574.451469:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497574.562345:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497574.591829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497574.602934:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302720 00000100:00100000:1.0:1777497574.602958:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302720 00000100:00100000:1.0:1777497574.603632:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1227 00000100:00100000:1.0:1777497574.603644:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68768:x1863837546302720:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:1.0:1777497574.603722:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497574.603759:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc200/0x3e357265691cca6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1b5 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603795:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fc100) 00010000:00010000:1.0:1777497574.603810:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497574.603909:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603926:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603939:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603952:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603958:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.603964:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604460:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604470:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604477:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604485:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604506:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497574.604512:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604521:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604533:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924086627800) 00010000:00010000:1.0:1777497574.604536:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497574.604540:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604548:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691ccad lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497574.604565:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000024a2bedb reply state 0000000066440196 transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604577:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.604583:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627600) 00010000:00010000:1.0:1777497574.604586:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497574.604589:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497574.604725:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+11:68768:x1863837546302720:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 1081us (12909us total) trans 107374182408 rc 0/0 00000100:00100000:1.0:1777497574.604733:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1227 00000100:00100000:0.0:1777497574.653817:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497574.654430:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302848 00000100:00100000:2.0:1777497574.654445:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302848 00000100:00100000:2.0:1777497574.654533:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1228 00000100:00100000:2.0:1777497574.654546:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:68771:x1863837546302848:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497574.654581:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497574.654622:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691ccbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1bc expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654733:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654749:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654762:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497574.654821:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497574.654826:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497574.654865:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654893:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691ccbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1bc expref: 13 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654917:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1bc expref: 12 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.654927:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0400) 00010000:00010000:2.0:1777497574.654931:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497574.654935:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35800, rc 0) 00000100:00100000:2.0:1777497574.655016:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68771:x1863837546302848:12345-192.168.202.4@tcp:101:rm.0 Request processed in 473us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497574.655024:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1228 00000100:00100000:0.0:1777497574.659581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497574.659683:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302976 00000100:00100000:3.0:1777497574.659697:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302976 00000100:00100000:3.0:1777497574.659773:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1229 00000100:00100000:3.0:1777497574.659786:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68771:x1863837546302976:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1777497574.659814:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497574.659841:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691ccc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1c3 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.659937:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.659978:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.659993:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660007:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660015:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660022:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660189:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/1,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660199:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660207:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497574.660260:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0xa:0x0]: returning size 0 00000004:00200000:3.0:1777497574.660265:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497574.660293:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660307:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660327:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660334:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660341:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660348:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660354:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497574.660359:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660367:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660381:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0400) 00010000:00010000:3.0:1777497574.660385:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497574.660390:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660397:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691ccd0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660415:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660421:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660432:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660437:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dce00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497574.660440:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660445:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660453:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627600) 00010000:00010000:3.0:1777497574.660455:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497574.660458:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660464:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691ccd7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660496:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691ccc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1c3 expref: 14 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660511:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1c3 expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497574.660518:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff92409f8fc000) 00010000:00010000:3.0:1777497574.660520:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497574.660523:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd000, rc 0) 00000100:00100000:3.0:1777497574.660604:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+13:68771:x1863837546302976:12345-192.168.202.4@tcp:101:rm.0 Request processed in 820us (1036us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497574.660622:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1229 00000100:00100000:0.0:1777497574.666549:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497574.666715:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303232 00000100:00100000:1.0:1777497574.666729:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303232 00000100:00100000:1.0:1777497574.666797:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1230 00000100:00100000:1.0:1777497574.666829:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+13:68771:x1863837546303232:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:1.0:1777497574.666927:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777497574.666965:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd000/0x3e357265691ccde lrc: 0/0,0 mode: --/PR res: [0x20000a811:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1c3 expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.666985:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff92409f8fc000) 00010000:00010000:1.0:1777497574.667000:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35800/0x3e357265691ccc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1bc expref: 12 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667007:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0400) 00010000:00010000:1.0:1777497574.667013:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497574.667043:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667059:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667070:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667083:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667090:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667142:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667237:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667248:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667253:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667479:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 3/0,1 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667488:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667497:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667504:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667512:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 4/0,1 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667518:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667539:0:64885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497574.667557:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667561:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667565:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667574:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497574.667579:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667585:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667592:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff924086627b00) 00010000:00010000:1.0:1777497574.667593:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497574.667596:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667600:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691ccf3 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667614:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667618:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667622:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667625:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667628:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497574.667629:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667638:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667643:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924086627800) 00010000:00010000:1.0:1777497574.667644:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497574.667646:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667649:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691cce5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497574.667656:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b1c79924 reply state 00000000471174d8 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667664:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497574.667667:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627600) 00010000:00010000:1.0:1777497574.667668:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497574.667670:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497574.667750:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+13:68771:x1863837546303232:12345-192.168.202.4@tcp:36:rm.0 Request processed in 924us (1309us total) trans 107374182409 rc 0/0 00000100:00100000:1.0:1777497574.667758:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1230 00010000:00010000:2.0:1777497574.667834:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497574.667842:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.667866:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497574.667870:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 2/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.667877:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 3/0,0 mode: PW/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.667886:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff924086627b00) 00010000:00010000:2.0:1777497574.667889:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777497574.667891:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 1/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.667897:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691ccfa lrc: 0/0,0 mode: --/PW res: [0x20000a811:0xa:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497574.667911:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497574.667913:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497574.667915:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497575.601949:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497575.973536:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564918400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973609:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973657:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564918912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973686:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973721:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564919424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973760:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973779:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564919936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973801:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973827:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1777497575.973834:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564918528:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973870:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973889:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564919040:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973914:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973930:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564919552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.973949:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.973967:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564920064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497575.973986:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497575.974021:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918912 00000100:00100000:1.0:1777497575.974028:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918912 00000100:00100000:1.0:1777497575.974079:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919424 00000100:00100000:1.0:1777497575.974081:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919424 00000100:00100000:1.0:1777497575.974130:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919936 00000100:00100000:1.0:1777497575.974133:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919936 00000100:00100000:1.0:1777497575.974144:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918528 00000100:00100000:1.0:1777497575.974146:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918528 00000100:00100000:1.0:1777497575.974161:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1777497575.974169:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564918912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974222:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564918912:12345-0@lo:400:kworker.0 Request processed in 54us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974229:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1777497575.974246:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1777497575.974259:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564919424:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497575.974273:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924088f85880 x1863837564919424/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1777497586 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.974300:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564919424:12345-0@lo:400:kworker.0 Request processed in 42us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974306:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1777497575.974319:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1777497575.974325:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564919936:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497575.974335:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcd55c00 x1863837564919936/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1777497586 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.974359:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564919936:12345-0@lo:400:kworker.0 Request processed in 35us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974365:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:1.0:1777497575.974376:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1777497575.974382:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564918528:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497575.974392:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f86224000 x1863837564918528/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1777497586 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.974412:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564918528:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974418:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1777497575.974443:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919040 00000100:00100000:1.0:1777497575.974446:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919040 00000100:00100000:1.0:1777497575.974471:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919552 00000100:00100000:1.0:1777497575.974473:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919552 00000100:00100000:1.0:1777497575.974483:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920064 00000100:00100000:1.0:1777497575.974484:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920064 00000100:00100000:1.0:1777497575.974501:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3929 00000100:00100000:1.0:1777497575.974505:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564919040:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497575.974517:0:23359:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2ea00 x1863837564919040/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1777497586 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.974540:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564919040:12345-0@lo:400:kworker.0 Request processed in 35us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974546:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3929 00000100:00100000:1.0:1777497575.974555:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1777497575.974559:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564919552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974584:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564919552:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974590:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3930 00000100:00100000:1.0:1777497575.974599:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3931 00000100:00100000:1.0:1777497575.974604:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564920064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497575.974626:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497575.974651:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564920064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.974657:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3931 00000100:00080000:1.0:1777497575.974677:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497575.974682:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497575.974720:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564918528:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974730:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564919040:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974738:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564919552:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974749:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564920064:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497575.974769:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564918912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974778:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564919424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.974785:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564919936:0@lo:400:kworker.0 00000100:00100000:0.0:1777497575.975046:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918400 00000100:00100000:0.0:1777497575.975051:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918400 00000100:00100000:0.0:1777497575.975111:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1777497575.975120:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564918400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497575.975159:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82bfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564918400:12345-0@lo:400:kworker.0 Request processed in 41us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497575.975174:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1777497575.975307:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564918656:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975339:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975357:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564919168:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975376:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975390:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564919680:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975409:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975428:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1777497575.975434:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564918784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975452:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975466:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564919296:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975492:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975507:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564919808:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975522:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.975552:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919168 00000100:00100000:2.0:1777497575.975555:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919168 00000100:00100000:2.0:1777497575.975585:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919680 00000100:00100000:2.0:1777497575.975588:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919680 00000100:00100000:2.0:1777497575.975603:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919296 00000100:00100000:2.0:1777497575.975606:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919296 00000100:00100000:2.0:1777497575.975624:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564919808 00000100:00100000:2.0:1777497575.975626:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564919808 00000100:00100000:2.0:1777497575.975646:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1777497575.975652:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564919168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975684:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564919168:12345-0@lo:400:kworker.0 Request processed in 33us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497575.975690:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:2.0:1777497575.975701:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:2.0:1777497575.975707:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564919680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.975732:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564919680:12345-0@lo:400:kworker.0 Request processed in 26us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497575.975737:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:0.0:1777497575.975929:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1777497575.975938:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564919296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497575.975970:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564919296:12345-0@lo:400:kworker.0 Request processed in 33us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497575.975975:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:0.0:1777497575.975987:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1777497575.975993:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564919808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497575.976016:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564919808:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497575.976021:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:2.0:1777497575.976313:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564920192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497575.976340:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497575.976419:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564919296:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.976429:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564919808:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.976437:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564919168:0@lo:400:kworker.0 00000100:00100000:2.0:1777497575.976456:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564919680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.977704:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918656 00000100:00100000:1.0:1777497575.977714:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918656 00000100:00100000:1.0:1777497575.977778:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564918784 00000100:00100000:1.0:1777497575.977782:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564918784 00000100:00100000:1.0:1777497575.977819:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1777497575.977829:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564918656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.977901:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564918656:12345-0@lo:400:kworker.0 Request processed in 75us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.977908:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1777497575.977923:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1777497575.977928:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564918784:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497575.977942:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240aee29180 x1863837564918784/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:331/0 lens 224/224 e 0 to 0 dl 1777497586 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.977966:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837564918784:12345-0@lo:400:kworker.0 Request processed in 38us (2513us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.977971:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:1.0:1777497575.978006:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564918784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497575.978017:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564918656:0@lo:400:kworker.0 00000100:00080000:1.0:1777497575.978043:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497575.978046:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497575.978049:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497575.978057:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497575.978080:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564918400:0@lo:400:kworker.0 00000100:00100000:0.0:1777497575.981887:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920192 00000100:00100000:0.0:1777497575.981904:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920192 00000100:00100000:1.0:1777497575.982142:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3932 00000100:00100000:1.0:1777497575.982153:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564920192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497575.982192:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00010000:00000080:1.0:1777497575.982219:0:23359:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240aee29f80 x1863837564920192/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:331/0 lens 224/368 e 0 to 0 dl 1777497586 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497575.982387:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564920192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (6045us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497575.982395:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3932 00000100:00100000:2.0:1777497575.982442:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564920192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497576.256565:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497576.256613:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497576.256702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497576.256738:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497576.256804:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303360 00000100:00100000:2.0:1777497576.256816:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303360 00000100:00100000:2.0:1777497576.256880:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:2.0:1777497576.256892:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546303360:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497576.256965:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed03850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546303360:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497576.256973:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:3.0:1777497576.257188:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303872 00000100:00100000:3.0:1777497576.257192:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303872 00000100:00100000:3.0:1777497576.257235:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2511 00000100:00100000:3.0:1777497576.257243:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546303872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497576.257278:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546303872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497576.257284:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2511 00000100:00080000:2.0:1777497576.257365:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497576.260194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497576.260306:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303744 00000100:00100000:3.0:1777497576.260317:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303744 00000100:00100000:3.0:1777497576.260378:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2512 00000100:00100000:3.0:1777497576.260389:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546303744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497576.260452:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546303744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497576.260459:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2512 00000100:00080000:0.0:1777497576.260949:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497576.261091:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303616 00000100:00100000:1.0:1777497576.261119:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303616 00000100:00100000:1.0:1777497576.261170:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303488 00000100:00100000:1.0:1777497576.261174:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303488 00000100:00100000:1.0:1777497576.261215:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1217 00000100:00100000:1.0:1777497576.261224:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546303616:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497576.261264:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546303616:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497576.261270:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1217 00000100:00100000:1.0:1777497576.261284:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1218 00000100:00100000:1.0:1777497576.261289:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2415:x1863837546303488:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:1.0:1777497576.261304:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f841a6d80 x1863837546303488/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:332/0 lens 224/224 e 0 to 0 dl 1777497587 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497576.261324:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2415:x1863837546303488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (4586us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497576.261347:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1218 00000100:00080000:0.0:1777497576.261425:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497576.261429:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497576.482569:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564920320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497576.482637:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497576.482682:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497576.482691:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564920448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497576.482714:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497576.482744:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920320 00000100:00100000:2.0:1777497576.482751:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920320 00000100:00100000:2.0:1777497576.482791:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920448 00000100:00100000:2.0:1777497576.482794:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920448 00000100:00100000:2.0:1777497576.482813:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:2.0:1777497576.482823:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564920320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497576.482862:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497576.482906:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564920320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497576.482913:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:2.0:1777497576.482939:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1777497576.482945:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564920448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497576.482963:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497576.482993:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564920448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497576.482999:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:2.0:1777497576.483052:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564920320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497576.483085:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564920448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497576.483212:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497576.483221:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564920576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497576.483249:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497576.483277:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920576 00000100:00100000:1.0:1777497576.483280:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920576 00000100:00100000:1.0:1777497576.483306:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1777497576.483312:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564920576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497576.483323:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497576.483351:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564920576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497576.483356:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1777497576.483384:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564920576:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497576.483652:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564920704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497576.483678:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497576.483725:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920704 00000100:00100000:3.0:1777497576.483730:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920704 00000100:00100000:3.0:1777497576.483756:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1777497576.483762:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564920704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497576.483772:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497576.487830:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564920704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 4057us (4139us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497576.487857:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:1.0:1777497576.489232:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564920704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497576.611337:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497577.642935:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497578.659272:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497579.684864:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1777497580.578418:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182409 is committed 00010000:00010000:2.0:1777497580.579216:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579230:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579237:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579243:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497580.579247:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579254:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579272:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627600) 00010000:00010000:2.0:1777497580.579276:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497580.579281:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579299:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff200/0x3e357265691ccb4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579316:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579322:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579328:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579332:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fea00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497580.579335:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579341:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579348:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627600) 00010000:00010000:2.0:1777497580.579351:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497580.579354:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497580.579359:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691ccec lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497580.709763:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497581.090288:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497581.092738:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564920832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497581.092824:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497581.093071:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920832 00000100:00100000:3.0:1777497581.093079:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920832 00000100:00100000:3.0:1777497581.093154:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1777497581.093162:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564920832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497581.093196:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497581.093238:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564920832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.093245:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3933 00000100:00100000:3.0:1777497581.093290:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564920832:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497581.096178:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497581.096201:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564920960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497581.096261:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497581.096307:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564920960 00000100:00100000:0.0:1777497581.096313:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564920960 00000100:00100000:0.0:1777497581.096370:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3934 00000100:00100000:0.0:1777497581.096378:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564920960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497581.096412:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1445236736 avail 1298997248 00010000:00000080:0.0:1777497581.096427:0:8407:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bb160000 x1863837564920960/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:337/0 lens 224/368 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497581.096466:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564920960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.096473:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3934 00000100:00100000:0.0:1777497581.096517:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564920960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497581.101801:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564921088:0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.102053:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497581.102197:0:85477:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921088 00000100:00100000:1.0:1777497581.102206:0:85477:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921088 00000100:00100000:1.0:1777497581.102257:0:85477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1777497581.102266:0:85477:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564921088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.104896:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564921472:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.104960:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.105011:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921472 00000100:00100000:2.0:1777497581.105027:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921472 00000100:00100000:2.0:1777497581.105079:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1777497581.105087:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564921472:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497581.105128:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240aee2bb80 x1863837564921472/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:337/0 lens 224/224 e 0 to 0 dl 1777497592 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497581.105182:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564921472:12345-0@lo:400:kworker.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.105189:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00080000:2.0:1777497581.105211:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497581.105245:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564921472:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.105276:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564921216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.105299:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.105321:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497581.105328:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564921344:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.105346:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.105369:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921216 00000100:00100000:2.0:1777497581.105372:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921216 00000100:00100000:2.0:1777497581.105399:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921344 00000100:00100000:2.0:1777497581.105402:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921344 00000100:00100000:2.0:1777497581.105419:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1777497581.105426:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564921216:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497581.105438:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240aee28e00 x1863837564921216/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:337/0 lens 224/224 e 0 to 0 dl 1777497592 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497581.105470:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564921216:12345-0@lo:400:kworker.0 Request processed in 45us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.105475:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1777497581.105494:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1221 00000100:00100000:2.0:1777497581.105500:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564921344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.105525:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564921344:12345-0@lo:400:kworker.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.105530:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1221 00000100:00080000:2.0:1777497581.105548:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497581.105550:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497581.105566:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564921344:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.105581:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564921216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.107146:0:85477:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed02c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564921088:12345-0@lo:400:kworker.0 Request processed in 4874us (5087us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.107454:0:85477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1777497581.108057:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564921088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.109322:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497581.110757:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564921728:0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.110834:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497581.110874:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497581.110881:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564921856:0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.110906:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497581.110942:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921728 00000100:00100000:0.0:1777497581.110950:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921728 00000100:00100000:0.0:1777497581.110999:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921856 00000100:00100000:0.0:1777497581.111002:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921856 00000100:00100000:0.0:1777497581.111022:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1777497581.111031:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564921728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.111084:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564921728:12345-0@lo:400:kworker.0 Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.111116:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:0.0:1777497581.111134:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1777497581.111139:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564921856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.111182:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564921856:12345-0@lo:400:kworker.0 Request processed in 44us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.111188:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00080000:0.0:1777497581.111209:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497581.111213:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497581.111251:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564921856:0@lo:400:kworker.0 00000100:00100000:0.0:1777497581.111262:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564921728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.114994:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564921984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.115071:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497581.115132:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564921600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.115862:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497581.115919:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921984 00000100:00100000:1.0:1777497581.115927:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921984 00000100:00100000:1.0:1777497581.115971:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564921600 00000100:00100000:1.0:1777497581.115974:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564921600 00000100:00100000:1.0:1777497581.116007:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1777497581.116016:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564921984:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497581.116042:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089358700 x1863837564921984/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:337/0 lens 224/224 e 0 to 0 dl 1777497592 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497581.116088:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564921984:12345-0@lo:400:kworker.0 Request processed in 74us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.116121:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1777497581.116139:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1777497581.116145:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564921600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.116960:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564921600:12345-0@lo:400:kworker.0 Request processed in 602us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.116969:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00080000:1.0:1777497581.116996:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497581.117035:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564921984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497581.117048:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564921600:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.117298:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564922112:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.117349:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497581.117419:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922112 00000100:00100000:1.0:1777497581.117425:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922112 00000100:00100000:1.0:1777497581.117465:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1777497581.117473:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564922112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497581.117582:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564922240:0@lo:400:kworker.0 00000100:00100000:3.0:1777497581.117611:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497581.117632:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497581.117637:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564922368:0@lo:400:kworker.0 00000100:00100000:3.0:1777497581.117658:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497581.117685:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922240 00000100:00100000:3.0:1777497581.117688:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922240 00000100:00100000:3.0:1777497581.117715:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:3.0:1777497581.117722:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564922240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497581.117766:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564922240:12345-0@lo:400:kworker.0 Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.117772:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:3.0:1777497581.117801:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922368 00000100:00100000:3.0:1777497581.117804:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922368 00000100:00100000:3.0:1777497581.117828:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1777497581.117834:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564922368:12345-0@lo:400:kworker.0 00010000:00000080:3.0:1777497581.117854:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf98700 x1863837564922368/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:337/0 lens 224/224 e 0 to 0 dl 1777497592 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497581.117883:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837564922368:12345-0@lo:400:kworker.0 Request processed in 49us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.117889:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1777497581.117920:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837564922368:0@lo:400:kworker.0 00000100:00100000:3.0:1777497581.117931:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564922240:0@lo:400:kworker.0 00000100:00080000:0.0:1777497581.122536:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497581.122543:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497581.125037:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564922112:12345-0@lo:400:kworker.0 Request processed in 7553us (7675us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.125052:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:2.0:1777497581.125504:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564922112:0@lo:400:kworker.0 00000100:00100000:2.0:1777497581.379838:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.379875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.379897:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.379925:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304128 00000100:00100000:2.0:1777497581.379935:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304128 00000100:00100000:2.0:1777497581.380002:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304256 00000100:00100000:2.0:1777497581.380005:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304256 00000100:00100000:2.0:1777497581.380031:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1225 00000100:00100000:2.0:1777497581.380041:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2415:x1863837546304128:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:2.0:1777497581.380075:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240aee29880 x1863837546304128/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 224/224 e 0 to 0 dl 1777497592 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497581.380157:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2415:x1863837546304128:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00080000:3.0:1777497581.380169:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497581.380174:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497581.380174:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1225 00000100:00100000:2.0:1777497581.380192:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1226 00000100:00100000:2.0:1777497581.380199:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546304256:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497581.380227:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546304256:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.380233:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1226 00000100:00100000:2.0:1777497581.380251:0:85478:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304000 00000100:00100000:2.0:1777497581.380254:0:85478:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304000 00000100:00100000:2.0:1777497581.380293:0:85478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1777497581.380300:0:85478:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546304000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497581.380325:0:85478:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aed02850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546304000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.380330:0:85478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1777497581.381710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497581.381760:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304512 00000100:00100000:0.0:1777497581.381767:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304512 00000100:00080000:3.0:1777497581.381816:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497581.381842:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2517 00000100:00100000:0.0:1777497581.381851:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546304512:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497581.381912:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2414:x1863837546304512:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 61us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.381919:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2517 00000100:00100000:2.0:1777497581.382368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497581.385632:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304384 00000100:00100000:0.0:1777497581.385646:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304384 00000100:00080000:3.0:1777497581.385782:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497581.385815:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2518 00000100:00100000:0.0:1777497581.385826:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546304384:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497581.385914:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+5:2415:x1863837546304384:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 90us (3545us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.385935:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2518 00000001:02000400:1.0:1777497581.500070:0:86627:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:2.0:1777497581.595208:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.595278:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304640 00000100:00100000:3.0:1777497581.595288:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304640 00000100:00100000:3.0:1777497581.595341:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1231 00000100:00100000:3.0:1777497581.595350:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:68839:x1863837546304640:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497581.595370:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497581.595389:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691cd01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1ca expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595447:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595460:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595471:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497581.595519:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497581.595522:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497581.595539:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595560:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dce00/0x3e357265691cd01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ca expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595577:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ca expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.595586:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fca00) 00010000:00010000:3.0:1777497581.595589:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497581.595592:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc600, rc 0) 00010000:00000080:3.0:1777497581.595599:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089386d80 x1863837546304640/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 576/688 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.595651:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68839:x1863837546304640:12345-192.168.202.4@tcp:101:dd.0 Request processed in 303us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.595658:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1231 00000100:00100000:3.0:1777497581.600827:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.602019:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546304896 00000100:00100000:2.0:1777497581.602031:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546304896 00000100:00100000:3.0:1777497581.602254:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1232 00000100:00100000:3.0:1777497581.602267:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:68839:x1863837546304896:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497581.602292:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497581.602295:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1777497581.602320:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc600/0x3e357265691cd08 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ca expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602352:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fca00) 00010000:00010000:3.0:1777497581.602362:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497581.602375:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd0f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1d1 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602500:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602514:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602523:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602535:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602541:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602547:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602603:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd24 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602610:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd24 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602617:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd24 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497581.602633:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 0 00010000:00010000:3.0:1777497581.602728:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602735:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602741:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602759:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602765:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.602770:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602777:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602794:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f8fcd00) 00010000:00010000:3.0:1777497581.602798:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.602801:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602808:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cd16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602818:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602823:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602836:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602841:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.602843:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602848:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602854:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff92409f8fcf00) 00010000:00010000:3.0:1777497581.602857:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.602859:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602864:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602900:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd0f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d1 expref: 12 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602912:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd24 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d1 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.602920:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.602922:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497581.602924:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc800, rc 0) 00010000:00000080:3.0:1777497581.602931:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf98e00 x1863837546304896/t107374182410(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 776/848 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.603011:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+11:68839:x1863837546304896:12345-192.168.202.4@tcp:101:dd.0 Request processed in 748us (2193us total) trans 107374182410 rc 0/0 00000100:00100000:3.0:1777497581.603018:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1232 00000100:00100000:2.0:1777497581.603290:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564922496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497581.603341:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.603375:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497581.603382:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564922624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497581.603412:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.603444:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922496 00000100:00100000:2.0:1777497581.603450:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922496 00000100:00100000:2.0:1777497581.603489:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922624 00000100:00100000:2.0:1777497581.603492:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922624 00000100:00100000:2.0:1777497581.603512:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1777497581.603519:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564922496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497581.603545:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497581.603580:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564922496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.603585:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:2.0:1777497581.603597:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:2.0:1777497581.603604:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564922624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497581.603618:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497581.603639:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564922624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.603644:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:2.0:1777497581.604487:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564922624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497581.604499:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564922496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497581.608200:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564922752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497581.608817:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.608834:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564922880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497581.608870:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497581.608908:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922752 00000100:00100000:2.0:1777497581.608916:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922752 00000100:00100000:2.0:1777497581.608969:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564922880 00000100:00100000:2.0:1777497581.608972:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564922880 00000100:00100000:2.0:1777497581.609002:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1777497581.609010:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564922752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497581.609035:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497581.609077:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564922752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.609090:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:2.0:1777497581.609122:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:2.0:1777497581.609127:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564922880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497581.609138:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497581.609168:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564922880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.609173:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00100000:3.0:1777497581.609325:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.609372:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564922752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497581.609394:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305024 00000100:00100000:2.0:1777497581.609395:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb160a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564922880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497581.609397:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305024 00000100:00100000:3.0:1777497581.609427:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1233 00000100:00100000:3.0:1777497581.609434:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:68839:x1863837546305024:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497581.609450:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497581.609471:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd32 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1d8 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609504:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dda00/0x3e357265691cd39 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609518:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dda00/0x3e357265691cd39 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609530:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dda00/0x3e357265691cd39 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609726:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd32 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d8 expref: 13 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609851:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dda00/0x3e357265691cd39 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d8 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.609860:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.609863:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497581.609866:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dda00, rc 0) 00010000:00000080:3.0:1777497581.609874:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcf99880 x1863837546305024/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 568/1344 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.609931:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68839:x1863837546305024:12345-192.168.202.4@tcp:101:dd.0 Request processed in 497us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.609938:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1233 00000100:00100000:2.0:1777497581.615209:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.615266:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305280 00000100:00100000:3.0:1777497581.615277:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305280 00000100:00100000:3.0:1777497581.615375:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1234 00000100:00100000:3.0:1777497581.615386:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+12:68839:x1863837546305280:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497581.615436:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497581.615461:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd24 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d1 expref: 12 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.615476:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.615480:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497581.615739:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.615839:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.615862:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777497581.615906:0:64885:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182411 00000004:00010000:3.0:1777497581.615929:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cb26813f reply state 00000000fb7db7ae transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.615940:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.615947:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.615949:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497581.615951:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00000080:3.0:1777497581.615988:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089384a80 x1863837546305280/t107374182412(0) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 488/456 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497581.616332:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+14:68839:x1863837546305280:12345-192.168.202.4@tcp:36:dd.0 Request processed in 948us (1132us total) trans 107374182412 rc 0/0 00000100:00100000:3.0:1777497581.616340:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1234 00000020:00080000:3.0:1777497581.616346:0:64885:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777497581.628467:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497581.628605:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305408 00000100:00100000:1.0:1777497581.628616:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305408 00000100:00100000:1.0:1777497581.628688:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1235 00000100:00100000:1.0:1777497581.628699:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+14:68839:x1863837546305408:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497581.628724:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497581.628744:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691cd47 lrc: 2/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1df expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497581.628815:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691cd47 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1df expref: 15 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497581.628833:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691cd47 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1df expref: 15 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497581.628852:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:1.0:1777497581.628856:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777497581.628859:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe400, rc 0) 00010000:00000080:1.0:1777497581.628867:0:63727:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089386a00 x1863837546305408/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 376/584 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497581.628946:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+15:68839:x1863837546305408:12345-192.168.202.4@tcp:101:dd.0 Request processed in 249us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.628954:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1235 00000100:00100000:1.0:1777497581.643703:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.644089:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305664 00000100:00100000:2.0:1777497581.644114:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305664 00000100:00100000:2.0:1777497581.644171:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1236 00000100:00100000:2.0:1777497581.644181:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+15:68839:x1863837546305664:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497581.644203:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497581.644205:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777497581.644231:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691cd47 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1df expref: 15 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644248:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:2.0:1777497581.644252:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497581.644266:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cd4e lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1e6 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644314:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644341:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644351:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497581.644456:0:63729:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x283:0x0], count =127 00000004:00080000:2.0:1777497581.644463:0:63729:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x283:0x0]+127 in llog 00000004:00080000:2.0:1777497581.644488:0:63729:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x302:0x0], index 0: 0 00000004:00080000:2.0:1777497581.644495:0:63729:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:2.0:1777497581.644585:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 17 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644593:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:2.0:1777497581.644596:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1777497581.644605:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cd4e lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 17 pid: 63729 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644618:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 16 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.644648:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:2.0:1777497581.644651:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1777497581.644653:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34a00, rc 0) 00010000:00000080:2.0:1777497581.644662:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f8410ca80 x1863837546305664/t107374182413(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 376/608 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497581.644889:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+16:68839:x1863837546305664:12345-192.168.202.4@tcp:101:dd.0 Request processed in 708us (1190us total) trans 107374182413 rc 0/0 00000100:00100000:2.0:1777497581.644903:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1236 00000100:00100000:3.0:1777497581.656409:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497581.656505:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305792 00000100:00100000:0.0:1777497581.656516:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305792 00000100:00100000:0.0:1777497581.656578:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5861 00000100:00100000:0.0:1777497581.656588:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68839:x1863837546305792:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497581.656609:0:25491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497581.656631:0:25491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cd5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1ed expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497581.656665:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497581.656688:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497581.656691:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497581.656700:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cd5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ed expref: 6 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.656720:0:25491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cd5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ed expref: 6 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.656734:0:25491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee400, rc 0) 00000100:00100000:0.0:1777497581.656800:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68839:x1863837546305792:12345-192.168.202.4@tcp:101:dd.0 Request processed in 214us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.656807:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5861 00000100:00100000:0.0:1777497581.659369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497581.659466:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305920 00000100:00100000:1.0:1777497581.659475:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305920 00000100:00100000:1.0:1777497581.659546:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5862 00000100:00100000:1.0:1777497581.659557:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+5:68839:x1863837546305920:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497581.659574:0:25489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497581.659592:0:25489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691cd63 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1f4 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497581.659618:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x302:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497581.659639:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497581.659642:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497581.659651:0:25489:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1f4 expref: 6 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497581.659869:0:25489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1f4 expref: 6 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497581.659884:0:25489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff800, rc 0) 00000100:00100000:1.0:1777497581.659948:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68839:x1863837546305920:12345-192.168.202.4@tcp:101:dd.0 Request processed in 393us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.659955:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5862 00000100:00100000:3.0:1777497581.662275:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497581.662322:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306048 00000100:00100000:0.0:1777497581.662331:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306048 00000100:00100000:0.0:1777497581.662392:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5863 00000100:00100000:0.0:1777497581.662402:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+6:68839:x1863837546306048:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497581.662425:0:25497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497581.662445:0:25497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cd6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1fb expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497581.662469:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497581.662635:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497581.662638:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497581.662645:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1fb expref: 7 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.662738:0:25497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cd6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1fb expref: 7 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.662752:0:25497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef600, rc 0) 00000100:00100000:0.0:1777497581.662858:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+7:68839:x1863837546306048:12345-192.168.202.4@tcp:101:dd.0 Request processed in 458us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.662865:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5863 00000100:00100000:3.0:1777497581.674112:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.674152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.674263:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306176 00000100:00100000:2.0:1777497581.674273:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306176 00002000:00010000:2.0:1777497581.674308:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/770 (1048576->18446744073709551615) 00002000:00100000:2.0:1777497581.674313:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d40a80 with x1863837546306176 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1777497581.674325:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f82d40a80. 00000100:00100000:2.0:1777497581.674350:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306304 00000100:00100000:2.0:1777497581.674352:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306304 00002000:00010000:2.0:1777497581.674362:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:2.0:1777497581.674364:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d40380 with x1863837546306304 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497581.674369:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f82d40380. 00000100:00100000:2.0:1777497581.674381:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1000 00000100:00100000:2.0:1777497581.674389:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546306176:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497581.674585:0:8401:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb size from disk: 0 -> 1048576 00002000:00010000:2.0:1777497581.674589:0:8401:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb mtime from disk: 0 -> 1777497581 00002000:00010000:2.0:1777497581.674591:0:8401:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1777497581.674593:0:8401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb ctime from disk: 0 -> 1777497581 00002000:00010000:2.0:1777497581.674595:0:8401:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1777497581.674643:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546306176:12345-192.168.202.4@tcp:10:dd.0 Request processed in 254us (558us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1777497581.674650:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1000 00002000:00010000:2.0:1777497581.674653:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/770 (1048576->18446744073709551615) 00002000:00100000:2.0:1777497581.674656:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d40a80 with x1863837546306176 ext(1048576->18446744073709551615) 00002000:00010000:2.0:1777497581.674660:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f82d40a80. 00000100:00100000:2.0:1777497581.674675:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1001 00000100:00100000:2.0:1777497581.674688:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546306304:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497581.674777:0:8401:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777497581.674780:0:8401:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb mtime from disk: 0 -> 1777497581 00002000:00010000:2.0:1777497581.674782:0:8401:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1777497581.674784:0:8401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb ctime from disk: 0 -> 1777497581 00002000:00010000:2.0:1777497581.674797:0:8401:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x2c0000401:0x303:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1777497581.674819:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546306304:12345-192.168.202.4@tcp:10:dd.0 Request processed in 131us (666us total) trans 4294969450 rc 0/0 00000100:00100000:2.0:1777497581.674824:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1001 00002000:00010000:2.0:1777497581.674827:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/771 (0->18446744073709551615) 00002000:00100000:2.0:1777497581.674829:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d40380 with x1863837546306304 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497581.674833:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f82d40380. 00010000:00010000:1.0:1777497581.734352:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497581.739003:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.739202:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306560 00000100:00100000:3.0:1777497581.739214:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306560 00000100:00100000:3.0:1777497581.739269:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 230 00000100:00100000:3.0:1777497581.739281:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+16:68839:x1863837546306560:12345-192.168.202.4@tcp:35:dd.0 00010000:00000080:3.0:1777497581.739508:0:66634:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f8410fb80 x1863837546306560/t107374182414(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 392/456 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.739580:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+17:68839:x1863837546306560:12345-192.168.202.4@tcp:35:dd.0 Request processed in 301us (595us total) trans 107374182414 rc 0/0 00000100:00100000:3.0:1777497581.739588:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 230 00000100:00100000:3.0:1777497581.776148:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.776262:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306688 00000100:00100000:2.0:1777497581.776275:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306688 00000100:00100000:2.0:1777497581.776340:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1237 00000100:00100000:2.0:1777497581.776351:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+17:68840:x1863837546306688:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497581.776379:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497581.776403:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cd71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c202 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776466:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776477:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776485:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497581.776541:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497581.776543:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497581.776561:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776579:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cd71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c202 expref: 19 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776593:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c202 expref: 18 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.776599:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:2.0:1777497581.776601:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497581.776604:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35c00, rc 0) 00010000:00000080:2.0:1777497581.776612:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82d42680 x1863837546306688/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 576/688 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497581.776676:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68840:x1863837546306688:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 326us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.776683:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1237 00000100:00100000:0.0:1777497581.782491:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.782573:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546306944 00000100:00100000:3.0:1777497581.782584:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546306944 00000100:00100000:3.0:1777497581.782642:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1238 00000100:00100000:3.0:1777497581.782652:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68840:x1863837546306944:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497581.782671:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497581.782691:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c209 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782772:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782794:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782807:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782822:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782828:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782834:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782926:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782933:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782938:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782944:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782950:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.782954:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782961:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782972:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:3.0:1777497581.782975:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.782981:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.782988:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cd86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783002:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783007:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783020:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783025:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.783027:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783033:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783040:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff92409f8fcd00) 00010000:00010000:3.0:1777497581.783043:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.783046:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783051:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cd8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783086:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c209 expref: 19 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783153:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:3.0:1777497581.783156:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497581.783160:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cd7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c209 expref: 19 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.783170:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc800, rc 0) 00010000:00000080:3.0:1777497581.783177:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bb162300 x1863837546306944/t0(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 800/608 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 301/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.783251:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68840:x1863837546306944:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 601us (769us total) trans 0 rc 301/301 00000100:00100000:3.0:1777497581.783259:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1238 00000100:00100000:1.0:1777497581.792756:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497581.792865:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307072 00000100:00100000:0.0:1777497581.792878:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307072 00000100:00100000:0.0:1777497581.792934:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1239 00000100:00100000:0.0:1777497581.792945:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68840:x1863837546307072:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:0.0:1777497581.793016:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793034:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793067:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793087:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793132:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793141:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793222:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793231:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793237:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497581.793277:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:0.0:1777497581.793282:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497581.793295:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793306:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793312:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793328:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793334:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497581.793338:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793345:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793356:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:0.0:1777497581.793360:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497581.793364:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793371:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee000/0x3e357265691cd94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793382:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793387:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793393:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793398:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497581.793401:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793421:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793428:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240a6e49100) 00010000:00010000:0.0:1777497581.793430:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497581.793433:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793438:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691cd9b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793452:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793458:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793463:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793468:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497581.793470:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793476:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793483:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:0.0:1777497581.793486:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497581.793488:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497581.793504:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691cda2 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:0.0:1777497581.793524:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f8410c000 x1863837546307072/t0(0) o34->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 472/728 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497581.793593:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68840:x1863837546307072:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 650us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497581.793601:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1239 00000100:00100000:0.0:1777497581.821233:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497581.821340:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307328 00000100:00100000:2.0:1777497581.821351:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307328 00000100:00100000:2.0:1777497581.821404:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1240 00000100:00100000:2.0:1777497581.821413:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+18:68842:x1863837546307328:12345-192.168.202.4@tcp:101:md5sum.0 00010000:00010000:2.0:1777497581.821436:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497581.821455:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cda9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c210 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821548:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821562:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821572:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821587:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821594:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497581.821600:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822525:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cdbe lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822538:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cdbe lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822645:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cdbe lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497581.822659:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00010000:00010000:3.0:1777497581.822761:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822769:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822774:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822781:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822795:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.822799:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822805:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822825:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:3.0:1777497581.822827:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.822830:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822835:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35600/0x3e357265691cdb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822845:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822849:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822852:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822855:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.822856:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822859:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822862:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff924093ca0b00) 00010000:00010000:3.0:1777497581.822864:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.822865:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822868:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34400/0x3e357265691cdb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822929:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35200/0x3e357265691cda9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c210 expref: 21 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822939:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cdbe lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c210 expref: 20 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.822944:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.822945:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497581.822947:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc800, rc 0) 00010000:00000080:3.0:1777497581.822952:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bb162680 x1863837546307328/t107374182415(0) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 800/872 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.823022:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+20:68842:x1863837546307328:12345-192.168.202.4@tcp:101:md5sum.0 Request processed in 1610us (1798us total) trans 107374182415 rc 0/0 00000100:00100000:3.0:1777497581.823029:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1240 00000100:00100000:3.0:1777497581.840579:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497581.842259:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307456 00000100:00100000:1.0:1777497581.842277:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307456 00002000:00100000:1.0:1777497581.842337:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff923f82d43b80 x1863837546307456/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 488/0 e 0 to 0 dl 1777497592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497581.842349:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d43b80 with x1863837546307456 ext(0->32767) 00002000:00010000:1.0:1777497581.842354:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f82d43b80 00000100:00100000:1.0:1777497581.842390:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1002 00000100:00100000:1.0:1777497581.842401:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546307456:12345-192.168.202.4@tcp:3:md5sum.0 00000100:00100000:2.0:1777497581.847603:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2413:x1863837546307456:12345-192.168.202.4@tcp:3:md5sum.0 Request processed in 5194us (7026us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497581.847618:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1002 00002000:00100000:2.0:1777497581.847631:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff923f82d43b80 x1863837546307456/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 488/440 e 0 to 0 dl 1777497592 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497581.847641:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82d43b80 with x1863837546307456 ext(0->32767) 00002000:00010000:2.0:1777497581.847646:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f82d43b80 00000100:00100000:0.0:1777497581.862225:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497581.862325:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307584 00000100:00100000:1.0:1777497581.862337:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307584 00002000:00100000:1.0:1777497581.862384:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9240bb161180 x1863837546307584/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 488/0 e 0 to 0 dl 1777497592 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497581.862394:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bb161180 with x1863837546307584 ext(32768->1048575) 00002000:00010000:1.0:1777497581.862399:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9240bb161180 00000100:00100000:1.0:1777497581.862432:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1003 00000100:00100000:1.0:1777497581.862441:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2415:x1863837546307584:12345-192.168.202.4@tcp:3:md5sum.0 00000100:00100000:1.0:1777497581.868548:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2415:x1863837546307584:12345-192.168.202.4@tcp:3:md5sum.0 Request processed in 5644us (5869us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497581.868562:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1003 00002000:00100000:1.0:1777497581.868574:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff9240bb161180 x1863837546307584/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 488/440 e 0 to 0 dl 1777497592 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497581.868584:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bb161180 with x1863837546307584 ext(32768->1048575) 00002000:00010000:1.0:1777497581.868661:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9240bb161180 00000100:00100000:0.0:1777497581.914509:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.914617:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307840 00000100:00100000:3.0:1777497581.914627:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307840 00000100:00100000:3.0:1777497581.914689:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:3.0:1777497581.914700:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+20:68842:x1863837546307840:12345-192.168.202.4@tcp:35:md5sum.0 00010000:00000080:3.0:1777497581.914980:0:63730:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bb163800 x1863837546307840/t107374182416(0) o35->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 392/456 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.915142:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+21:68842:x1863837546307840:12345-192.168.202.4@tcp:35:md5sum.0 Request processed in 444us (642us total) trans 107374182416 rc 0/0 00000100:00100000:3.0:1777497581.915150:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 231 00000100:00100000:0.0:1777497581.964733:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497581.964845:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546307968 00000100:00100000:3.0:1777497581.964855:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546307968 00000100:00100000:3.0:1777497581.964921:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1241 00000100:00100000:3.0:1777497581.964931:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+21:68844:x1863837546307968:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:3.0:1777497581.965012:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965031:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965044:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965060:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965067:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965074:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965183:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965192:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965199:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497581.965238:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 2097152 00000004:00200000:3.0:1777497581.965257:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497581.965271:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965286:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965292:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965299:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965305:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965311:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.965315:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965322:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965334:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0000) 00010000:00010000:3.0:1777497581.965337:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.965341:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965347:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd200/0x3e357265691cdcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965362:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965378:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965384:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965388:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.965391:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965397:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965404:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff92409f8fcd00) 00010000:00010000:3.0:1777497581.965407:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.965409:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965415:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd800/0x3e357265691cdd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965429:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965435:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965440:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965444:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497581.965453:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965459:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965467:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:3.0:1777497581.965470:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497581.965472:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497581.965477:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc000/0x3e357265691cdda lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00000080:3.0:1777497581.965501:0:65418:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bb161c00 x1863837546307968/t0(0) o34->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:337/0 lens 472/728 e 0 to 0 dl 1777497592 ref 1 fl Interpret:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497581.965563:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+21:68844:x1863837546307968:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 634us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497581.965571:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1241 00010000:00010000:2.0:1777497582.754665:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497582.914944:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497582.916643:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497582.924014:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308224 00000100:00100000:3.0:1777497582.924030:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308224 00000100:00100000:3.0:1777497582.924118:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5864 00000100:00100000:3.0:1777497582.924128:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546308224:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:2.0:1777497582.924597:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308096 00000100:00100000:2.0:1777497582.924604:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308096 00002000:00100000:2.0:1777497582.924643:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff9240bb161f80 x1863837546308096/t0(0) o4->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:338/0 lens 488/0 e 0 to 0 dl 1777497593 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497582.924653:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bb161f80 with x1863837546308096 ext(1048576->2097151) 00002000:00010000:2.0:1777497582.924659:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bb161f80 00000100:00100000:2.0:1777497582.924685:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1004 00000100:00100000:2.0:1777497582.924693:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308096:12345-192.168.202.4@tcp:4:md5sum.0 00000001:00080000:0.0:1777497582.926090:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969454 is committed 00000100:00100000:0.0:1777497582.926235:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546308224:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 2104us (9594us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497582.926246:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5864 00000100:00100000:1.0:1777497582.970326:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308096:12345-192.168.202.4@tcp:4:md5sum.0 Request processed in 45622us (55379us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1777497582.970339:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1004 00002000:00100000:1.0:1777497582.970352:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff9240bb161f80 x1863837546308096/t4294969455(0) o4->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:338/0 lens 488/448 e 0 to 0 dl 1777497593 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497582.970363:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bb161f80 with x1863837546308096 ext(1048576->2097151) 00002000:00010000:1.0:1777497582.970370:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bb161f80 00010000:00010000:0.0:1777497583.778755:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1777497583.833214:0:86724:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1777497583.833274:0:86724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.833289:0:86724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.833295:0:86724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.833301:0:86724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.833323:0:86724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1777497583.833328:0:86724:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1777497583.833354:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497583.833358:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1777497583.833363:0:86724:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1777497583.833390:0:86724:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1777497583.833423:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564923008:0@lo:39:umount.0 00000100:00100000:2.0:1777497583.833488:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.837913:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923008 00000100:00100000:2.0:1777497583.837925:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923008 00000100:00100000:2.0:1777497583.837981:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1777497583.837991:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564923008:12345-0@lo:39:umount.0 00000020:00000080:2.0:1777497583.838020:0:73210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ca0d 00000100:00080000:2.0:1777497583.838034:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from FULL to CLOSED 00010000:00000080:2.0:1777497583.838063:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089384700 x1863837564923008/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:339/0 lens 224/224 e 0 to 0 dl 1777497594 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497583.838154:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837564923008:12345-0@lo:39:umount.0 Request processed in 165us (4666us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.838161:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000020:00000080:2.0:1777497583.838173:0:73210:0:(genops.c:906:class_export_put()) final put ffff9240bcc6f800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1777497583.838218:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcc6f800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497583.838260:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc6e800 for lustre-MDT0000 00000100:00080000:2.0:1777497583.838300:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497583.838312:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564923008:0@lo:39:umount.0 00000100:00080000:2.0:1777497583.838341:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497583.838344:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1777497583.838348:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1777497583.839311:0:86724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839325:0:86724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839332:0:86724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839353:0:86724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839372:0:86724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497583.839378:0:86724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839384:0:86724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839389:0:86724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839395:0:86724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839407:0:86724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777497583.839421:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497583.839426:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839432:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497583.839435:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839443:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497583.839450:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497583.839462:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497583.839465:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1777497583.839467:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1777497583.839496:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839501:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497583.839521:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839527:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691c8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8fc expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839541:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497583.839544:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839549:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497583.839551:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839558:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497583.839563:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497583.839567:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497583.839569:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1777497583.839580:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839591:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497583.839598:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839604:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38200/0x3e357265691c815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c81c expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839613:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497583.839615:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839620:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497583.839623:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839629:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497583.839635:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497583.839640:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497583.839642:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1777497583.839643:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1777497583.839656:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839661:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497583.839685:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839700:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691c934 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c93b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.839708:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.839710:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.839712:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840300:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840307:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840317:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497583.840342:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564923264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497583.840404:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777497583.840470:0:86724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840490:0:86724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840497:0:86724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840503:0:86724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840516:0:86724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497583.840525:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497583.840529:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840535:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39a00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497583.840538:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840545:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497583.840551:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497583.840557:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1777497583.840560:0:6503:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1777497583.840562:0:6503:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1777497583.840581:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840597:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497583.840607:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840613:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691c8e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c8ee expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840624:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840625:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840627:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497583.840637:0:86724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840645:0:86724:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840651:0:86724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840657:0:86724:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.840670:0:86724:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777497583.840674:0:86724:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1777497583.840678:0:86724:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1777497583.840716:0:86724:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000100:00100000:2.0:1777497583.841700:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564923136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497583.841880:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.841942:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564923520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497583.841966:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.841987:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497583.841994:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564923392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497583.842013:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.842042:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923264 00000100:00100000:2.0:1777497583.842049:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923264 00000100:00100000:2.0:1777497583.842113:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923136 00000100:00100000:2.0:1777497583.842116:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923136 00000100:00100000:2.0:1777497583.842133:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923520 00000100:00100000:2.0:1777497583.842136:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923520 00000100:00100000:2.0:1777497583.842147:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923392 00000100:00100000:2.0:1777497583.842149:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923392 00000100:00100000:2.0:1777497583.842162:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1777497583.842170:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+26:3660:x1863837564923264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497583.842183:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497583.842200:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9600/0x3e357265691c81c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c815 expref: 26 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842229:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497583.842263:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3660:x1863837564923264:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (1859us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.842269:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1777497583.842287:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1777497583.842292:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409b413050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3659:x1863837564923136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497583.842300:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497583.842308:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39400/0x3e357265691c8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c8f5 expref: 24 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842317:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497583.842338:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409b413050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564923136:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.842344:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:2.0:1777497583.842379:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1777497583.842384:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837564923520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497583.842391:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497583.842399:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38c00/0x3e357265691c8ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c8e7 expref: 22 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842408:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497583.842431:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3658:x1863837564923520:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.842436:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:2.0:1777497583.842448:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1777497583.842453:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3658:x1863837564923392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497583.842465:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497583.842473:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef200/0x3e357265691c93b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c934 expref: 20 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842481:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497583.842500:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3658:x1863837564923392:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.842505:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1777497583.842548:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564923392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497583.842557:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564923520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497583.842583:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564923264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497583.842597:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497583.842603:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842611:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497583.842615:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842623:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497583.842629:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497583.842634:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497583.842637:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1777497583.842645:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1777497583.842668:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842674:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497583.842686:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842693:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b34200/0x3e357265691c800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691c80e expref: -99 pid: 85470 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497583.842703:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.842705:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.842706:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497583.842712:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497583.842719:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564923648:0@lo:103:ldlm_bl.0 00000020:01000000:0.0:1777497583.842872:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:0.0:1777497583.842880:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:0.0:1777497583.842887:0:86724:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00000100:00100000:2.0:1777497583.849146:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.849235:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564923136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497583.850965:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923648 00000100:00100000:3.0:1777497583.850980:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923648 00000100:00100000:3.0:1777497583.851051:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:3.0:1777497583.851060:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3660:x1863837564923648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497583.851076:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497583.851129:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38400/0x3e357265691c80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c800 expref: 19 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497583.851163:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497583.851234:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3660:x1863837564923648:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (2091us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497583.851242:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1777497583.851337:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564923648:0@lo:103:ldlm_bl.0 00000004:00000080:0.0:1777497583.860057:0:86724:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000001:00080000:1.0:1777497583.861448:0:85471:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182416 is committed 00010000:00010000:0.0:1777497583.865216:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865234:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865242:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865248:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497583.865253:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865261:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865278:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409f8fc400) 00010000:00010000:0.0:1777497583.865281:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497583.865286:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.865292:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dd600/0x3e357265691cd40 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1777497583.865367:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:0.0:1777497583.865375:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f839d0800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497583.865381:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f839d7800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497583.865386:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f839d3000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497583.865390:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240911d3800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497583.865396:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240bcc6c000 6d03493e-1218-49f3-bdd0-b10716c402e0 192.168.202.4@tcp 12 (0 0 7) 0 0 0 0: 0000000000000000 107374182416 stale:0 00000020:00080000:0.0:1777497583.865421:0:86724:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff9240a62ecd40) has exports, disconnecting them 00000020:00080000:0.0:1777497583.865426:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f839d0800), last request at 1777497550 00000020:00000080:0.0:1777497583.865433:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ca06 00000100:00080000:0.0:1777497583.865441:0:86724:0:(import.c:65:import_set_state_nolock()) ffff9240bcc69800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497583.865465:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f839d0800): rc 0 00000020:00000080:0.0:1777497583.865468:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f839d0800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1777497583.865492:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f839d7800), last request at 1777497581 00000020:00000080:0.0:1777497583.865495:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c9ff 00000100:00080000:0.0:1777497583.865499:0:86724:0:(import.c:65:import_set_state_nolock()) ffff923f839d2800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777497583.865515:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497583.865522:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f839d7800): rc 0 00000020:00000080:0.0:1777497583.865524:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f839d7800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1777497583.865527:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f839d3000), last request at 1777497581 00000020:00000080:0.0:1777497583.865530:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c9f8 00000100:00080000:0.0:1777497583.865533:0:86724:0:(import.c:65:import_set_state_nolock()) ffff923f839d6000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777497583.865544:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497583.865550:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f839d3000): rc 0 00000020:00000080:0.0:1777497583.865551:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f839d3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1777497583.865554:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240911d3800), last request at 1777497544 00000020:00000080:0.0:1777497583.865561:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c869 00000100:00080000:0.0:1777497583.865571:0:86724:0:(import.c:65:import_set_state_nolock()) ffff924086e2b000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1777497583.865609:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497583.865616:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240911d3800): rc 0 00000020:00000080:0.0:1777497583.865618:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240911d3800/lustre-MDT0001-mdtlov_UUID 00000020:00080000:0.0:1777497583.865622:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff9240bcc6c000), last request at 1777497581 00000020:00000080:0.0:1777497583.865625:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c862 00000020:00010000:0.0:1777497583.865631:0:86724:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240bcc6c000: total 4 00000100:00080000:0.0:1777497583.865634:0:86724:0:(import.c:65:import_set_state_nolock()) ffff9240b5398000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497583.865651:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff9240bcc6c000): rc 0 00000004:00000080:0.0:1777497583.865658:0:86724:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef04e97ae0 00000100:00080000:0.0:1777497583.865676:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497583.865680:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1777497583.866566:0:86724:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1777497583.866595:0:86724:0:(import.c:65:import_set_state_nolock()) ffff92409c763800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1777497583.866665:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564923776:0@lo:39:umount.0 00000100:00100000:0.0:1777497583.866730:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1777497583.866793:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d0800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1777497583.866840:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d7800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1777497583.866860:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1777497583.866880:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1777497583.866903:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc69800 for lustre-MDT0000 00000020:00000080:0.0:1777497583.866910:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d2800 for lustre-MDT0000 00000020:00000080:0.0:1777497583.866914:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d6000 for lustre-MDT0000 00000020:00000080:0.0:1777497583.866916:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e2b000 for lustre-MDT0000 00000020:00010000:0.0:1777497583.866927:0:83956:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240bcc6c000: total 0 00010000:00010000:0.0:1777497583.866971:0:83956:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240bcc6c000, canceled 0 locks, left on hash table 7. 00010000:00010000:0.0:1777497583.867005:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691cc4b lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c199 expref: 8 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867025:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dda00/0x3e357265691cd39 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1d8 expref: 7 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867040:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b34a00/0x3e357265691cd55 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 6 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867072:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88b35c00/0x3e357265691cd78 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c202 expref: 5 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867091:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240866dc800/0x3e357265691cdbe lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c210 expref: 4 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867135:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691cc44 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c192 expref: 3 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867149:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691cc3d lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x6:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c18b expref: 2 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497583.867163:0:83956:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240bcc6c000, canceled 7 locks, left on hash table 0. 00010000:00010000:1.0:1777497583.869369:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497583.870059:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923776 00000100:00100000:1.0:1777497583.870071:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923776 00000100:00100000:1.0:1777497583.870148:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3935 00000100:00100000:1.0:1777497583.870158:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564923776:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777497583.870198:0:80394:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8a8 00000100:00080000:1.0:1777497583.870210:0:80394:0:(import.c:65:import_set_state_nolock()) ffff92409c46d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497583.870232:0:80394:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378733 00000100:00100000:1.0:1777497583.873603:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837564923776:12345-0@lo:39:umount.0 Request processed in 3437us (6862us total) trans 81604378734 rc 0/0 00000100:00100000:1.0:1777497583.873617:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3935 00010000:00010000:1.0:1777497583.877189:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497583.877266:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777497583.877272:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 3 00000004:00080000:1.0:1777497583.877300:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:1.0:1777497583.877362:0:86724:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1777497583.877407:0:86724:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1777497583.877420:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777497583.877423:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 3 00000004:00080000:1.0:1777497583.877429:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:1.0:1777497583.877485:0:86724:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1777497583.877493:0:86724:0:(import.c:65:import_set_state_nolock()) ffff923f81a02000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1777497583.877531:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a62ecd40) has no exports 00000100:00100000:2.0:1777497583.879368:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564923904:0@lo:9:umount.0 00000100:00100000:2.0:1777497583.879443:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497583.879488:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564924032:0@lo:9:umount.0 00000100:00100000:2.0:1777497583.879510:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497583.879554:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c763800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497583.879561:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb161500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564923776:0@lo:39:umount.0 00000100:00100000:2.0:1777497583.879589:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564923904 00000100:00100000:2.0:1777497583.879595:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564923904 00000100:00100000:2.0:1777497583.879660:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924032 00000100:00100000:2.0:1777497583.879663:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924032 00000100:00100000:2.0:1777497583.879700:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5865 00000100:00100000:2.0:1777497583.879708:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564923904:12345-0@lo:9:umount.0 00000100:00100000:3.0:1777497583.879945:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5866 00000100:00100000:3.0:1777497583.879956:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564924032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777497583.879978:0:25492:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8d2 00000100:00080000:3.0:1777497583.879987:0:25492:0:(import.c:65:import_set_state_nolock()) ffff923f826ca800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777497583.880031:0:25492:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969450 00000100:00100000:3.0:1777497583.880195:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564924032:12345-0@lo:9:umount.0 Request processed in 242us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497583.880201:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5866 00000100:00080000:3.0:1777497583.880222:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497583.880226:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497583.880236:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497583.880256:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81a02000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777497583.880268:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777497583.880270:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497583.880273:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564924032:0@lo:9:umount.0 00000020:00000080:2.0:1777497583.880346:0:25490:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8c4 00000100:00080000:2.0:1777497583.880352:0:25490:0:(import.c:65:import_set_state_nolock()) ffff923f826ca000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497583.880392:0:25490:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969455 00000100:00100000:2.0:1777497583.880475:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564923904:12345-0@lo:9:umount.0 Request processed in 769us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497583.880482:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5865 00010000:00010000:3.0:1777497583.881316:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497583.881344:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777497583.881354:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777497583.881356:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497583.881359:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564923904:0@lo:9:umount.0 00000020:00080000:1.0:1777497583.881791:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a62ecd40) has no exports 00000020:00000080:0.0:1777497583.924715:0:83956:0:(genops.c:906:class_export_put()) final put ffff9240bcc6c000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:2.0:1777497583.924804:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcc6c000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0000 00000020:00000080:2.0:1777497583.924880:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240b5398000 for lustre-MDT0000 00010000:00010000:2.0:1777497583.924891:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.924893:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497583.924896:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777497583.954867:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c87e 00000020:00000080:1.0:1777497583.954881:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240849d5000/lustre-QMT0000_UUID 00000020:01000000:1.0:1777497583.954967:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1777497583.955241:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497583.955253:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497583.955257:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff923f84b0cd40) has no exports 00000020:00000080:2.0:1777497583.955572:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c877 00000020:00000080:2.0:1777497583.955577:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240aef68800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497583.959033:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1777497583.959537:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497583.959548:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497583.959552:0:86724:0:(genops.c:906:class_export_put()) final put ffff924083bbd800/lustre-QMT0000_UUID 00000020:00000080:2.0:1777497583.959555:0:86724:0:(genops.c:865:class_export_destroy()) destroying export ffff924083bbd800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1777497583.959565:0:86724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1777497583.959740:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240aef68800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777497583.959798:0:86724:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924099014180 - data ffff9240a33aebd0/ffff923f82483000 00000020:01000000:2.0:1777497583.959905:0:86724:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f84c51900 - data ffff9240a335e288/ffff92408938cc00 00000100:00080000:3.0:1777497584.001023:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497584.001042:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1777497584.001057:0:86724:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240bb161500 x1863837564923776/t81604378734(81604378734) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497593 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497584.001086:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1777497584.002476:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777497584.002481:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 4 00000004:00080000:3.0:1777497584.002533:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497584.002537:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777497584.003265:0:85489:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777497584.003271:0:85489:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x64:0x0] index 1 count 1 00000040:00080000:1.0:1777497584.003281:0:85489:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 25 count 2 00000100:00080000:3.0:1777497584.003841:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777497584.003846:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 4 00000004:00080000:3.0:1777497584.003869:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497584.003872:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1777497584.004376:0:85491:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1777497584.004381:0:85491:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x66:0x0] index 1 count 1 00000040:00080000:0.0:1777497584.004391:0:85491:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 25 count 2 00000020:00000080:3.0:1777497584.007817:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c838 00000020:00000080:3.0:1777497584.007829:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c761000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497584.008686:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c84d 00000020:00000080:3.0:1777497584.008692:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c46d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.008740:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c761000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1777497584.009198:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1777497584.009205:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497584.009214:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1777497584.009218:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9240a62eb380) has no exports 00000004:01000000:3.0:1777497584.009380:0:86724:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1777497584.009389:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8cb 00000020:00000080:3.0:1777497584.009393:0:86724:0:(genops.c:906:class_export_put()) final put ffff924086e2b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.009477:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1777497584.009540:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1777497584.009544:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497584.009549:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777497584.009552:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9240aecdcd40) has no exports 00000020:00000080:3.0:1777497584.009558:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8bd 00000020:00000080:3.0:1777497584.009562:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f81a03000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497584.009580:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e2b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1777497584.009964:0:86724:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1777497584.009968:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777497584.009976:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969449 gen 5 00000004:00080000:3.0:1777497584.010000:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497584.010003:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497584.010232:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a03000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497584.010318:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497584.010326:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497584.010332:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8af 00000020:00000080:3.0:1777497584.010337:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240ae4b2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.010353:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81a02000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1777497584.010360:0:38121:0:(genops.c:906:class_export_put()) final put ffff9240ae4b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.010362:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1777497584.010365:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1777497584.010488:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1777497584.010492:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497584.010496:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777497584.010498:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9240aecd99c0) has no exports 00000020:00000080:3.0:1777497584.010502:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c8a1 00000020:00000080:3.0:1777497584.010506:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f88a1d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497584.010523:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1777497584.010659:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1777497584.011067:0:86724:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1777497584.011070:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777497584.011073:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969453 gen 5 00000004:00080000:3.0:1777497584.011077:0:86724:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497584.011078:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497584.011162:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497584.011167:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1777497584.011177:0:86724:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1777497584.011183:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c893 00000020:00000080:3.0:1777497584.011187:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f88a1d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.011206:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e27000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1777497584.011211:0:38121:0:(genops.c:906:class_export_put()) final put ffff923f88a1c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.011213:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1777497584.011216:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1777497584.011301:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1777497584.011305:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497584.011309:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1777497584.011312:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240aecdb380) has no exports 00000020:00000080:3.0:1777497584.011315:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c88c 00000020:00000080:3.0:1777497584.011319:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c761800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497584.011339:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1777497584.011966:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c761800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777497584.013163:0:86724:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1777497584.013168:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497584.013171:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1777497584.013177:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497584.013231:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497584.013239:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497584.013261:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497584.013263:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497584.013267:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240a3af3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497584.013270:0:86724:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1777497584.013281:0:86724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497584.013493:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c763800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1777497584.013502:0:38121:0:(genops.c:906:class_export_put()) final put ffff924086e22000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497584.013505:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e22000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1777497584.013508:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497584.013584:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c854 00000020:00000080:0.0:1777497584.013591:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c46e800/lustre-MDD0000_UUID 00000020:01000000:0.0:1777497584.013604:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1777497584.013607:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497584.013612:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497584.013614:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9240a62e8000) has no exports 00000020:00000080:0.0:1777497584.013636:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497584.013638:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1777497584.013642:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c85b 00000020:00000080:0.0:1777497584.013645:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c46f800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497584.013652:0:86724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f82ab5800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1777497584.013654:0:86724:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f82ab5800 3 00000020:01000004:0.0:1777497584.013667:0:86724:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff923f82ab5800 from lustre-MDT0000 00000020:00000080:0.0:1777497584.013684:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497584.013687:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1777497584.013689:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409c764000/lustre-MDT0000_UUID 00000020:00000080:0.0:1777497584.013691:0:86724:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c764000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1777497584.013698:0:86724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1777497584.013724:0:86724:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1777497584.013727:0:86724:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1777497584.013729:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1777497584.013731:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497584.013734:0:86724:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1777497584.013739:0:86724:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240bb686000 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497584.013746:0:86724:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240a6375000 95f1b493-372d-4153-ad35-48e1115be1b1 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497584.013751:0:86724:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff9240aecd8000) has exports, disconnecting them 00000020:00080000:0.0:1777497584.013754:0:86724:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9240bb686000), last request at 1777497544 00000020:00000080:0.0:1777497584.013782:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c7f9 00000020:00010000:0.0:1777497584.013786:0:86724:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240bb686000: total 2 00000100:00080000:0.0:1777497584.013789:0:86724:0:(import.c:65:import_set_state_nolock()) ffff9240bb682000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497584.013798:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240bb686000): rc 0 00000020:00080000:0.0:1777497584.013801:0:86724:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff9240a6375000), last request at 1777497544 00000020:00000080:0.0:1777497584.013837:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c7f2 00000020:00010000:0.0:1777497584.013839:0:86724:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240a6375000: total 2 00000100:00080000:0.0:1777497584.013842:0:86724:0:(import.c:65:import_set_state_nolock()) ffff9240a6372000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497584.013847:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff9240a6375000): rc 0 00000020:00080000:0.0:1777497584.013850:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff9240aecd8000) has no exports 00000020:00010000:1.0:1777497584.013973:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240bb686000: total 2 00010000:00010000:1.0:1777497584.014004:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240bb686000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1777497584.014030:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef400/0x3e357265691c9ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9a4 expref: 14 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014044:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8400/0x3e357265691c9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9b2 expref: 13 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014053:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefa00/0x3e357265691c949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c942 expref: 12 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014062:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8600/0x3e357265691c9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9c0 expref: 11 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014076:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38a00/0x3e357265691c957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c950 expref: 10 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014085:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9a00/0x3e357265691c9d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9ce expref: 9 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014114:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38600/0x3e357265691c965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c95e expref: 8 pid: 85476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014124:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee800/0x3e357265691c9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9ea expref: 7 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014132:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef800/0x3e357265691c981 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c97a expref: 6 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014141:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeea00/0x3e357265691c9e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c9dc expref: 5 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014151:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee600/0x3e357265691c973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c96c expref: 4 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014161:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39800/0x3e357265691c98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c988 expref: 3 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014169:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39000/0x3e357265691c99d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691c996 expref: 2 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014176:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240bb686000, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1777497584.014191:0:16604:0:(genops.c:906:class_export_put()) final put ffff9240bb686000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00000020:00010000:1.0:1777497584.014195:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240a6375000: total 3 00010000:00010000:1.0:1777497584.014213:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240a6375000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1777497584.014226:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9400/0x3e357265691c91f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c168 expref: 5 pid: 85478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014236:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691c92d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c176 expref: 4 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014246:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b34600/0x3e357265691c918 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c161 expref: 3 pid: 85482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014256:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b34e00/0x3e357265691c926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c16f expref: 2 pid: 85477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497584.014264:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240a6375000, canceled 4 locks, left on hash table 0. 00000020:00000080:1.0:1777497584.014270:0:16604:0:(genops.c:906:class_export_put()) final put ffff9240a6375000/95f1b493-372d-4153-ad35-48e1115be1b1 00010000:00010000:1.0:1777497584.014274:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497584.014276:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497584.014278:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497584.014283:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497584.014313:0:85477:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff92409c20ca00:85477] 1 exiting: rc = 0 00000100:00100000:1.0:1777497584.014407:0:85476:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff923f86233800:85476] 0 exiting: rc = 1 00000020:00000080:1.0:1777497584.014550:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46e800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1777497584.014555:0:38121:0:(genops.c:906:class_export_put()) final put ffff92409c765000/lustre-MDD0000_UUID 00000020:00000080:1.0:1777497584.014557:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c765000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1777497584.014561:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1777497584.014597:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497584.014602:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb686000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:1.0:1777497584.014737:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a6375000/95f1b493-372d-4153-ad35-48e1115be1b1 for MGS 00000020:00000080:1.0:1777497584.014752:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb682000 for MGS 00000020:00000080:1.0:1777497584.014777:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a6372000 for MGS 00000100:00100000:2.0:1777497584.015431:0:85478:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff92409c20d000:85478] 2 exiting: rc = 0 00000100:00100000:3.0:1777497584.030234:0:85482:0:(service.c:3164:ptlrpc_main()) ll_mgs_0003: service thread [ffff9240a3b5f400:85482] 3 exiting: rc = 0 00000100:00100000:0.0:1777497584.030398:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030408:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030415:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030421:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030428:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030434:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030457:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030463:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030469:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030476:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030481:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030488:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030495:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030500:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030505:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030511:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030516:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030523:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030528:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030534:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030540:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030545:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030551:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030574:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030581:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030587:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030593:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030598:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030604:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030610:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030615:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030620:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030626:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030632:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030637:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030643:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030648:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030654:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030659:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030665:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030670:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030682:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030688:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030693:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030698:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030704:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030710:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030715:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030722:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030727:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030734:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030739:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030744:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030750:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030755:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030761:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030777:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030782:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030788:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030793:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030798:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030804:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030809:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497584.030815:0:86724:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1777497584.036930:0:86724:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924098ababa0 - data ffff9240a31e0d80/ffff9240b54e5c00 00000020:01000000:0.0:1777497584.037152:0:86724:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240b548a6c0 - data ffff923f815276c0/ffff92409097e800 00000020:00000080:0.0:1777497584.040681:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c7eb 00000020:00000080:0.0:1777497584.040697:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240911d0800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497584.040732:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1777497584.040748:0:86724:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f82ab5800 from MGS, refs=2 00000020:01000004:0.0:1777497584.040751:0:86724:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f82ab5800 2 00000020:01000004:0.0:1777497584.040755:0:86724:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff923f82ab5800 from MGS 00000020:00000080:0.0:1777497584.040790:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497584.040800:0:86724:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1777497584.040803:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240911d7000/MGS 00000020:00000080:0.0:1777497584.040814:0:86724:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d7000/MGS for MGS 00000020:01000000:0.0:1777497584.040820:0:86724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1777497584.041408:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1777497584.041414:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497584.041420:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1777497584.041428:0:86724:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff923f839d5000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497584.041434:0:86724:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9240a6bf0000) has exports, disconnecting them 00000020:00080000:0.0:1777497584.041439:0:86724:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff923f839d5000), last request at 1777497545 00000020:00000080:0.0:1777497584.041442:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c90a 00000020:00080000:0.0:1777497584.041454:0:86724:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f839d5000): rc 0 00000020:00000080:0.0:1777497584.041458:0:86724:0:(genops.c:906:class_export_put()) final put ffff923f839d5000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1777497584.041490:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d5000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1777497584.046188:0:86724:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1777497584.046196:0:86724:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777497584.046201:0:86724:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1777497584.046210:0:86724:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777497584.046417:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497584.046428:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1777497584.046436:0:86724:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f82ab5800 1 00000020:00000080:1.0:1777497584.046443:0:86724:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691c7dd 00000020:00000080:1.0:1777497584.046452:0:86724:0:(genops.c:906:class_export_put()) final put ffff9240911d0000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497584.046757:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1777497584.046775:0:8:0:(genops.c:906:class_export_put()) final put ffff923f81a07800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1777497584.046778:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a07800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1777497584.046801:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1777497584.047080:0:86724:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1777497584.047086:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497584.047090:0:86724:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777497584.047126:0:86724:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff923f84b099c0) has no exports 00000020:00000080:3.0:1777497584.047849:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497584.127425:0:86724:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497584.127437:0:86724:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1777497584.127442:0:86724:0:(genops.c:906:class_export_put()) final put ffff92409fb65800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777497584.127446:0:86724:0:(genops.c:865:class_export_destroy()) destroying export ffff92409fb65800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777497584.127468:0:86724:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1777497584.127589:0:86724:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff923f82ab0000 00000020:02000400:2.0:1777497584.127651:0:86724:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1777497584.803123:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497585.834620:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497586.210449:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564924416:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.210519:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.210554:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564924928:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.210580:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.210603:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1777497586.210609:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564924288:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.210630:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.210647:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564924800:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.210671:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.210716:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924416 00000100:00100000:3.0:1777497586.210723:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924416 00000100:00100000:3.0:1777497586.210786:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924288 00000100:00100000:3.0:1777497586.210789:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924288 00000100:00100000:3.0:1777497586.210811:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1777497586.210819:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564924416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211071:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564924544:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211136:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497586.211156:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564925056:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211176:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497586.211194:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777497586.211199:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564924160:0@lo:400:kworker.0 00000400:00000100:2.0:1777497586.211217:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564924160 offset 0 length 224: 4 00000100:00100000:2.0:1777497586.211237:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564924672:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211255:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497586.211270:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564925184:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211288:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497586.211308:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924544 00000100:00100000:2.0:1777497586.211312:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924544 00000100:00100000:2.0:1777497586.211326:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924672 00000100:00100000:2.0:1777497586.211329:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924672 00000100:00100000:2.0:1777497586.211343:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925184 00000100:00100000:2.0:1777497586.211345:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925184 00000100:00100000:2.0:1777497586.211355:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1777497586.211362:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564924672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.211397:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564924672:12345-0@lo:400:kworker.0 Request processed in 35us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497586.211404:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:2.0:1777497586.211421:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1777497586.211425:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3658:x1863837564924288:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1777497586.211445:0:73210:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497586.211517:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564924416:12345-0@lo:400:kworker.0 Request processed in 699us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497586.211525:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1777497586.211540:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1777497586.211544:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1863837564924544:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497586.211548:0:64885:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497586.211570:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1863837564924544:12345-0@lo:400:kworker.0 Request processed in 25us (434us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497586.211582:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:3.0:1777497586.211594:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1777497586.211598:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1863837564925184:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497586.211603:0:64885:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497586.211624:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3659:x1863837564925184:12345-0@lo:400:kworker.0 Request processed in 24us (335us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497586.211630:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:3.0:1777497586.211648:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924928 00000100:00100000:3.0:1777497586.211652:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924928 00000100:00100000:3.0:1777497586.211674:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925056 00000100:00100000:3.0:1777497586.211677:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925056 00000100:00100000:3.0:1777497586.211708:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1777497586.211717:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564924928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497586.212122:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:0.0:1777497586.212134:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564925056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497586.212174:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564925056:12345-0@lo:400:kworker.0 Request processed in 44us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497586.212179:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1777497586.212305:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564925312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497586.212341:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497586.212373:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564924800 00000100:00100000:1.0:1777497586.212378:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564924800 00000100:00100000:1.0:1777497586.212399:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925312 00000100:00100000:1.0:1777497586.212402:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925312 00000100:00100000:1.0:1777497586.212415:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3936 00000100:00100000:1.0:1777497586.212419:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1863837564924800:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497586.212425:0:23359:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777497586.213501:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3658:x1863837564924288:12345-0@lo:400:kworker.0 Request processed in 2066us (2862us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497586.213512:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1777497586.213585:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564924672:0@lo:400:kworker.0 00000100:00080000:2.0:1777497586.213598:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777497586.213603:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777497586.213607:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777497586.213613:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497586.213617:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:2.0:1777497586.213623:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497586.213651:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089385500 x1863837564925440/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497586.213678:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408938a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564925184:0@lo:400:kworker.0 00000100:00080000:2.0:1777497586.213691:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777497586.213693:0:3659:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777497586.213706:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777497586.213709:0:3659:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497586.213712:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3679 00000100:00080000:2.0:1777497586.213716:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497586.213728:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089387480 x1863837564925568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497586.213738:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564924544:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.213777:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564925056:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.215680:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564924928:12345-0@lo:400:kworker.0 Request processed in 3954us (5088us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497586.215695:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:3.0:1777497586.216047:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3937 00000100:00100000:3.0:1777497586.216055:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1863837564925312:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1777497586.216063:0:8407:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497586.216248:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3657:x1863837564925312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 191us (3905us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497586.216256:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3937 00000100:00080000:3.0:1777497586.216281:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497586.216286:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497586.216289:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497586.216314:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564925440:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777497586.216355:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:02020000:2.0:1777497586.217870:0:3657:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:2.0:1777497586.217877:0:3657:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777497586.217882:0:3657:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777497586.217886:0:3657:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777497586.217893:0:3657:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497586.217897:0:3657:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3679 00000100:00080000:2.0:1777497586.217904:0:3657:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497586.217936:0:3657:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089384380 x1863837564925696/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497586.218228:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564925568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1777497586.218282:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.218312:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564925696:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1777497586.218335:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.218366:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925696 00000100:00100000:3.0:1777497586.218372:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925696 00000100:00100000:3.0:1777497586.218399:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3938 00000100:00100000:3.0:1777497586.218406:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564925696:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1777497586.218429:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497586.218464:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564925696:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 58us (129us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497586.218471:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3938 00000100:00080000:3.0:1777497586.218498:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497586.218503:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497586.218506:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564925696:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1777497586.218537:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497586.218540:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777497586.218543:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1777497586.218547:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497586.218550:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3679 00000100:00080000:3.0:1777497586.218555:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497586.218570:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aedc6300 x1863837564925824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497586.218588:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564924288:0@lo:400:kworker.0 00000100:00100000:2.0:1777497586.218656:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925440 00000100:00100000:2.0:1777497586.218661:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925440 00000100:00100000:2.0:1777497586.218685:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925568 00000100:00100000:2.0:1777497586.218688:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925568 00000100:00100000:2.0:1777497586.218704:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1777497586.219654:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564925440:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1777497586.219674:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497586.219756:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564925440:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 105us (3399us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497586.219762:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:2.0:1777497586.219788:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1777497586.219792:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564925568:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1777497586.219803:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497586.219828:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564925568:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 35us (1546us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497586.219846:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:2.0:1777497586.220381:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564925824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497586.220445:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497586.220491:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497586.220496:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497586.220499:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564925440:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1777497586.220508:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497586.220511:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497586.220514:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089387480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564925568:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777497586.220548:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925824 00000100:00100000:2.0:1777497586.220553:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925824 00000100:00100000:2.0:1777497586.220578:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1777497586.220583:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564925824:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777497586.220595:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497586.220627:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564925824:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 43us (182us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497586.220633:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00080000:2.0:1777497586.220655:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497586.220659:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497586.220661:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564925824:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777497586.221663:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1863837564924800:12345-0@lo:400:kworker.0 Request processed in 9232us (10980us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497586.221676:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3936 00000100:00080000:3.0:1777497586.221952:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497586.221956:0:3658:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff92408395d800 already not connected (conn 56, was 55): DISCONN 00000100:00100000:3.0:1777497586.221963:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564924800:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.221984:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564924416:0@lo:400:kworker.0 00000100:00100000:3.0:1777497586.221997:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564924928:0@lo:400:kworker.0 00000400:00000100:1.0:1777497586.494947:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546308352 offset 0 length 224: 4 00000100:00100000:1.0:1777497586.494990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497586.495041:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497586.495075:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497586.495173:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497586.495218:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308608 00000100:00100000:3.0:1777497586.495228:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308608 00000100:00100000:0.0:1777497586.495280:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308864 00000100:00100000:0.0:1777497586.495284:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308864 00000100:00100000:2.0:1777497586.495332:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308480 00000100:00100000:2.0:1777497586.495336:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308480 00000100:00100000:2.0:1777497586.495378:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1249 00000100:00100000:2.0:1777497586.495386:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2414:x1863837546308480:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:2.0:1777497586.495526:0:73210:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:2.0:1777497586.495585:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2414:x1863837546308480:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 198us (509us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497586.495593:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1249 00000100:00100000:2.0:1777497586.495735:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308736 00000100:00100000:2.0:1777497586.495739:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308736 00000100:00100000:3.0:1777497586.495916:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1229 00000100:00100000:3.0:1777497586.495923:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546308608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497586.495967:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546308608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 45us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497586.495973:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1229 00000100:00080000:1.0:1777497586.500397:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497586.500407:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497586.500411:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497586.502864:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2521 00000100:00100000:1.0:1777497586.502889:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308864:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497586.502988:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c97c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308864:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 112us (7946us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497586.502996:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2521 00000100:00100000:2.0:1777497586.507184:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2522 00000100:00100000:2.0:1777497586.507200:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308736:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497586.507300:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2414:x1863837546308736:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 104us (12124us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497586.507308:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2522 00000100:00100000:3.0:1777497586.534188:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497586.534284:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546308992 00000100:00100000:0.0:1777497586.534295:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546308992 00000100:00100000:0.0:1777497586.534351:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1250 00000100:00100000:0.0:1777497586.534358:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546308992:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 00010000:00020000:0.0:1777497586.534383:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497586.534464:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546308992:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 Request processed in 105us (286us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497586.534471:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1250 00000100:00100000:0.0:1777497586.722365:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497586.722386:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564925952:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497586.722467:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497586.725859:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925952 00000100:00100000:3.0:1777497586.725874:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925952 00000100:00100000:3.0:1777497586.725951:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:3.0:1777497586.725961:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564925952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497586.725997:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17088320 pending 1073152 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497586.726087:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564925952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497586.726115:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1777497586.726166:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564925952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497586.727523:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564926080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497586.727578:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497586.727864:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926080 00000100:00100000:0.0:1777497586.727880:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926080 00000100:00100000:0.0:1777497586.727930:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1777497586.727939:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564926080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497586.727965:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497586.728376:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564926080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 437us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497586.728384:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:2.0:1777497586.728998:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564926080:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497586.850367:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497587.747913:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497587.747921:0:9460:0:(genops.c:906:class_export_put()) final put ffff923f826ce800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777497587.747949:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969450 is committed 00000020:00000080:3.0:1777497587.748139:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1777497587.748201:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f826ca800 for lustre-OST0001 00010000:00010000:1.0:1777497587.878457:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1777497588.780975:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497588.780984:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f826cd800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497588.781022:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969455 is committed 00000020:00000080:3.0:1777497588.781123:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826cd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1777497588.781196:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f826ca000 for lustre-OST0000 00010000:00010000:1.0:1777497588.898327:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497589.800270:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777497589.800284:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378734 is committed 00000020:00000080:1.0:1777497589.800290:0:72699:0:(genops.c:906:class_export_put()) final put ffff92409c46c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497589.805903:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1777497589.806005:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c46d000 for lustre-MDT0001 00010000:00010000:3.0:1777497589.922395:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497590.946314:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497591.330786:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497591.330792:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497591.330796:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497591.330804:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3715 00000100:00080000:3.0:1777497591.330880:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497591.330888:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497591.330909:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aedc6300 x1863837564926336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497591.330936:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497591.330940:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497591.330942:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497591.330946:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3715 00000100:00080000:3.0:1777497591.330949:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497591.330952:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497591.330965:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d40700 x1863837564926592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497591.330981:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497591.330984:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497591.330986:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497591.330989:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3715 00000100:00080000:3.0:1777497591.331005:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497591.331010:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497591.331022:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a7480 x1863837564926848/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497591.331041:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497591.331045:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497591.331046:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497591.331049:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3715 00000100:00080000:3.0:1777497591.331052:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497591.331055:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497591.331063:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a7100 x1863837564927232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497591.331178:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564926208:0@lo:400:kworker.0 00000400:00000100:2.0:1777497591.331227:0:3660:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564926208 offset 0 length 224: 4 00000100:00100000:2.0:1777497591.331260:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564927104:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331300:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331334:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497591.331340:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564926976:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331361:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331394:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927104 00000100:00100000:2.0:1777497591.331400:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927104 00000100:00100000:2.0:1777497591.331444:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926976 00000100:00100000:2.0:1777497591.331455:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926976 00000100:00100000:2.0:1777497591.331481:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:2.0:1777497591.331490:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564927104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331539:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564927104:12345-0@lo:400:kworker.0 Request processed in 51us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497591.331546:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:2.0:1777497591.331561:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:2.0:1777497591.331567:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331595:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564926976:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497591.331601:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:2.0:1777497591.331638:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564926976:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331648:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564927104:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.331669:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564926336:0@lo:38:kworker.0 00000100:00100000:2.0:1777497591.331707:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331726:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564926592:0@lo:38:kworker.0 00000100:00100000:2.0:1777497591.331746:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331760:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564926848:0@lo:38:kworker.0 00000100:00100000:2.0:1777497591.331780:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331794:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564927232:0@lo:38:kworker.0 00000100:00100000:2.0:1777497591.331811:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.331835:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926336 00000100:00100000:2.0:1777497591.331838:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926336 00000100:00100000:2.0:1777497591.331858:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926592 00000100:00100000:2.0:1777497591.331861:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926592 00000100:00100000:2.0:1777497591.331881:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927232 00000100:00100000:2.0:1777497591.331884:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927232 00000100:00100000:2.0:1777497591.331897:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1777497591.331902:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564926336:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497591.331920:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497591.331951:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564926336:12345-0@lo:38:kworker.0 Request processed in 48us (255us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497591.331957:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:2.0:1777497591.331969:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1777497591.331973:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564926592:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497591.331982:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497591.332004:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564926592:12345-0@lo:38:kworker.0 Request processed in 29us (256us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497591.332008:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1777497591.332018:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:2.0:1777497591.332021:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564927232:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497591.332030:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497591.332050:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564927232:12345-0@lo:38:kworker.0 Request processed in 27us (238us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497591.332055:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00080000:2.0:1777497591.332090:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497591.332133:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497591.332136:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564926336:0@lo:38:kworker.0 00000100:00080000:2.0:1777497591.332146:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497591.332150:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497591.332159:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564926592:0@lo:38:kworker.0 00000100:00080000:2.0:1777497591.332168:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497591.332171:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497591.332173:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564927232:0@lo:38:kworker.0 00000100:00100000:2.0:1777497591.332201:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564926720:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.332225:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.332244:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497591.332250:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564926464:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.332269:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497591.332292:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926720 00000100:00100000:2.0:1777497591.332295:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926720 00000100:00100000:2.0:1777497591.332321:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926464 00000100:00100000:2.0:1777497591.332324:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926464 00000100:00100000:2.0:1777497591.332340:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:2.0:1777497591.332346:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564926720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.332380:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564926720:12345-0@lo:400:kworker.0 Request processed in 34us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497591.332386:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:2.0:1777497591.332397:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1777497591.332403:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564926464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.332427:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564926464:12345-0@lo:400:kworker.0 Request processed in 25us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497591.332433:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1777497591.332460:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564926464:0@lo:400:kworker.0 00000100:00100000:2.0:1777497591.332468:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564926720:0@lo:400:kworker.0 00000100:00080000:1.0:1777497591.333373:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497591.333378:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497591.333380:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497591.333554:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564926848 00000100:00100000:3.0:1777497591.333561:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564926848 00000100:00100000:3.0:1777497591.333600:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3939 00000100:00100000:3.0:1777497591.333606:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564926848:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497591.333634:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497591.333924:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564926848:12345-0@lo:38:kworker.0 Request processed in 316us (2142us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497591.333933:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3939 00000100:00080000:2.0:1777497591.334056:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497591.334062:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497591.334066:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564926848:0@lo:38:kworker.0 00000100:00100000:3.0:1777497591.619000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497591.623880:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:3.0:1777497591.627229:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546309120 offset 0 length 224: 4 00000100:00100000:3.0:1777497591.627269:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497591.627399:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546309376 00000100:00100000:2.0:1777497591.627409:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546309376 00000100:00100000:2.0:1777497591.627468:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546309248 00000100:00100000:2.0:1777497591.627472:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546309248 00000100:00100000:2.0:1777497591.627494:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1232 00000100:00100000:2.0:1777497591.627505:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546309376:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497591.627573:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2414:x1863837546309376:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (8581us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497591.627580:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1232 00000100:00100000:2.0:1777497591.627597:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1254 00000100:00100000:2.0:1777497591.627602:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546309248:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497591.627635:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497591.627663:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546309248:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 60us (3795us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497591.627670:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1254 00000100:00080000:3.0:1777497591.627773:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497591.632343:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497591.639218:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546309504 00000100:00100000:1.0:1777497591.639233:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546309504 00000100:00100000:1.0:1777497591.639317:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546309632 00000100:00100000:1.0:1777497591.639322:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546309632 00000100:00100000:1.0:1777497591.639356:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2525 00000100:00100000:1.0:1777497591.639380:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546309504:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497591.639462:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546309504:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 98us (12193us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497591.639486:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2525 00000100:00100000:1.0:1777497591.639504:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2526 00000100:00100000:1.0:1777497591.639511:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546309632:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497591.639538:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2414:x1863837546309632:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (7206us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497591.639543:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2526 00000100:00080000:3.0:1777497591.639866:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497591.639871:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497591.842581:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564927360:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497591.842664:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497591.842947:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927360 00000100:00100000:0.0:1777497591.842958:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927360 00000100:00100000:0.0:1777497591.843016:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1777497591.843026:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564927360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497591.843062:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497591.843134:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564927360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497591.843141:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:2.0:1777497591.843237:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564927360:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497591.843505:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564927488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497591.843540:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497591.843856:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927488 00000100:00100000:0.0:1777497591.843861:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927488 00000100:00100000:0.0:1777497591.843896:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1777497591.843904:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564927488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497591.843938:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497591.843980:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564927488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497591.843987:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:3.0:1777497591.844164:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564927488:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497591.970507:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497592.996163:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497594.018535:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497595.044034:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497596.066581:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497596.451246:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497596.451253:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497596.451256:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497596.451264:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3720 00000100:00080000:3.0:1777497596.451270:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497596.451276:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497596.451298:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9c700 x1863837564927744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497596.451324:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497596.451328:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497596.451330:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497596.451333:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3720 00000100:00080000:3.0:1777497596.451336:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497596.451339:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497596.451350:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9df80 x1863837564928000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497596.451373:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497596.451377:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497596.451386:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497596.451389:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3720 00000100:00080000:3.0:1777497596.451392:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497596.451397:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497596.451407:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497596.451424:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564928128:0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.451487:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497596.451536:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928128 00000100:00100000:3.0:1777497596.451544:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928128 00000100:00100000:3.0:1777497596.451597:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:3.0:1777497596.451606:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564928128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.451668:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564928128:12345-0@lo:400:kworker.0 Request processed in 62us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497596.451675:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00080000:3.0:1777497596.451695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497596.451727:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564928128:0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.451756:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d94380 x1863837564928256/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497596.451781:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564928384:0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.451807:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497596.451836:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928384 00000100:00100000:3.0:1777497596.451839:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928384 00000100:00100000:3.0:1777497596.451871:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:3.0:1777497596.451877:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564928384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.451912:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564928384:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497596.451929:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00080000:3.0:1777497596.451945:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497596.451965:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564928384:0@lo:400:kworker.0 00000100:00080000:3.0:1777497596.451986:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497596.451990:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497596.451992:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497596.451996:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3720 00000100:00080000:3.0:1777497596.451999:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497596.452002:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497596.452015:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d94700 x1863837564928640/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497596.452875:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564927616:0@lo:400:kworker.0 00000400:00000100:1.0:1777497596.452915:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564927616 offset 0 length 224: 4 00000100:00100000:1.0:1777497596.452944:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564928512:0@lo:400:kworker.0 00000100:00100000:1.0:1777497596.452970:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497596.453005:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497596.453012:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564927872:0@lo:400:kworker.0 00000100:00100000:1.0:1777497596.453036:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497596.457397:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928512 00000100:00100000:3.0:1777497596.457413:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928512 00000100:00100000:3.0:1777497596.457489:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1777497596.457501:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564928512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497596.457595:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564928512:12345-0@lo:400:kworker.0 Request processed in 97us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497596.457602:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1777497596.457673:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564928512:0@lo:400:kworker.0 00000100:00080000:1.0:1777497596.457754:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497596.459864:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564927744:0@lo:38:kworker.0 00000100:00100000:2.0:1777497596.459942:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497596.459997:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564928000:0@lo:38:kworker.0 00000100:00100000:2.0:1777497596.460021:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497596.460041:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564928256:0@lo:38:kworker.0 00000100:00100000:2.0:1777497596.460065:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497596.460087:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564928640:0@lo:38:kworker.0 00000100:00100000:2.0:1777497596.460162:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497596.460217:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927872 00000100:00100000:2.0:1777497596.460224:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927872 00000100:00100000:2.0:1777497596.460287:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564927744 00000100:00100000:2.0:1777497596.460291:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564927744 00000100:00100000:2.0:1777497596.460305:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928000 00000100:00100000:2.0:1777497596.460307:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928000 00000100:00100000:2.0:1777497596.460315:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928640 00000100:00100000:2.0:1777497596.460317:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928640 00000100:00100000:2.0:1777497596.460327:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1777497596.460335:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564927872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497596.460391:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564927872:12345-0@lo:400:kworker.0 Request processed in 56us (7353us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497596.460398:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1777497596.460413:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1777497596.460417:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564927744:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497596.460436:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497596.460464:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564927744:12345-0@lo:38:kworker.0 Request processed in 46us (523us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497596.460470:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1777497596.460480:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1777497596.460483:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564928000:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497596.460499:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497596.460530:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564928000:12345-0@lo:38:kworker.0 Request processed in 45us (508us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497596.460537:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1777497596.460549:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1777497596.460553:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564928640:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497596.460561:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497596.460583:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564928640:12345-0@lo:38:kworker.0 Request processed in 29us (420us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497596.460589:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:2.0:1777497596.460609:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928256 00000100:00100000:2.0:1777497596.460612:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928256 00000100:00100000:2.0:1777497596.460632:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3940 00000100:00100000:2.0:1777497596.460636:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564928256:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497596.460645:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497596.460682:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564928256:12345-0@lo:38:kworker.0 Request processed in 44us (615us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497596.460687:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3940 00000100:00080000:2.0:1777497596.460720:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497596.460725:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497596.460729:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564927744:0@lo:38:kworker.0 00000100:00080000:2.0:1777497596.460738:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497596.460741:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497596.460743:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564928000:0@lo:38:kworker.0 00000100:00080000:2.0:1777497596.460763:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497596.460766:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497596.460768:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564928256:0@lo:38:kworker.0 00000100:00080000:2.0:1777497596.460775:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497596.460778:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497596.460780:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564928640:0@lo:38:kworker.0 00000100:00080000:2.0:1777497596.460817:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497596.460850:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564927872:0@lo:400:kworker.0 00000400:00000100:3.0:1777497596.748475:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546309760 offset 0 length 224: 4 00000100:00100000:3.0:1777497596.748522:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497596.748573:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497596.748813:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310144 00000100:00100000:1.0:1777497596.748824:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310144 00000100:00100000:3.0:1777497596.748880:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497596.748915:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310272 00000100:00100000:3.0:1777497596.748916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497596.748919:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310272 00000100:00100000:1.0:1777497596.748953:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2529 00000100:00100000:1.0:1777497596.748966:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546310144:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497596.748968:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310016 00000100:00100000:3.0:1777497596.748974:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310016 00000100:00100000:3.0:1777497596.749014:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546309888 00000100:00100000:3.0:1777497596.749018:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546309888 00000100:00100000:3.0:1777497596.749037:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1235 00000100:00100000:3.0:1777497596.749044:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546310016:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:0.0:1777497596.749125:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497596.749131:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497596.749133:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497596.749138:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1258 00000100:00100000:2.0:1777497596.749145:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546309888:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497596.749166:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497596.749172:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2530 00000100:00100000:0.0:1777497596.749192:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546310272:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497596.749287:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546310144:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 324us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497596.749305:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2529 00000100:00100000:3.0:1777497596.750974:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546310016:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1921us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497596.750986:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1235 00000100:00100000:2.0:1777497596.751270:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546309888:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 2123us (2354us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497596.751279:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1258 00000100:00100000:0.0:1777497596.762915:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546310272:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 13723us (14024us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497596.762928:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2530 00000100:00100000:3.0:1777497596.963919:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497596.963947:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497596.964017:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497596.964198:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497596.964209:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497596.964341:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497596.966979:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928768 00000100:00100000:0.0:1777497596.966995:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928768 00000100:00100000:2.0:1777497596.968610:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564928896 00000100:00100000:2.0:1777497596.968623:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564928896 00000100:00100000:2.0:1777497596.968734:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2074 00000100:00100000:2.0:1777497596.968745:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564928768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497596.968779:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497596.968862:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564928768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (4844us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497596.968871:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2074 00000100:00100000:3.0:1777497596.970132:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:3.0:1777497596.970151:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564928896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497596.970183:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497596.970245:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564928896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (5905us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497596.971637:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564928768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497596.971700:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564928896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497596.973587:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00010000:00010000:2.0:1777497597.090357:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497598.116085:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497599.147113:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497600.162882:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497601.198810:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497601.570304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497601.570311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497601.570315:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497601.570322:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3725 00000100:00080000:3.0:1777497601.570328:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497601.570347:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497601.570371:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9df80 x1863837564929152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497601.570411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497601.570415:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497601.570416:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497601.570420:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3725 00000100:00080000:3.0:1777497601.570423:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497601.570426:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497601.570437:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408935bb80 x1863837564929408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497601.570452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497601.570455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497601.570456:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497601.570459:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3725 00000100:00080000:3.0:1777497601.570462:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497601.570465:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497601.570478:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089358380 x1863837564929664/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497601.570495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497601.570498:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497601.570499:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497601.570502:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3725 00000100:00080000:3.0:1777497601.570504:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1777497601.570513:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497601.570522:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408935b800 x1863837564930048/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497601.570564:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564929152:0@lo:38:kworker.0 00000100:00100000:3.0:1777497601.570638:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570671:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564929408:0@lo:38:kworker.0 00000100:00100000:3.0:1777497601.570691:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570704:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564929664:0@lo:38:kworker.0 00000100:00100000:3.0:1777497601.570724:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570736:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564930048:0@lo:38:kworker.0 00000100:00100000:3.0:1777497601.570754:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570787:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564929280:0@lo:400:kworker.0 00000100:00100000:3.0:1777497601.570808:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570827:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497601.570832:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564929536:0@lo:400:kworker.0 00000100:00100000:3.0:1777497601.570851:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497601.570879:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929152 00000100:00100000:3.0:1777497601.570886:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929152 00000100:00100000:3.0:1777497601.570915:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929408 00000100:00100000:3.0:1777497601.570917:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929408 00000100:00100000:3.0:1777497601.570926:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930048 00000100:00100000:3.0:1777497601.570927:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930048 00000100:00100000:3.0:1777497601.570934:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929280 00000100:00100000:3.0:1777497601.570936:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929280 00000100:00100000:1.0:1777497601.571124:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564929792:0@lo:400:kworker.0 00000100:00100000:1.0:1777497601.571158:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497601.571184:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1777497601.571190:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564929024:0@lo:400:kworker.0 00000400:00000100:1.0:1777497601.571208:0:3657:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564929024 offset 0 length 224: 4 00000100:00100000:1.0:1777497601.571231:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564929920:0@lo:400:kworker.0 00000100:00100000:1.0:1777497601.571250:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497601.571273:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929536 00000100:00100000:1.0:1777497601.571276:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929536 00000100:00100000:2.0:1777497601.571358:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929792 00000100:00100000:2.0:1777497601.571362:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929792 00000100:00100000:2.0:1777497601.571391:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929920 00000100:00100000:2.0:1777497601.571393:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929920 00000100:00100000:2.0:1777497601.571414:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1777497601.571422:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564929792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497601.571472:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564929792:12345-0@lo:400:kworker.0 Request processed in 51us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497601.571478:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:2.0:1777497601.571493:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1777497601.571499:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564929920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497601.571524:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564929920:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497601.571530:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1777497601.571734:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1777497601.571743:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564929280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497601.571809:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564929280:12345-0@lo:400:kworker.0 Request processed in 68us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497601.571816:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:2.0:1777497601.571878:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564929280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497601.576057:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1777497601.576071:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564929152:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497601.576120:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497601.576220:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564929152:12345-0@lo:38:kworker.0 Request processed in 150us (5581us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497601.576228:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1777497601.576252:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1777497601.576256:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564929408:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497601.576266:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497601.576302:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564929408:12345-0@lo:38:kworker.0 Request processed in 44us (5610us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497601.576308:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1777497601.576319:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:2.0:1777497601.576324:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564930048:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497601.576334:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497601.576356:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564930048:12345-0@lo:38:kworker.0 Request processed in 31us (5601us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497601.576361:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1777497601.580268:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1777497601.580285:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564929536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497601.580363:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564929536:12345-0@lo:400:kworker.0 Request processed in 87us (9511us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497601.580368:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1777497601.580390:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564929664 00000100:00100000:1.0:1777497601.580396:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564929664 00000100:00100000:1.0:1777497601.580411:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1777497601.580415:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564929664:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497601.580429:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497601.580449:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564929664:12345-0@lo:38:kworker.0 Request processed in 34us (9725us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497601.580461:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3941 00000100:00100000:1.0:1777497601.580499:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564929536:0@lo:400:kworker.0 00000100:00100000:1.0:1777497601.580527:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564929920:0@lo:400:kworker.0 00000100:00100000:1.0:1777497601.580534:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564929792:0@lo:400:kworker.0 00000100:00080000:3.0:1777497601.580774:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497601.580780:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497601.580784:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564929152:0@lo:38:kworker.0 00000100:00080000:3.0:1777497601.580793:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497601.580796:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497601.580798:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564929408:0@lo:38:kworker.0 00000100:00080000:3.0:1777497601.580805:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497601.580808:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497601.580811:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564929664:0@lo:38:kworker.0 00000100:00080000:3.0:1777497601.580820:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497601.580823:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497601.580826:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564930048:0@lo:38:kworker.0 00000100:00080000:3.0:1777497601.580854:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497601.580859:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497601.580863:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497601.854775:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497601.854806:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497601.854827:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:1.0:1777497601.854842:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546310400 offset 0 length 224: 4 00000100:00100000:1.0:1777497601.854864:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497601.854879:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310656 00000100:00100000:3.0:1777497601.854888:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310656 00000100:00100000:1.0:1777497601.854895:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310912 00000100:00100000:1.0:1777497601.854898:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310912 00000100:00100000:3.0:1777497601.854950:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310528 00000100:00100000:3.0:1777497601.854953:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310528 00000100:00100000:2.0:1777497601.854955:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1238 00000100:00100000:2.0:1777497601.854967:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546310656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497601.854982:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1262 00000100:00100000:3.0:1777497601.854987:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546310528:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497601.855006:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497601.855041:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546310528:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 53us (234us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497601.855041:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546310656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497601.855049:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1238 00000100:00100000:2.0:1777497601.855079:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546310784 00000100:00100000:2.0:1777497601.855083:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546310784 00000100:00100000:3.0:1777497601.855408:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1262 00000100:00100000:1.0:1777497601.862055:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2533 00000100:00100000:1.0:1777497601.862071:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546310912:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497601.862168:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546310912:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 102us (7340us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497601.862175:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2533 00000100:00080000:3.0:1777497601.862302:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497601.862452:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497601.862456:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497601.872194:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2534 00000100:00100000:3.0:1777497601.872219:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546310784:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497601.872313:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546310784:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 101us (17447us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497601.872321:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2534 00000100:00100000:2.0:1777497602.082561:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497602.082582:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564930176:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497602.082662:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497602.082698:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497602.082709:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564930304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497602.082752:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497602.082821:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930176 00000100:00100000:0.0:1777497602.082829:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930176 00000100:00100000:0.0:1777497602.082880:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930304 00000100:00100000:0.0:1777497602.082883:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930304 00000100:00100000:0.0:1777497602.082903:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1777497602.082912:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564930176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497602.082943:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497602.082986:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564930176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497602.082993:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:0.0:1777497602.083010:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1777497602.083017:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564930304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497602.083033:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497602.083081:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564930304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497602.083087:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:0.0:1777497602.083150:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564930304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497602.084032:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564930176:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497602.211302:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1777497602.814910:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546311040 offset 0 length 520: 4 00000100:00100000:1.0:1777497602.814947:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497602.814976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497602.815005:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497602.815031:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497602.815058:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311552 00000100:00100000:1.0:1777497602.815066:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311552 00000100:00100000:1.0:1777497602.815137:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311424 00000100:00100000:1.0:1777497602.815141:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311424 00000100:00100000:1.0:1777497602.815175:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2535 00000100:00100000:1.0:1777497602.815185:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546311552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497602.815250:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546311552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497602.815258:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2535 00000100:00100000:1.0:1777497602.815275:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2536 00000100:00100000:1.0:1777497602.815281:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546311424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497602.815304:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546311424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497602.815311:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2536 00000100:00100000:3.0:1777497602.815382:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311168 00000100:00100000:3.0:1777497602.815386:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311168 00000100:00100000:3.0:1777497602.815417:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311296 00000100:00100000:3.0:1777497602.815419:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311296 00000100:00100000:3.0:1777497602.815443:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1239 00000100:00100000:3.0:1777497602.815449:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546311296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497602.815478:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546311296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497602.815485:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1239 00000100:00100000:3.0:1777497602.815497:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1263 00000100:00100000:3.0:1777497602.815501:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546311168:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497602.815520:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497602.815562:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546311168:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 59us (615us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497602.815569:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1263 00000100:00000400:0.0:1777497603.111254:0:3659:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497586/real 1777497586] req@ffff923f82d41880 x1863837564924160/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497602 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497603.111288:0:3659:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff923f82d41880 x1863837564924160/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497603.111298:0:3659:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1777497603.111302:0:3659:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1777497603.111306:0:3659:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1777497603.111308:0:3659:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1777497603.111312:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f82d41880 x1863837564924160/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497602 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497603.111322:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240aedc4e00 x1863837564926208/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497607 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497603.111340:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff924086e9fb80 x1863837564927616/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497612 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497603.111349:0:3659:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff924086e9d880 x1863837564929024/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497617 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1777497603.111373:0:3659:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1777497603.111376:0:3659:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1777497603.111378:0:3659:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1777497603.111380:0:3659:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:0.0:1777497603.111421:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564927616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497603.111427:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564924160:0@lo:400:kworker.0 00000100:00100000:1.0:1777497603.111551:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564929024:0@lo:400:kworker.0 00000100:00100000:2.0:1777497603.111663:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aedc4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564926208:0@lo:400:kworker.0 00000100:00080000:3.0:1777497603.111672:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497603.111678:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1777497603.111681:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497603.111686:0:82203:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3674 00000100:00080000:3.0:1777497603.111692:0:82203:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497603.111723:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aee2b100 x1863837564930432/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497603.111742:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497603.111745:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497603.111747:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497603.111749:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3730 00000100:00080000:3.0:1777497603.111752:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497603.111755:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497603.111769:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aee29500 x1863837564930560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497603.111798:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564930432:0@lo:250:kworker.0 00000100:00080000:3.0:1777497603.111805:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497603.111808:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497603.111810:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497603.111813:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3730 00000100:00080000:3.0:1777497603.111815:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497603.111818:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497603.111828:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9d880 x1863837564930816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:0.0:1777497603.111841:0:3656:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564930432 offset 0 length 520: 4 00000100:00080000:3.0:1777497603.111848:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497603.111851:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497603.111852:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497603.111855:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3730 00000100:00080000:3.0:1777497603.111857:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497603.111860:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497603.111869:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9df80 x1863837564931072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497603.111870:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564930560:0@lo:38:kworker.0 00000100:00100000:0.0:1777497603.111897:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497603.111901:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497603.111904:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497603.111906:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497603.111909:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3730 00000100:00080000:3.0:1777497603.111911:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497603.111915:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497603.111918:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564930816:0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.111924:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fc700 x1863837564931456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497603.111937:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497603.111951:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930560 00000100:00100000:0.0:1777497603.111951:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564931072:0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.111957:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930560 00000100:00100000:0.0:1777497603.111972:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497603.111986:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930816 00000100:00100000:3.0:1777497603.111988:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930816 00000100:00100000:0.0:1777497603.111988:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564931456:0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.112005:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1777497603.112006:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497603.112012:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564930560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497603.112031:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497603.112071:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564930560:12345-0@lo:38:kworker.0 Request processed in 58us (173us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497603.112085:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:3.0:1777497603.112133:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931456 00000100:00100000:3.0:1777497603.112138:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931456 00000100:00100000:3.0:1777497603.112155:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1777497603.112160:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564930816:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497603.112160:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564930944:0@lo:400:kworker.0 00010000:00020000:3.0:1777497603.112170:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497603.112186:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497603.112189:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564930816:12345-0@lo:38:kworker.0 Request processed in 29us (252us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497603.112194:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:3.0:1777497603.112204:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930944 00000100:00100000:2.0:1777497603.112205:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497603.112207:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930944 00000100:00100000:2.0:1777497603.112210:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564930688:0@lo:400:kworker.0 00000100:00100000:2.0:1777497603.112232:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497603.112234:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1777497603.112240:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564930944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497603.112251:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931072 00000100:00100000:2.0:1777497603.112254:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931072 00000100:00100000:2.0:1777497603.112274:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1777497603.112278:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aedc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564930944:12345-0@lo:400:kworker.0 Request processed in 39us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497603.112279:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564931072:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.112284:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00010000:00020000:2.0:1777497603.112288:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497603.112292:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564930688 00000100:00100000:3.0:1777497603.112295:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564930688 00000100:00100000:3.0:1777497603.112308:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:2.0:1777497603.112310:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564931072:12345-0@lo:38:kworker.0 Request processed in 31us (337us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497603.112313:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564930688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497603.112316:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3942 00000100:00100000:3.0:1777497603.112338:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564930688:12345-0@lo:400:kworker.0 Request processed in 25us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497603.112344:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:3.0:1777497603.112354:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:3.0:1777497603.112358:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564931456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497603.112367:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497603.112395:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564931456:12345-0@lo:38:kworker.0 Request processed in 35us (388us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497603.112401:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00080000:3.0:1777497603.112429:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497603.112437:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564931328:0@lo:400:kworker.0 00000100:00080000:0.0:1777497603.112437:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497603.112441:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497603.112444:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564931456:0@lo:38:kworker.0 00000100:00080000:0.0:1777497603.112452:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497603.112454:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497603.112457:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564930816:0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.112462:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497603.112464:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497603.112466:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497603.112469:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564931072:0@lo:38:kworker.0 00000100:00080000:0.0:1777497603.112475:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497603.112478:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497603.112481:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564930560:0@lo:38:kworker.0 00000100:00100000:3.0:1777497603.112489:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497603.112494:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564931200:0@lo:400:kworker.0 00000100:00100000:3.0:1777497603.112512:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497603.112534:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931328 00000100:00100000:0.0:1777497603.112537:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931328 00000100:00100000:3.0:1777497603.112553:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564930688:0@lo:400:kworker.0 00000100:00100000:3.0:1777497603.112564:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564930944:0@lo:400:kworker.0 00000100:00100000:0.0:1777497603.112573:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931200 00000100:00100000:0.0:1777497603.112575:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931200 00000100:00100000:0.0:1777497603.112629:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1777497603.112637:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564931328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497603.112669:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564931328:12345-0@lo:400:kworker.0 Request processed in 34us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497603.112675:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2537 00000100:00100000:0.0:1777497603.112687:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2538 00000100:00100000:0.0:1777497603.112692:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564931200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497603.112715:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564931200:12345-0@lo:400:kworker.0 Request processed in 24us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497603.112720:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2538 00000100:00080000:1.0:1777497603.112773:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497603.112776:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497603.113028:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564931200:0@lo:400:kworker.0 00000100:00100000:3.0:1777497603.113038:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564931328:0@lo:400:kworker.0 00010000:00010000:1.0:1777497603.235555:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497604.260554:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497605.282886:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497606.306286:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1777497606.715775:0:87342:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1777497606.715781:0:87342:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1777497606.715783:0:87342:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1777497606.715896:0:87342:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff924098a46000 00000020:01000004:2.0:1777497606.715912:0:87342:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1777497606.715925:0:87342:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1777497606.715938:0:87342:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff923f84b099c0) 00000020:00000080:2.0:1777497606.715954:0:87342:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1777497606.811768:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1777497606.812908:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1777497606.822872:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1777497606.824733:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1777497606.824948:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1777497606.825727:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1777497606.826063:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1777497606.826442:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1777497606.826810:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1777497606.827024:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1777497606.827786:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.828230:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.828648:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.828898:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.829430:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.831609:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.831823:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.832276:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.832668:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.832890:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.833436:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.833663:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.833878:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.834229:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.834616:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.834821:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.835222:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.835518:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.835785:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.836040:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.836707:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.836937:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.837486:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.837798:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.838266:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.838663:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.839038:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.839487:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.839784:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.840159:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.840753:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.841429:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.841725:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.841946:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.842900:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.843467:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1777497606.843801:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1777497606.845937:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.847005:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.848698:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.849895:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.850739:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1777497606.851262:0:87342:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1777497606.855340:0:87342:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1777497606.855589:0:87342:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1777497606.855597:0:87342:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:2.0:1777497606.855609:0:87342:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691cde8 00000020:01000004:2.0:1777497606.855615:0:87342:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1777497606.855627:0:87342:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1777497606.855632:0:87342:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924098a46000 from MGS 00000020:01000004:2.0:1777497606.855636:0:87342:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1777497606.855646:0:87342:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff923f84b0cd40) 00000020:00000080:2.0:1777497606.855659:0:87342:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1777497606.855717:0:87342:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924098a46000 from MGS, refs=2 00080000:01000000:2.0:1777497606.855722:0:87342:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:2.0:1777497606.855729:0:87342:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691cdf6 00010000:00010000:2.0:1777497606.855866:0:87342:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:0.0:1777497606.868244:0:87342:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1777497606.868840:0:87346:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1777497606.868873:0:87342:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1777497606.868902:0:87342:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497606.872812:0:87342:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1777497606.873074:0:87342:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1777497606.873301:0:87342:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1777497606.873307:0:87342:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1777497606.876112:0:87342:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1777497606.876123:0:87342:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1777497606.888940:0:87342:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1777497606.888950:0:87342:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1777497606.893495:0:87342:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1777497606.893527:0:87342:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:3.0:1777497606.893528:0:87342:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:3.0:1777497606.893532:0:87342:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:3.0:1777497606.893538:0:87342:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 69, was 0): CONNECTING 00000100:00100000:3.0:1777497606.893544:0:87342:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1777497607.202379:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564931584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497607.202449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497607.202586:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931584 00000100:00100000:2.0:1777497607.202607:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931584 00000100:00100000:2.0:1777497607.202677:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1777497607.202687:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564931584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497607.202714:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497607.202764:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564931584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497607.202770:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2078 00000100:00100000:2.0:1777497607.202812:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564931584:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497607.202878:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497607.203112:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497607.203120:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564931712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497607.203144:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497607.203222:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931712 00000100:00100000:2.0:1777497607.203225:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931712 00000100:00100000:2.0:1777497607.203256:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1777497607.203260:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564931712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497607.203273:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497607.203297:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564931712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497607.203301:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00080000:1.0:1777497607.203478:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497607.203498:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089388700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564931712:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497607.333352:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497607.998707:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497607.998840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497607.998934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497607.998967:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311808 00000100:00100000:1.0:1777497607.998978:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311808 00000100:00100000:1.0:1777497607.999066:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1242 00000100:00100000:1.0:1777497607.999090:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546311808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497607.999209:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546311808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 122us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497607.999218:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1242 00000100:00080000:0.0:1777497608.000654:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497608.001685:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497608.001824:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311680 00000100:00100000:1.0:1777497608.001834:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311680 00000100:00100000:1.0:1777497608.001880:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1267 00000100:00100000:1.0:1777497608.001888:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546311680:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:1.0:1777497608.003311:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497608.003393:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546311680:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 1503us (1723us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497608.003404:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1267 00000100:00100000:2.0:1777497608.006728:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312064 00000100:00100000:2.0:1777497608.006744:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312064 00000100:00100000:2.0:1777497608.006842:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546311936 00000100:00100000:2.0:1777497608.006845:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546311936 00000100:00100000:2.0:1777497608.006879:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2539 00000100:00100000:2.0:1777497608.006890:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546312064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497608.006968:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546312064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 80us (8127us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.006975:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2539 00000100:00100000:2.0:1777497608.006991:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2540 00000100:00100000:2.0:1777497608.007022:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546311936:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497608.007048:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546311936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (8114us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.007053:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2540 00000100:00080000:1.0:1777497608.008109:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497608.008115:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497608.226228:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497608.226239:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1777497608.226242:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497608.226246:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497608.226250:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497608.226258:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3732 00000100:00080000:3.0:1777497608.226263:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497608.226270:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497608.226331:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924087888a80 x1863837564931840/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497608.226404:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497608.226408:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497608.226410:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497608.226414:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3732 00000100:00080000:3.0:1777497608.226416:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497608.226420:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497608.226433:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844cd880 x1863837564932096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497608.226448:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497608.226451:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497608.226453:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497608.226456:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3732 00000100:00080000:3.0:1777497608.226472:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497608.226476:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497608.226490:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844ce300 x1863837564932352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497608.226530:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497608.226533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497608.226549:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497608.226553:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3732 00000100:00080000:3.0:1777497608.226556:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1777497608.226560:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497608.226572:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409094f100 x1863837564932736/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497608.226608:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409094ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564932608:0@lo:400:kworker.0 00000100:00100000:3.0:1777497608.226678:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497608.226718:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497608.226724:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564932480:0@lo:400:kworker.0 00000100:00100000:3.0:1777497608.226747:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497608.226957:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564932224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.226990:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497608.227021:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497608.227027:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564931968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227049:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497608.227084:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932608 00000100:00100000:2.0:1777497608.227121:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932608 00000100:00100000:2.0:1777497608.227164:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932480 00000100:00100000:2.0:1777497608.227167:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932480 00000100:00100000:2.0:1777497608.227188:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1777497608.227197:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564932608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227254:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564932608:12345-0@lo:400:kworker.0 Request processed in 57us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.227261:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:2.0:1777497608.227280:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1777497608.227287:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564932480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227315:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564932480:12345-0@lo:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.227320:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2542 00000100:00100000:2.0:1777497608.227354:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932224 00000100:00100000:2.0:1777497608.227358:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932224 00000100:00100000:2.0:1777497608.227388:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931968 00000100:00100000:2.0:1777497608.227400:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931968 00000100:00100000:2.0:1777497608.227422:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1777497608.227428:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564932224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227462:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564932224:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.227467:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1777497608.227477:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1777497608.227482:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564931968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227506:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089388700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564931968:12345-0@lo:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497608.227512:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1777497608.227557:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564931968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227570:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564932224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227608:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564932480:0@lo:400:kworker.0 00000100:00100000:2.0:1777497608.227619:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409094ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564932608:0@lo:400:kworker.0 00000100:00080000:1.0:1777497608.227826:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497608.229401:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564931840:0@lo:38:kworker.0 00000100:00100000:0.0:1777497608.229470:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497608.229515:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564932096:0@lo:38:kworker.0 00000100:00100000:0.0:1777497608.229549:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497608.229577:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564932352:0@lo:38:kworker.0 00000100:00100000:3.0:1777497608.229595:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564931840 00000100:00100000:3.0:1777497608.229604:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564931840 00000100:00100000:0.0:1777497608.229608:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497608.229639:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409094f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564932736:0@lo:38:kworker.0 00000100:00100000:3.0:1777497608.229642:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932096 00000100:00100000:3.0:1777497608.229646:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932096 00000100:00100000:0.0:1777497608.229666:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497608.229670:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1777497608.229678:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564931840:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497608.229701:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497608.229729:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932736 00000100:00100000:0.0:1777497608.229734:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932736 00000100:00100000:3.0:1777497608.229748:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564931840:12345-0@lo:38:kworker.0 Request processed in 69us (278us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497608.229765:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:0.0:1777497608.229773:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564932096:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497608.229774:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00010000:00020000:0.0:1777497608.229788:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497608.229798:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:3.0:1777497608.229803:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564932736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497608.229815:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497608.229819:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837564932096:12345-0@lo:38:kworker.0 Request processed in 44us (267us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497608.229827:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1777497608.229853:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564932736:12345-0@lo:38:kworker.0 Request processed in 48us (187us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497608.229860:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00080000:0.0:1777497608.229875:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497608.229881:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497608.229885:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564931840:0@lo:38:kworker.0 00000100:00080000:0.0:1777497608.229895:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497608.229898:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497608.229901:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564932096:0@lo:38:kworker.0 00000100:00080000:0.0:1777497608.229908:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497608.229911:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497608.229914:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409094f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564932736:0@lo:38:kworker.0 00000100:00100000:2.0:1777497608.230030:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932352 00000100:00100000:2.0:1777497608.230035:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932352 00000100:00100000:2.0:1777497608.230063:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3943 00000100:00100000:2.0:1777497608.230068:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564932352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497608.230079:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497608.230141:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564932352:12345-0@lo:38:kworker.0 Request processed in 72us (535us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497608.230148:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3943 00000100:00080000:0.0:1777497608.231627:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497608.231635:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497608.231640:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564932352:0@lo:38:kworker.0 00010000:00010000:1.0:1777497608.354373:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497609.378396:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497610.404117:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497611.427230:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497612.101649:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497612.101721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497612.101746:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312576 00000100:00100000:1.0:1777497612.101758:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312576 00000100:00100000:3.0:1777497612.101763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:3.0:1777497612.101824:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497612.101826:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312704 00000100:00100000:1.0:1777497612.101830:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312704 00000100:00100000:3.0:1777497612.101855:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2543 00000100:00100000:3.0:1777497612.101868:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546312576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497612.101949:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546312576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497612.102262:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312448 00000100:00100000:0.0:1777497612.102268:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312448 00000100:00100000:0.0:1777497612.102317:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1245 00000100:00100000:0.0:1777497612.102325:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546312448:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497612.102361:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546312448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497612.102368:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1245 00000100:00080000:0.0:1777497612.102397:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497612.102400:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497612.109053:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2544 00000100:00100000:1.0:1777497612.109074:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546312704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497612.119288:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2543 00000100:00100000:1.0:1777497612.125280:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546312704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 16205us (23505us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497612.125306:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2544 00000100:00100000:2.0:1777497612.126970:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497612.127376:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312192 00000100:00100000:1.0:1777497612.127393:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312192 00000100:00100000:1.0:1777497612.127459:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1777497612.127467:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2411:x1863837546312192:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:1.0:1777497612.127493:0:87347:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 95f1b493-372d-4153-ad35-48e1115be1b1@192.168.202.4@tcp t0 exp 0000000000000000 cur 3741 last 0 00000020:00000080:1.0:1777497612.127530:0:87347:0:(genops.c:1406:class_connect()) connect: client 95f1b493-372d-4153-ad35-48e1115be1b1, cookie 0x3e357265691cdfd 00000100:00080000:1.0:1777497612.127859:0:87347:0:(import.c:65:import_set_state_nolock()) ffff9240a68c9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497612.127916:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+4:2411:x1863837546312192:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 448us (952us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497612.127923:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:2.0:1777497612.128831:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497612.129804:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312320 00000100:00100000:0.0:1777497612.129814:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312320 00000100:00100000:0.0:1777497612.129875:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1271 00000100:00100000:0.0:1777497612.129881:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546312320:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497612.129903:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497612.129948:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546312320:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 66us (1121us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497612.129954:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1271 00000100:00100000:2.0:1777497612.322616:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564932992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497612.322808:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497612.322856:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497612.322862:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564932864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497612.322888:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497612.322918:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932992 00000100:00100000:2.0:1777497612.322926:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932992 00000100:00100000:2.0:1777497612.322977:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564932864 00000100:00100000:2.0:1777497612.322980:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564932864 00000100:00100000:2.0:1777497612.322999:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1777497612.323007:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564932992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497612.323035:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497612.323075:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564932992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497612.323082:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1777497612.323121:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1777497612.323128:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564932864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497612.323143:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497612.323169:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564932864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497612.323175:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00080000:2.0:1777497612.323189:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497612.323192:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497612.323241:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564932864:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497612.323253:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564932992:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497612.451574:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497613.346289:0:3656:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497603/real 1777497603] req@ffff9240aee2b100 x1863837564930432/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497613 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497613.346321:0:3656:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9240aee2b100 x1863837564930432/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497613 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497613.346342:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497613.346362:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1777497613.346380:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564930432:0@lo:250:kworker.0 10000000:01000000:3.0:1777497613.346456:0:87342:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:3.0:1777497613.346472:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346482:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346499:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1777497613.346514:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346529:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b34c00/0x3e357265691c9dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9e3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346545:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346551:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346556:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346559:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346562:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39200/0x3e357265691c942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c949 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346569:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346574:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346579:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346582:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346584:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9c00/0x3e357265691c95e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c965 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346592:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346597:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346601:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346609:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346613:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35e00/0x3e357265691c988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c98f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346621:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346627:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346631:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346634:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346636:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8c00/0x3e357265691c996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c99d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346644:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346649:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346654:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346656:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346659:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35400/0x3e357265691c9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9b9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346667:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346673:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346687:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346691:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346694:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691c9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346703:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346708:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346712:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346715:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346718:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92408164e600/0x3e357265691c9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9f1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346728:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346734:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346740:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497613.346745:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346748:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691c950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c957 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497613.346760:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1777497613.346761:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497613.346770:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1777497613.346774:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497613.346782:0:82203:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3732 10000000:00010000:3.0:1777497613.346787:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497613.346790:0:82203:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 5s 10000000:01000000:3.0:1777497613.346796:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00000100:00080000:2.0:1777497613.346800:0:82203:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00010000:00010000:3.0:1777497613.346801:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346807:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691c96c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c973 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346819:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346825:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346830:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1777497613.346833:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844ce300 x1863837564933120/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:3.0:1777497613.346835:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346840:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691c97a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c981 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.346852:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346857:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497613.346862:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777497613.346866:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00000100:00080000:2.0:1777497613.346868:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00010000:00010000:3.0:1777497613.346870:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39600/0x3e357265691c9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9ab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497613.346877:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497613.346881:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497613.346884:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3737 00000100:00080000:2.0:1777497613.346887:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497613.346893:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00010000:00010000:3.0:1777497613.346902:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497613.346910:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.346913:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f844cf100 x1863837564933248/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 10000000:01000000:3.0:1777497613.346919:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1777497613.346922:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:3.0:1777497613.346926:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b34000/0x3e357265691c9ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691c9d5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497613.346940:0:87342:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 70, was 0): CONNECTING 00000100:00080000:3.0:1777497613.346946:0:87342:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00080000:2.0:1777497613.346967:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497613.346971:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497613.346973:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1777497613.346976:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1777497613.346976:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3737 00000100:00080000:2.0:1777497613.346982:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497613.346985:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497613.346992:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564933376:0@lo:400:kworker.0 00000100:00100000:2.0:1777497613.346998:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd56d80 x1863837564933504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497613.347030:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497613.347034:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497613.347035:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497613.347039:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3737 00000100:00080000:2.0:1777497613.347041:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497613.347045:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497613.347058:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2efb80 x1863837564933760/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497613.347068:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.347141:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564933632:0@lo:400:kworker.0 00000100:00080000:2.0:1777497613.347141:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497613.347149:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497613.347151:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497613.347156:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3737 00000100:00080000:2.0:1777497613.347159:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497613.347163:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497613.347169:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.347178:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50b1c00 x1863837564934144/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497613.347207:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564933888:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.347227:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564934016:0@lo:400:kworker.0 00000100:00100000:2.0:1777497613.347252:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.347283:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.347524:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933888 00000100:00100000:1.0:1777497613.347533:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933888 00000100:00100000:0.0:1777497613.347539:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933376 00000100:00100000:0.0:1777497613.347544:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933376 00000100:00100000:1.0:1777497613.347584:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934016 00000100:00100000:1.0:1777497613.347588:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934016 00000100:00100000:0.0:1777497613.347597:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933632 00000100:00100000:0.0:1777497613.347601:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933632 00000100:00100000:1.0:1777497613.347625:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1777497613.347630:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1777497613.347640:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564933888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.347641:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564933376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497613.347709:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564933888:12345-0@lo:400:kworker.0 Request processed in 74us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.347716:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564933376:12345-0@lo:400:kworker.0 Request processed in 77us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.347721:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1777497613.347728:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1777497613.347747:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1777497613.347751:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1777497613.347760:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564934016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.347761:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564933632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.347796:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564933632:12345-0@lo:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.347801:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1777497613.347818:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564934016:12345-0@lo:400:kworker.0 Request processed in 61us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.347826:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1777497613.347842:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564933632:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.347854:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564933376:0@lo:400:kworker.0 00000100:00100000:1.0:1777497613.347858:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564933120:0@lo:250:kworker.0 00000100:00100000:1.0:1777497613.347893:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.347922:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564934016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.347943:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933120 00000100:00100000:0.0:1777497613.347946:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933120 00000100:00100000:1.0:1777497613.347947:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564933248:0@lo:38:kworker.0 00000100:00100000:0.0:1777497613.347974:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1777497613.347980:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3656:x1863837564933120:12345-0@lo:250:kworker.0 00000100:00100000:1.0:1777497613.347991:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1777497613.348001:0:87350:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3742 last 0 00000100:00100000:1.0:1777497613.348015:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564933504:0@lo:38:kworker.0 00000020:00000080:0.0:1777497613.348036:0:87350:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691ce04 00000100:00100000:1.0:1777497613.348039:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.348059:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564933760:0@lo:38:kworker.0 00000100:00100000:1.0:1777497613.348125:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.348147:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564934144:0@lo:38:kworker.0 00000100:00100000:1.0:1777497613.348184:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497613.348219:0:87350:0:(import.c:65:import_set_state_nolock()) ffff9240bb785000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497613.348249:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933248 00000100:00100000:1.0:1777497613.348255:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933248 00000100:00100000:3.0:1777497613.348261:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933504 00000100:00100000:3.0:1777497613.348274:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933504 00000100:00100000:1.0:1777497613.348280:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934144 00000100:00100000:1.0:1777497613.348286:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934144 00000100:00100000:1.0:1777497613.348302:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1777497613.348307:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564933248:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497613.348322:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497613.348338:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:3.0:1777497613.348348:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564934144:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497613.348359:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564933248:12345-0@lo:38:kworker.0 Request processed in 48us (367us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497613.348365:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00010000:00020000:3.0:1777497613.348373:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497613.348385:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1777497613.348391:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564933504:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497613.348404:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497613.348421:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837564933120:12345-0@lo:250:kworker.0 Request processed in 287us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.348431:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1777497613.348511:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564933760 00000100:00100000:2.0:1777497613.348515:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564933760 00000100:00100000:2.0:1777497613.348534:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3944 00000100:00100000:2.0:1777497613.348538:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564933760:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497613.348548:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1777497613.348618:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 10000000:01000000:0.0:1777497613.348626:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:02000400:0.0:1777497613.348630:0:3656:0:(import.c:1282:ptlrpc_connect_interpret()) Evicted from MGS (at 0@lo) after server handle changed from 0x0 to 0x3e357265691ce04 00000100:00100000:1.0:1777497613.352133:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564933504:12345-0@lo:38:kworker.0 Request processed in 3730us (4083us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497613.352148:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00080000:1.0:1777497613.352252:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497613.352309:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564933888:0@lo:400:kworker.0 00000100:00080000:0.0:1777497613.360045:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to EVICTED 00000100:00080000:0.0:1777497613.360066:0:3656:0:(import.c:1667:ptlrpc_import_recovery_state_machine()) evicted from MGS@0@lo; invalidating 00000100:00100000:2.0:1777497613.360335:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564933760:12345-0@lo:38:kworker.0 Request processed in 11785us (12230us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497613.360351:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3944 00000100:00100000:1.0:1777497613.362777:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564933120:0@lo:250:kworker.0 00000100:00080000:1.0:1777497613.362835:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497613.362841:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497613.362846:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564933248:0@lo:38:kworker.0 00000100:00080000:1.0:1777497613.362861:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497613.362865:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497613.362868:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564933504:0@lo:38:kworker.0 00000100:00080000:1.0:1777497613.362880:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497613.362885:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497613.362888:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564933760:0@lo:38:kworker.0 00000100:00080000:1.0:1777497613.362900:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497613.362904:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497613.362907:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564934144:0@lo:38:kworker.0 00000100:00080000:2.0:1777497613.363031:0:87342:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished EVICTED, rc = 0 00000020:01000004:2.0:1777497613.363048:0:87342:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1777497613.363166:0:87342:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1777497613.363173:0:87342:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1777497613.363342:0:87342:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1777497613.363404:0:87342:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1777497613.363411:0:87342:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1777497613.363413:0:87342:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497613.363415:0:87342:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497613.363416:0:87342:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497613.363417:0:87342:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497613.363419:0:87342:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497613.363420:0:87342:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497613.363422:0:87342:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497613.363424:0:87342:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497613.363426:0:87342:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497613.363429:0:87342:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1777497613.363431:0:87342:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497613.363432:0:87342:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497613.363433:0:87342:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497613.363435:0:87342:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497613.363436:0:87342:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497613.363437:0:87342:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497613.363438:0:87342:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497613.363439:0:87342:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497613.363440:0:87342:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497613.363441:0:87342:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497613.363497:0:87342:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1777497613.363519:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240917ebcc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497613.363526:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564934272:0@lo:253:mount.lustre.0 00000020:00080000:2.0:1777497613.363550:0:87342:0:(tgt_mount.c:1425:server_register_target()) lustre-MDT0000: error registering with the MGS: rc = -108 (not fatal) 00000020:01000004:2.0:1777497613.363573:0:87342:0:(tgt_mount.c:101:server_register_mount()) register mount ffff924098a46000 from lustre-MDT0000 10000000:01000000:2.0:1777497613.363597:0:87342:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1777497613.363600:0:87342:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497613.363610:0:87342:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff924098a46000 10000000:01000000:2.0:1777497613.363615:0:87342:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777497613.363619:0:87342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff924098a46000 10000000:01000000:2.0:1777497613.363621:0:87342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777497613.363625:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff924098a46000 from 1 10000000:01000000:2.0:1777497613.363628:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497613.363660:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363672:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363682:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.363692:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240917eb180 going to sleep for 0 seconds 00000100:00100000:2.0:1777497613.363696:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564934400:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497613.363705:0:87342:0:(ldlm_request.c:688:ldlm_cli_enqueue_fini()) ### client-side enqueue END (FAILED) ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363713:0:87342:0:(ldlm_request.c:591:failed_lock_cleanup()) ### setting FL_LOCAL_ONLY | LDLM_FL_FAILED | LDLM_FL_ATOMIC_CB | LDLM_FL_CBPENDING ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363719:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363727:0:87342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11206400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363741:0:87342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363749:0:87342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497613.363753:0:87342:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1206400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363762:0:87342:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120e400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497613.363770:0:87342:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 5/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x120f400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497613.363777:0:87342:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497613.363781:0:87342:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497613.363788:0:87342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.363796:0:87342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35800/0x3e357265691ce0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5a0f400000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497613.363821:0:87342:0:(mgc_request.c:1814:mgc_process_log()) Can't get cfg lock: -108 00000100:00080000:2.0:1777497613.363842:0:87342:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:EVICTED 00000100:00080000:2.0:1777497613.363881:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level EVICTED/10 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497613.363886:0:82203:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: EVICTED) 00000100:00080000:0.0:1777497613.364873:0:87352:0:(import.c:1591:ptlrpc_invalidate_import_thread()) thread invalidate import MGC192.168.202.104@tcp to MGS@0@lo 00000100:00100000:0.0:1777497613.364879:0:87352:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1777497613.364884:0:87352:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000100:00080000:0.0:1777497613.364908:0:87352:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from EVICTED to RECOVER 00000100:00080000:0.0:1777497613.364915:0:87352:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from RECOVER to FULL 10000000:01000000:0.0:1777497613.364917:0:87352:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00100000:3.0:1777497613.365072:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564934144:12345-0@lo:38:kworker.0 Request processed in 16723us (16886us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497613.365123:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00080000:0.0:1777497613.367223:0:87352:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:02000000:0.0:1777497613.367237:0:87352:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) MGC192.168.202.104@tcp: Connection restored to 0@lo (at 0@lo) 10000000:01000000:2.0:1777497613.367712:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff924098a46000 from 1 10000000:01000000:2.0:1777497613.367719:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497613.367776:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.367816:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.367830:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.367862:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564934528:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497613.367948:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.368002:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240917eb180 going to sleep for 11 seconds 00000020:01000000:3.0:1777497613.369719:0:82203:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:3.0:1777497613.369752:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777497613.369755:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497613.369757:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497613.369759:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.369760:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.369761:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.369762:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.369764:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497613.369766:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.369767:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497613.369837:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497613.369844:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777497613.369846:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497613.369848:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497613.369849:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.369850:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.369851:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.369852:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.369854:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497613.369855:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.369856:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497613.369868:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497613.369873:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1777497613.369874:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497613.369875:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497613.369876:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.369878:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.369879:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.369880:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.369881:0:82203:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497613.369882:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.369883:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497613.369912:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1777497613.369957:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564934784:0@lo:253:kworker.0 00000100:00100000:3.0:1777497613.370039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.370139:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497613.370146:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564934656:0@lo:253:kworker.0 00000100:00100000:3.0:1777497613.370175:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.370199:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497613.370207:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564934912:0@lo:253:kworker.0 00000100:00100000:3.0:1777497613.370237:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.370269:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934528 00000100:00100000:3.0:1777497613.370279:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934528 00000100:00100000:0.0:1777497613.370576:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934784 00000100:00100000:0.0:1777497613.370580:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934784 00000100:00100000:0.0:1777497613.370616:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934656 00000100:00100000:0.0:1777497613.370619:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934656 00000100:00100000:0.0:1777497613.370628:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564934912 00000100:00100000:0.0:1777497613.370630:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564934912 00000100:00100000:0.0:1777497613.370642:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1777497613.370653:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564934784:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1777497613.370705:0:87349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 10000000:01000000:0.0:1777497613.370869:0:87353:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1777497613.370991:0:87349:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 112 00000100:00100000:3.0:1777497613.371730:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1777497613.371745:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564934656:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497613.371775:0:87350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1777497613.384050:0:87354:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1777497613.384062:0:87354:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1777497613.384066:0:87354:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1777497613.384068:0:87354:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1777497613.385585:0:87354:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1777497613.386030:0:87349:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1777497613.386065:0:87349:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777497613.390878:0:87350:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1777497613.391056:0:87349:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497613.391202:0:87349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1777497613.391440:0:87353:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497613.391574:0:87353:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497613.391610:0:87353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391633:0:87353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497613.391646:0:87353:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073698s 00010000:00010000:2.0:1777497613.391652:0:87353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391659:0:87353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391668:0:87353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391780:0:87353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391786:0:87353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497613.391791:0:87353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391800:0:87353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391817:0:87353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391826:0:87353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.391832:0:87353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b35800/0x3e357265691ce19 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.396173:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564934784:12345-0@lo:253:kworker.0 Request processed in 25421us (26033us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.396199:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1777497613.396256:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1777497613.396269:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3660:x1863837564934912:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1777497613.396327:0:87349:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000020:01000004:3.0:1777497613.396830:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497613.396834:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497613.396835:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.396837:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.396838:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.396841:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.396842:0:3658:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497613.396845:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.396846:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497613.396851:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564934784:0@lo:253:kworker.0 20000000:01000000:0.0:1777497613.396969:0:87350:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497613.396989:0:87350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1777497613.397180:0:87353:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1777497613.397185:0:87353:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1777497613.397215:0:87353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397234:0:87353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1777497613.397245:0:87353:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000073698s 00010000:00010000:3.0:1777497613.397250:0:87353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397273:0:87353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397280:0:87353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397298:0:87353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397305:0:87353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497613.397310:0:87353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397318:0:87353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397331:0:87353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397340:0:87353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.397348:0:87353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd800/0x3e357265691ce20 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497613.397954:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3658:x1863837564934656:12345-0@lo:253:kworker.0 Request processed in 26210us (27774us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.397966:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1777497613.398015:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1777497613.398029:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:87342:x1863837564934528:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497613.398045:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497613.398066:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee200/0x3e357265691ce27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ce12 expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.398243:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee200/0x3e357265691ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ce12 expref: 6 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.398256:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee200/0x3e357265691ce27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ce12 expref: 6 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.398264:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee200, rc 0) 00000020:01000004:3.0:1777497613.398511:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497613.398515:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497613.398516:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.398517:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.398519:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.398520:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.398522:0:3658:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497613.398536:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.398538:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497613.398543:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564934656:0@lo:253:kworker.0 00000100:00100000:0.0:1777497613.398612:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:87342:x1863837564934528:12345-0@lo:101:mount.lustre.0 Request processed in 587us (30663us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.398619:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 20000000:01000000:2.0:1777497613.398869:0:87349:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497613.399073:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564934528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497613.399435:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.399458:0:87342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497613.399477:0:87342:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1777497613.399499:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.399521:0:87342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497613.399530:0:87342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777497613.399536:0:87342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777497613.399544:0:87342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff924098a46000 10000000:01000000:1.0:1777497613.399547:0:87342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777497613.399551:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777497613.399554:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497613.399592:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.399599:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.399608:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497613.399635:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935040:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497613.399688:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.399880:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497613.399952:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935040 00000100:00100000:2.0:1777497613.399962:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935040 00000100:00100000:2.0:1777497613.400023:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1777497613.400042:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:87342:x1863837564935040:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497613.400057:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497613.400071:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b34000/0x3e357265691ce35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ce2e expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.400128:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b34000/0x3e357265691ce35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ce2e expref: 7 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.400139:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b34000/0x3e357265691ce35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ce2e expref: 7 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.400148:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34000, rc 0) 00000100:00100000:2.0:1777497613.400191:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:87342:x1863837564935040:12345-0@lo:101:mount.lustre.0 Request processed in 153us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.400198:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1777497613.400244:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497613.400257:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.400264:0:87342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.400526:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497613.400555:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.400576:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935168 00000100:00100000:2.0:1777497613.400579:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935168 00000100:00100000:2.0:1777497613.400594:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497613.400599:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:87342:x1863837564935168:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497613.400921:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564935168:12345-0@lo:501:mount.lustre.0 Request processed in 320us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.400929:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1777497613.401963:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240917eb540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497613.401997:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497613.402054:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497613.402407:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.402463:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935296 00000100:00100000:2.0:1777497613.402471:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935296 00000100:00100000:2.0:1777497613.402518:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1777497613.402528:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564935296:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497613.404862:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564935296:12345-0@lo:503:mount.lustre.0 Request processed in 2325us (2444us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.404876:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1777497613.404966:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240917eb540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497613.405001:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564935296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497613.406754:0:87355:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87355:1863837564935424:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497613.406857:0:87355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.406909:0:87355:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f82d0af00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497613.407048:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935424 00000100:00100000:2.0:1777497613.407059:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935424 00000100:00100000:2.0:1777497613.407144:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1777497613.407156:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87355:x1863837564935424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.408521:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87355:x1863837564935424:12345-0@lo:502:llog_process_th.0 Request processed in 1361us (1657us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.408533:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1777497613.408666:0:87355:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87355:1863837564935424:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777497613.408729:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497613.408753:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.408756:0:87355:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1777497613.408764:0:87355:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1777497613.408767:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497613.408786:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9240a69599c0) 00000020:00000080:0.0:1777497613.408816:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:0.0:1777497613.408822:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1777497613.408928:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:0.0:1777497613.408938:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ce43 00000020:00000080:0.0:1777497613.409255:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1777497613.409260:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497613.409264:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.409265:0:87355:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1777497613.409267:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497613.409271:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.409272:0:87355:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1777497613.409275:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497613.409285:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9240a695cd40) 00000020:00000080:0.0:1777497613.409299:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:0.0:1777497613.409303:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1777497613.409306:0:87355:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1777497613.409309:0:87355:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1777497613.409316:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1777497613.409370:0:87355:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924098a46000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1777497613.409386:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9240a695b380) 00000020:00000080:0.0:1777497613.409396:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:0.0:1777497613.409465:0:87355:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:0.0:1777497613.409471:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ce58 00000020:00000080:0.0:1777497613.409593:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1777497613.409601:0:87355:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1777497613.409606:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691ce5f 00080000:01000000:0.0:1777497613.409611:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:0.0:1777497613.409615:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ce66 20000000:01000000:3.0:1777497613.426479:0:87349:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777497613.426517:0:87349:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1777497613.427222:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3660:x1863837564934912:12345-0@lo:253:kworker.0 Request processed in 30951us (56976us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.427238:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:2.0:1777497613.427883:0:87353:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497613.427891:0:87353:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497613.427942:0:87353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.427966:0:87353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497613.427980:0:87353:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000090401s 00010000:00010000:2.0:1777497613.427986:0:87353:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.427993:0:87353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428002:0:87353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428010:0:87353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428017:0:87353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497613.428022:0:87353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428030:0:87353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428046:0:87353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428055:0:87353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.428063:0:87353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b35800/0x3e357265691ce6d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1777497613.428790:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1777497613.428794:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1777497613.428796:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497613.428798:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497613.428799:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497613.428801:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497613.428803:0:3660:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497613.428805:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497613.428806:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777497613.428813:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564934912:0@lo:253:kworker.0 00010000:00010000:2.0:1777497613.474459:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497613.549772:0:87355:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:2.0:1777497613.549962:0:87355:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: 6d03493e-1218-49f3-bdd0-b10716c402e0 idx: 0 lr: 103079215115 srv lr: 107374182400 lx: 0 gen 22 00000001:00080000:2.0:1777497613.550016:0:87355:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 107374182400 lx: 0 gen 21 00000001:00000004:2.0:1777497613.550045:0:87355:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 107374182400 00000001:00080000:2.0:1777497613.550273:0:87355:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:2.0:1777497613.550352:0:87355:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9240885c3780: xid 1863837546301824, transno 107374182407, client gen 22, slot idx 0 00000001:00080000:2.0:1777497613.550365:0:87355:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9240a62e6f00: xid 1863837546301568, transno 107374182406, client gen 22, slot idx 1 00000020:00000080:2.0:1777497613.550917:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff923f84b08000) 00000020:00000080:2.0:1777497613.550943:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:2.0:1777497613.551037:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:2.0:1777497613.551045:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ce89 00000020:00000080:2.0:1777497613.562321:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497613.576158:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691ce90 00000020:00000080:0.0:1777497613.578301:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1777497613.578335:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497613.578344:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.578346:0:87355:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1777497613.578350:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777497613.578353:0:87355:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1777497613.578354:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497613.578356:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497613.578358:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777497613.578360:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.578362:0:87355:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1777497613.578364:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497613.578370:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.578371:0:87355:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1777497613.578395:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1777497613.578477:0:87355:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1777497613.578510:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497613.578514:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.578516:0:87355:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1777497613.578519:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497613.578522:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497613.578523:0:87355:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1777497613.578526:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1777497613.578534:0:87355:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:0.0:1777497613.578565:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497613.578588:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240aecd8000) 00000020:00000080:0.0:1777497613.578616:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1777497613.578621:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1777497613.578702:0:87355:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1777497613.578709:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:0.0:1777497613.578718:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ce9e 00010000:00080000:0.0:1777497613.578762:0:87355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924086e2d800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497613.582799:0:87355:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:2.0:1777497613.584056:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497613.584074:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1777497613.584174:0:87355:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1777497613.584201:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691cea5 00000100:00080000:2.0:1777497613.584215:0:87355:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777497613.584223:0:87355:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff924086e2d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497613.584268:0:87355:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b50b1c00 x1863837564935552/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497613.584360:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564935552:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497613.584466:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497613.584557:0:87355:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1777497613.584630:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497613.584634:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.584636:0:87355:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1777497613.584648:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497613.584652:0:87355:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1777497613.584653:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497613.584654:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497613.584656:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497613.584659:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.584660:0:87355:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497613.584664:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1777497613.584670:0:87355:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1777497613.584673:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.584675:0:87355:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1777497613.584678:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1777497613.584683:0:87355:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1777497613.584710:0:87355:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1777497613.584713:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497613.584731:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9240bb6999c0) 00000020:00000080:2.0:1777497613.584751:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1777497613.584756:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1777497613.584829:0:87355:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1777497613.584837:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:2.0:1777497613.584845:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ceb3 00010000:00080000:2.0:1777497613.584886:0:87355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240bb6f7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1777497613.585159:0:87355:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:0.0:1777497613.585867:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935552 00000100:00100000:0.0:1777497613.585887:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935552 00000100:00100000:0.0:1777497613.585941:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3945 00000100:00100000:0.0:1777497613.585949:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564935552:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1777497613.585985:0:80394:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3742 last 0 00000020:00000080:0.0:1777497613.586027:0:80394:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ceba 00000004:00100000:0.0:1777497613.586045:0:80394:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1777497613.586209:0:80394:0:(import.c:65:import_set_state_nolock()) ffff923f839d1000 : changing import state from RECOVER to FULL 00000040:01000000:2.0:1777497613.586471:0:87355:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777497613.586512:0:87355:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1777497613.586600:0:87355:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 24, last_idx 25 00000100:00100000:3.0:1777497613.589629:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564935680:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.589725:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.589794:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935680 00000100:00100000:3.0:1777497613.589803:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935680 00000100:00100000:3.0:1777497613.589857:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1777497613.589867:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3660:x1863837564935680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.589925:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3660:x1863837564935680:12345-0@lo:400:kworker.0 Request processed in 59us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.589934:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1777497613.589994:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564935680:0@lo:400:kworker.0 00000040:00080000:3.0:1777497613.590693:0:87355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497613.590731:0:87355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].26, 64 off9856 00000040:00080000:3.0:1777497613.590911:0:87355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x68:0x0].1, 64 off8256 00000040:00080000:3.0:1777497613.591616:0:87361:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1777497613.591623:0:87361:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1777497613.591806:0:87361:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1777497613.591823:0:87361:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x64:0x0] at index 25 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1777497613.591952:0:87361:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1777497613.591955:0:87361:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x68:0x0] at index 26 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1777497613.592164:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564935552:12345-0@lo:38:llog_process_th.0 Request processed in 6210us (7693us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.592180:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3945 00000100:00100000:1.0:1777497613.593724:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497613.593740:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1777497613.593752:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1777497613.593758:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1777497613.593765:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e2d800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497613.593796:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564935552:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1777497613.593961:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564935808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497613.594044:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.594182:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935808 00000100:00100000:1.0:1777497613.594190:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935808 00000100:00100000:1.0:1777497613.594246:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1777497613.594258:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564935808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497613.594301:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497613.594355:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564935808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.594362:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3946 00000100:00100000:1.0:1777497613.594400:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564935808:0@lo:41:osp-pre-1-0.0 00000020:00000080:2.0:1777497613.595027:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497613.595045:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1777497613.595133:0:87355:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1777497613.595164:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691cec1 00000100:00080000:2.0:1777497613.595173:0:87355:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1777497613.595179:0:87355:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240bb6f7800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497613.595213:0:87355:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a3b88000 x1863837564935936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497613.595282:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564935936:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1777497613.595338:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497613.595403:0:87355:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1777497613.595483:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497613.595497:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.595500:0:87355:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1777497613.595504:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497613.595507:0:87355:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1777497613.595508:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497613.595510:0:87355:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497613.595511:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497613.595514:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.595515:0:87355:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497613.595518:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1777497613.595523:0:87355:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1777497613.595526:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497613.595528:0:87355:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1777497613.595531:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1777497613.595535:0:87355:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:2.0:1777497613.595561:0:87355:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1777497613.595564:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497613.595578:0:87355:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9240bb698000) 00000020:00000080:2.0:1777497613.595597:0:87355:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:2.0:1777497613.595602:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1777497613.595675:0:87355:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1777497613.595683:0:87355:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:2.0:1777497613.595690:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691cecf 00010000:00080000:2.0:1777497613.595726:0:87355:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92409c46f000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1777497613.595967:0:87355:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:2.0:1777497613.596058:0:87355:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777497613.596078:0:87355:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1777497613.596872:0:87355:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 24, last_idx 25 00000100:00100000:0.0:1777497613.597330:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564935936 00000100:00100000:0.0:1777497613.597343:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564935936 00000100:00100000:0.0:1777497613.597410:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5867 00000100:00100000:0.0:1777497613.597421:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3656:x1863837564935936:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497613.597471:0:25496:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3742 last 0 00000020:00000080:0.0:1777497613.597517:0:25496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ced6 00002000:00100000:0.0:1777497613.597536:0:25496:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff923f839d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777497613.597541:0:25496:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777497613.597545:0:25496:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497613.597622:0:25496:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777497613.597655:0:25496:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1777497613.598917:0:87355:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497613.598968:0:87355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].26, 64 off9856 00000040:00080000:3.0:1777497613.599134:0:87355:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6a:0x0].1, 64 off8256 00000100:00100000:0.0:1777497613.599646:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564935936:12345-0@lo:8:llog_process_th.0 Request processed in 2221us (4302us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.599661:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5867 00000040:00080000:3.0:1777497613.606247:0:87363:0:(llog.c:800:llog_process_thread()) index: 25, lh_last_idx: 26 synced_idx: 0 lgh_last_idx: 26 00000040:00080000:3.0:1777497613.606256:0:87363:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1777497613.606525:0:87363:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 25, last_idx 26 00000040:00080000:3.0:1777497613.606552:0:87363:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x66:0x0] at index 25 of catalog [0x1:0x5:0x0] 00000040:00080000:3.0:1777497613.606702:0:87363:0:(llog.c:800:llog_process_thread()) index: 26, lh_last_idx: 26 synced_idx: 26 lgh_last_idx: 26 00000040:00080000:3.0:1777497613.606706:0:87363:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6a:0x0] at index 26 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1777497613.607256:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497613.607272:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1777497613.607283:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1777497613.607291:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1777497613.607296:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1777497613.607367:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:1.0:1777497613.607397:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564935936:0@lo:8:llog_process_th.0 00000004:00080000:3.0:1777497613.608623:0:87361:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1777497613.608733:0:87361:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3742949636960ns, next at 0ns, rc = 0 00080000:00080000:3.0:1777497613.608742:0:87361:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:00000080:3.0:1777497613.612061:0:87355:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497613.612084:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1777497613.612184:0:87355:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777497613.612213:0:87355:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691cedd 00000100:00080000:3.0:1777497613.612227:0:87355:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777497613.612234:0:87355:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff92409c46f000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497613.612283:0:87355:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240867ac700 x1863837564936064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497613.612318:0:87355:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1777497613.612627:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564936064:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497613.612728:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.612814:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936064 00000100:00100000:2.0:1777497613.612824:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936064 00000100:00100000:2.0:1777497613.612864:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5868 00000100:00100000:2.0:1777497613.612872:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3656:x1863837564936064:12345-0@lo:8:llog_process_th.0 00010000:00080000:2.0:1777497613.612910:0:25490:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3742 last 0 00000020:00000080:2.0:1777497613.612943:0:25490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691cee4 00002000:00100000:2.0:1777497613.612961:0:25490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff923f88a8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1777497613.612967:0:25490:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1777497613.612970:0:25490:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1777497613.613076:0:25490:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1777497613.613127:0:25490:0:(import.c:65:import_set_state_nolock()) ffff923f88a8f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497613.613187:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564936064:12345-0@lo:8:llog_process_th.0 Request processed in 315us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.613196:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5868 00000100:00100000:2.0:1777497613.613245:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497613.613254:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777497613.613263:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777497613.613269:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1777497613.613271:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46f000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1777497613.613284:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777497613.613289:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564936064:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497613.613414:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497613.613424:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564936192:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1777497613.613910:0:87343:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:01000000:3.0:1777497613.614133:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497613.614158:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497613.614161:0:87355:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1777497613.614165:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497613.614169:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497613.614171:0:87355:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1777497613.614174:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1777497613.614176:0:87355:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1777497613.614178:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497613.614180:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497613.614182:0:87355:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1777497613.614195:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497613.614198:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497613.614199:0:87355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1777497613.614203:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1777497613.614245:0:87355:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87355:1863837564936320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497613.614313:0:87355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.614349:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936320 00000100:00100000:3.0:1777497613.614355:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936320 00000100:00100000:3.0:1777497613.614395:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1777497613.614404:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:87355:x1863837564936320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497613.614559:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:87355:x1863837564936320:12345-0@lo:502:llog_process_th.0 Request processed in 155us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.614567:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1777497613.614627:0:87355:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240887f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.614648:0:87355:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87355:1863837564936320:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497613.614672:0:87355:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497613.614677:0:87355:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497613.614678:0:87355:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1777497613.614683:0:87355:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000004:00080000:3.0:1777497613.614853:0:87363:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1777497613.614940:0:87363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3742955844318ns, next at 0ns, rc = 0 00080000:00080000:3.0:1777497613.614947:0:87363:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:1.0:1777497613.617612:0:87342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1777497613.617665:0:87342:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1777497613.617706:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.617722:0:87342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497613.617733:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff924098a46000 from 1 10000000:01000000:1.0:1777497613.617736:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497613.617800:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.617810:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.617824:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497613.617858:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497613.617944:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.617999:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861ed6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497613.618140:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.618197:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936192 00000100:00100000:2.0:1777497613.618205:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936192 00000100:00100000:2.0:1777497613.618270:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1777497613.618281:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564936192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497613.618308:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497613.618355:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564936192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.618362:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1777497613.618420:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564936192:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1777497613.619328:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497613.620200:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936448 00000100:00100000:3.0:1777497613.620215:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936448 00000100:00100000:3.0:1777497613.620272:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777497613.620283:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:87342:x1863837564936448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497613.620301:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497613.620324:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ceeb expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.620376:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ceeb expref: 8 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.620388:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ceeb expref: 8 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.620398:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd800, rc 0) 00000100:00100000:3.0:1777497613.620502:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564936448:12345-0@lo:101:mount.lustre.0 Request processed in 221us (2558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.620510:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777497613.620593:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497613.620613:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.620624:0:87342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497613.621210:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936576:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1777497613.621265:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.621303:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240887f7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.621326:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936576 00000100:00100000:3.0:1777497613.621333:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936576 00000100:00100000:3.0:1777497613.621366:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1777497613.621373:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564936576:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1777497613.621393:0:87347:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1777497613.621416:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1777497613.621431:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1777497613.621435:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1777497613.621437:0:87347:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 115 00000100:00100000:0.0:1777497613.621845:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564936704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497613.621894:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.621954:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936704 00000100:00100000:0.0:1777497613.621958:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936704 00000100:00100000:0.0:1777497613.622007:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1777497613.622014:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564936704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497613.622032:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497613.622074:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564936704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.622079:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00080000:0.0:1777497613.622124:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497613.622165:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564936704:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1777497613.624144:0:87343:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1777497613.625649:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564936576:12345-0@lo:256:mount.lustre.0 Request processed in 4264us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.625667:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777497613.628837:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936576:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1777497613.630031:0:87342:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777497613.630271:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.630287:0:87342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497613.630299:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff924098a46000 from 1 10000000:01000000:0.0:1777497613.630302:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497613.630358:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.630367:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.630391:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497613.630818:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1777497613.630910:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.631012:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.631935:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936832 00000100:00100000:3.0:1777497613.631948:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936832 00000100:00100000:3.0:1777497613.632018:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1777497613.632028:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:87342:x1863837564936832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497613.632047:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497613.632069:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dc000/0x3e357265691cf00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cef9 expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.632342:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dc000/0x3e357265691cf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cef9 expref: 9 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.632358:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dc000/0x3e357265691cf00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cef9 expref: 9 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.632370:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc000, rc 0) 00000100:00100000:3.0:1777497613.632624:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564936832:12345-0@lo:101:mount.lustre.0 Request processed in 596us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.632633:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1777497613.632747:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497613.632771:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.632782:0:87342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497613.632875:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777497613.632908:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.632977:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.633019:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564936960 00000100:00100000:3.0:1777497613.633025:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564936960 00000100:00100000:3.0:1777497613.633090:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1777497613.633140:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564936960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497613.633312:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564936960:12345-0@lo:501:mount.lustre.0 Request processed in 174us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.633336:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1777497613.633411:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564936960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497613.633461:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497613.633516:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.633866:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861edd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.633927:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937088 00000100:00100000:0.0:1777497613.633933:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937088 00000100:00100000:0.0:1777497613.633960:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777497613.633967:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564937088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497613.634074:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564937088:12345-0@lo:503:mount.lustre.0 Request processed in 106us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.634081:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777497613.634352:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497613.634861:0:87365:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87365:1863837564937216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497613.634914:0:87365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.634949:0:87365:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.635000:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937216 00000100:00100000:0.0:1777497613.635006:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937216 00000100:00100000:0.0:1777497613.635042:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1777497613.635050:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87365:x1863837564937216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497613.635809:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87365:x1863837564937216:12345-0@lo:502:llog_process_th.0 Request processed in 756us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.635827:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777497613.636005:0:87365:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87365:1863837564937216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497613.636038:0:87365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497613.636050:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497613.636053:0:87365:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1777497613.636059:0:87365:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff924098a46000 00000020:00000080:1.0:1777497613.636062:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777497613.636070:0:87365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497613.636073:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497613.636074:0:87365:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1777497613.636077:0:87365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497613.636078:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497613.636080:0:87365:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1777497613.636083:0:87365:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff924098a46000 00000020:00000080:1.0:1777497613.636084:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1777497613.636402:0:87365:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87365:1863837564937344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497613.636551:0:87365:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.636589:0:87365:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861ede40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.636646:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937344 00000100:00100000:3.0:1777497613.636653:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937344 00000100:00100000:3.0:1777497613.636734:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497613.636744:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87365:x1863837564937344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497613.636865:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87365:x1863837564937344:12345-0@lo:502:llog_process_th.0 Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.636873:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777497613.639701:0:87365:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87365:1863837564937344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497613.639767:0:87365:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497613.639780:0:87365:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497613.639783:0:87365:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1777497613.639787:0:87365:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1777497613.641636:0:87342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:2.0:1777497613.641717:0:87342:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497613.641743:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.641760:0:87342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497613.641848:0:87342:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1777497613.641852:0:87342:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff924098a46000 10000000:01000000:2.0:1777497613.641855:0:87342:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff924098a46000 10000000:01000000:2.0:1777497613.641860:0:87342:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777497613.641867:0:87342:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff924098a46000 from 1 10000000:01000000:2.0:1777497613.641870:0:87342:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497613.641920:0:87342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.641940:0:87342:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.641954:0:87342:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.641984:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937472:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497613.642067:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.643333:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.643407:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937472 00000100:00100000:0.0:1777497613.643428:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937472 00000100:00100000:0.0:1777497613.643498:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1777497613.643510:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:87342:x1863837564937472:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497613.643530:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497613.643550:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefc00/0x3e357265691cf0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf07 expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.643586:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefc00/0x3e357265691cf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf07 expref: 10 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.643598:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefc00/0x3e357265691cf0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf07 expref: 10 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.643608:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefc00, rc 0) 00000100:00100000:0.0:1777497613.644234:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564937472:12345-0@lo:101:mount.lustre.0 Request processed in 722us (2162us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.644243:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1777497613.646637:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497613.646668:0:87342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.647000:0:87342:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497613.647129:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497613.647208:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.651008:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937600 00000100:00100000:3.0:1777497613.651034:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240914606c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497613.651049:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937600 00000100:00100000:1.0:1777497613.651146:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497613.651168:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564937600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497613.651393:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564937600:12345-0@lo:501:mount.lustre.0 Request processed in 238us (4184us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.651401:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1777497613.653378:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497613.653468:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937728:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497613.653570:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.653622:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937728 00000100:00100000:1.0:1777497613.653629:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937728 00000100:00100000:1.0:1777497613.653681:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497613.653691:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564937728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497613.653822:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564937728:12345-0@lo:503:mount.lustre.0 Request processed in 132us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.653829:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1777497613.654223:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240914606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.654241:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867ad880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564937728:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497613.655336:0:87368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564937856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.655410:0:87368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.655584:0:87368:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326c00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.656333:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937856 00000100:00100000:0.0:1777497613.656345:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937856 00000100:00100000:0.0:1777497613.656450:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1777497613.656461:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87368:x1863837564937856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.656935:0:87368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564937856:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1777497613.657021:0:87368:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1777497613.657045:0:87368:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff92408316b380) 00000020:00000080:2.0:1777497613.657079:0:87368:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000100:00100000:0.0:1777497613.658905:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87368:x1863837564937856:12345-0@lo:502:llog_process_th.0 Request processed in 213us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.658926:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:2.0:1777497613.660607:0:87368:0:(tgt_mount.c:153:server_get_mount()) get mount ffff924098a46000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1777497613.660617:0:87368:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924098a46000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1777497613.660621:0:87368:0:(obd_mount.c:701:lustre_put_lsi()) put ffff924098a46000 4 00010000:00080000:2.0:1777497613.660672:0:87368:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240aef6f800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497613.672503:0:87368:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1777497613.672681:0:87368:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1777497613.672753:0:87368:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1777497613.672773:0:87368:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691cf1c 00000100:00080000:1.0:1777497613.672788:0:87368:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497613.672795:0:87368:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240aef6f800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497613.672841:0:87368:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2efb80 x1863837564937984/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497613.672876:0:87368:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1777497613.673013:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497613.673027:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497613.673030:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497613.673035:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3742 00000100:00080000:0.0:1777497613.673039:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497613.673043:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497613.673060:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcd56300 x1863837564938240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497613.673071:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564938112:0@lo:400:kworker.0 00000100:00080000:0.0:1777497613.673118:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497613.673123:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497613.673124:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497613.673128:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3742 00000100:00080000:0.0:1777497613.673130:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497613.673134:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497613.673146:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924087888a80 x1863837564938496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497613.673177:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497613.673180:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497613.673182:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497613.673185:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3742 00000100:00080000:0.0:1777497613.673188:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1777497613.673189:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497613.673192:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497613.673206:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240aee28000 x1863837564938752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497613.673228:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497613.673235:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497613.673237:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497613.673241:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3742 00000100:00080000:0.0:1777497613.673243:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00100000:1.0:1777497613.673246:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564939008:0@lo:400:kworker.0 00000100:00080000:0.0:1777497613.673246:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497613.673258:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086e9df80 x1863837564939136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497613.673276:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.673302:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564938880:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673332:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.673439:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564939520:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673469:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.673510:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564938624:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673545:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.673565:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564939392:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673586:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.673605:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564937984:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777497613.673605:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777497613.673610:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564938368:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.673658:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939008 00000100:00100000:0.0:1777497613.673658:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.673666:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939008 00000100:00100000:0.0:1777497613.673692:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564939264:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.673715:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938880 00000100:00100000:3.0:1777497613.673719:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938880 00000100:00100000:0.0:1777497613.673722:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.673760:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938624 00000100:00100000:0.0:1777497613.673765:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938624 00000100:00100000:0.0:1777497613.673796:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938368 00000100:00100000:0.0:1777497613.673799:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938368 00000100:00100000:0.0:1777497613.673819:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1777497613.673829:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564938624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673898:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564938624:12345-0@lo:400:kworker.0 Request processed in 70us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.673905:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1777497613.673923:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1777497613.673929:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564938368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.673954:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564938368:12345-0@lo:400:kworker.0 Request processed in 26us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.673960:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1777497613.674013:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564938368:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674024:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939520 00000100:00100000:0.0:1777497613.674025:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564938624:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674027:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939520 00000100:00100000:3.0:1777497613.674046:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939392 00000100:00100000:3.0:1777497613.674048:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939392 00000100:00100000:3.0:1777497613.674071:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1777497613.674076:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564939008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674139:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564939008:12345-0@lo:400:kworker.0 Request processed in 62us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.674145:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000100:00100000:3.0:1777497613.674156:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1777497613.674162:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564938880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674192:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564938880:12345-0@lo:400:kworker.0 Request processed in 31us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.674197:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1777497613.674207:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1777497613.674213:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564939520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674238:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564939520:12345-0@lo:400:kworker.0 Request processed in 26us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.674244:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:3.0:1777497613.674255:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1777497613.674260:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564939392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674313:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564939392:12345-0@lo:400:kworker.0 Request processed in 52us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.674328:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:3.0:1777497613.674376:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564938880:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674391:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564939520:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.674414:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.674438:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564938240:0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.674677:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.674697:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564938496:0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.674721:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.674737:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564938752:0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.674764:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.674782:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564939136:0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.674803:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.674839:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564937984 00000100:00100000:3.0:1777497613.674843:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564937984 00000100:00100000:3.0:1777497613.674863:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938240 00000100:00100000:3.0:1777497613.674866:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938240 00000100:00100000:3.0:1777497613.674876:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938496 00000100:00100000:3.0:1777497613.674878:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938496 00000100:00100000:3.0:1777497613.674884:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939136 00000100:00100000:3.0:1777497613.674887:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939136 00000100:00100000:3.0:1777497613.674895:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1777497613.674900:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564937984:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777497613.674951:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564937984:12345-0@lo:38:llog_process_th.0 Request processed in 50us (536us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.674956:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:3.0:1777497613.674968:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1777497613.674982:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564938240:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.675009:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564938240:12345-0@lo:38:kworker.0 Request processed in 27us (332us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.675015:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1777497613.675026:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1777497613.675029:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564938496:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.675056:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564938496:12345-0@lo:38:kworker.0 Request processed in 25us (335us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.675062:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:3.0:1777497613.675072:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1777497613.675076:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564939136:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.675128:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564939136:12345-0@lo:38:kworker.0 Request processed in 51us (324us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.675134:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:3.0:1777497613.675158:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939264 00000100:00100000:3.0:1777497613.675162:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939264 00000100:00100000:3.0:1777497613.675191:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938752 00000100:00100000:3.0:1777497613.675194:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938752 00000100:00100000:3.0:1777497613.675218:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1777497613.675225:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564939264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.675264:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564939264:12345-0@lo:400:kworker.0 Request processed in 40us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.675270:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3947 00000100:00100000:3.0:1777497613.675294:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1777497613.675298:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564938752:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1777497613.675325:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564938752:12345-0@lo:38:kworker.0 Request processed in 26us (561us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.675339:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3948 00000100:00100000:3.0:1777497613.675389:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564939008:0@lo:400:kworker.0 00000100:00100000:3.0:1777497613.675419:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1777497613.675425:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497613.675430:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497613.675433:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564937984:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497613.675762:0:87368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564939648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497613.675822:0:87368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.675855:0:87368:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.676476:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564939264:0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.676510:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564939392:0@lo:400:kworker.0 00000100:00100000:2.0:1777497613.676783:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564938112 00000100:00100000:2.0:1777497613.676790:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564938112 00000100:00100000:2.0:1777497613.676844:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939648 00000100:00100000:2.0:1777497613.676847:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939648 00000100:00100000:2.0:1777497613.676861:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1777497613.676869:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:3660:x1863837564938112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497613.677243:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1777497613.677254:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:87368:x1863837564939648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.677739:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:3660:x1863837564938112:12345-0@lo:400:kworker.0 Request processed in 866us (4547us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.677756:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1777497613.678482:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497613.678498:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497613.678503:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564938240:0@lo:38:kworker.0 00000100:00080000:3.0:1777497613.678529:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497613.678533:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497613.678536:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564938496:0@lo:38:kworker.0 00000100:00080000:3.0:1777497613.678549:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497613.678553:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497613.678556:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240aee28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564938752:0@lo:38:kworker.0 00000100:00080000:3.0:1777497613.678570:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497613.678573:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497613.678576:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564939136:0@lo:38:kworker.0 00000100:00100000:0.0:1777497613.678984:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87368:x1863837564939648:12345-0@lo:502:llog_process_th.0 Request processed in 1731us (3160us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.678995:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1777497613.679780:0:87368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564939648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.679873:0:87368:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564939776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497613.679938:0:87368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.679979:0:87368:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409907e000 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.680048:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939776 00000100:00100000:3.0:1777497613.680057:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939776 00000100:00100000:3.0:1777497613.680142:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1777497613.680154:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87368:x1863837564939776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497613.680276:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87368:x1863837564939776:12345-0@lo:502:llog_process_th.0 Request processed in 124us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.680303:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1777497613.680501:0:87368:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87368:1863837564939776:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1777497613.680530:0:87368:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1777497613.680914:0:87342:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1777497613.680947:0:87342:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497613.680974:0:87342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.680989:0:87342:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1777497613.681054:0:87342:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1777497613.681056:0:87342:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777497613.681058:0:87342:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.681059:0:87342:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.681061:0:87342:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.681063:0:87342:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.681064:0:87342:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497613.681066:0:87342:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777497613.681069:0:87342:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.681070:0:87342:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1777497613.681076:0:87342:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1777497613.681078:0:87342:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1777497613.681080:0:87342:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777497613.681081:0:87342:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.681082:0:87342:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.681084:0:87342:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.681085:0:87342:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.681086:0:87342:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497613.681087:0:87342:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777497613.681088:0:87342:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.681089:0:87342:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1777497613.681141:0:87342:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1777497613.681155:0:87342:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564939904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1777497613.681205:0:87342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497613.681238:0:87342:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.681547:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564939904 00000100:00100000:0.0:1777497613.681555:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564939904 00000100:00100000:0.0:1777497613.681605:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1777497613.681614:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564939904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777497613.681654:0:87350:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1777497613.681673:0:87350:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497613.682767:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564938112:0@lo:400:kworker.0 20000000:01000000:0.0:1777497613.689675:0:87350:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497613.689699:0:87350:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1777497613.689823:0:87353:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497613.689830:0:87353:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497613.689859:0:87353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.689885:0:87353:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.689895:0:87353:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.689952:0:87353:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.689968:0:87353:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497613.689988:0:87353:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87353:1863837564940032:0@lo:104: 00000100:00100000:2.0:1777497613.690076:0:87353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497613.690172:0:87353:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409907eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.690278:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940032 00000100:00100000:0.0:1777497613.690299:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940032 00000100:00100000:0.0:1777497613.690353:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1777497613.690363:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:87353:x1863837564940032:12345-0@lo:104: 00010000:00010000:0.0:1777497613.690378:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497613.690459:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497613.690466:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:87353:x1863837564940032:12345-0@lo:104: Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.690474:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1777497613.690661:0:87353:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:87353:1863837564940032:0@lo:104: 00010000:00010000:2.0:1777497613.690689:0:87353:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497613.691060:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:87342:x1863837564939904:12345-0@lo:253:mount.lustre.0 Request processed in 9446us (9853us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.691071:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1777497613.691274:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497613.691292:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691301:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497613.691306:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691315:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497613.691321:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497613.691327:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497613.691377:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691383:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497613.691418:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691425:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ceeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691cef2 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691449:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497613.691458:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497613.691460:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497613.691469:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497613.691493:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564940160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497613.691532:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.691584:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940160 00000100:00100000:1.0:1777497613.691589:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940160 00010000:00010000:1.0:1777497613.691613:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497613.691638:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1777497613.691646:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3659:x1863837564940160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497613.691659:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497613.691663:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691674:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691689:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd800/0x3e357265691cef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691ceeb expref: 10 pid: 87350 timeout: 3843 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691708:0:10268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691716:0:10268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497613.691731:0:10268:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001903091s 00010000:00010000:1.0:1777497613.691736:0:10268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691754:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691760:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691766:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691771:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497613.691775:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691782:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691793:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.691803:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497613.691833:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:3659:x1863837564940160:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.691840:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2541 00000100:00100000:1.0:1777497613.691876:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564940160:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497613.692170:0:87353:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.692178:0:87353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.692185:0:87353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b35400/0x3e357265691cf23 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497613.697617:0:87342:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240867af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:87342:1863837564939904:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1777497613.697647:0:87342:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1777497613.697651:0:87342:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1777497613.697652:0:87342:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777497613.697654:0:87342:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497613.697655:0:87342:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497613.697656:0:87342:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497613.697658:0:87342:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497613.697659:0:87342:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497613.697660:0:87342:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777497613.697663:0:87342:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497613.697665:0:87342:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1777497613.697686:0:87342:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1777497613.701043:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497613.701143:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312832 00000100:00100000:3.0:1777497613.701156:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312832 00000100:00100000:3.0:1777497613.701214:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:3.0:1777497613.701226:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+4:41987:x1863837546312832:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497613.701248:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497613.701274:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd200/0x3e357265691cf2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c217 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.701321:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd200/0x3e357265691cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c217 expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.701334:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd200/0x3e357265691cf2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c217 expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.701343:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd200, rc 0) 00000100:00100000:3.0:1777497613.701419:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546312832:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 195us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.701426:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 27 00000100:00100000:0.0:1777497613.706894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497613.707005:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546312960 00000100:00100000:1.0:1777497613.707020:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546312960 00000100:00100000:1.0:1777497613.707136:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 28 00000100:00100000:1.0:1777497613.707150:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546312960:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497613.707208:0:87350:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777497613.707229:0:87350:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497613.707233:0:87350:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497613.707236:0:87350:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497613.707239:0:87350:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777497613.707242:0:87350:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1777497613.717137:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546312960:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 9976us (10242us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.717153:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 28 00000020:00080000:3.0:1777497613.721565:0:87342:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000100:00100000:2.0:1777497613.726538:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497613.726710:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313216 00000100:00100000:1.0:1777497613.726726:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313216 00000100:00100000:1.0:1777497613.726804:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1777497613.726816:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+5:41987:x1863837546313216:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497613.726840:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497613.726864:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff200/0x3e357265691cf31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c21e expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.726900:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff200/0x3e357265691cf31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c21e expref: 6 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.726913:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff200/0x3e357265691cf31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c21e expref: 6 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497613.726922:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff200, rc 0) 00000040:01000000:2.0:1777497613.734602:0:87342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1777497613.734819:0:87374:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1777497613.734840:0:87342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:0.0:1777497613.735185:0:87373:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:0.0:1777497613.735192:0:87373:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:2.0:1777497613.736006:0:87342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1777497613.736057:0:87342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497613.736526:0:87374:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1777497613.736791:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546313216:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 9967us (10258us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.736805:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000004:00000080:2.0:1777497613.738746:0:87342:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1777497613.738777:0:87342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1777497613.738904:0:87342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1777497613.740030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497613.740186:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313088 00000100:00100000:3.0:1777497613.740198:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313088 00000100:00100000:3.0:1777497613.740250:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1279 00000100:00100000:3.0:1777497613.740259:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546313088:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 00000100:00100000:3.0:1777497613.740358:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240867af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2411:x1863837546313088:12345-192.168.202.4@tcp:38:ll_cfg_requeue.0 Request processed in 97us (336us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497613.740365:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1279 00000100:00100000:1.0:1777497613.742244:0:87375:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940288:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497613.742350:0:87375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.742504:0:87375:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048600 going to sleep for 11 seconds 00000040:00080000:0.0:1777497613.742772:0:87374:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1777497613.742860:0:87374:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1777497613.743258:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940288 00000100:00100000:3.0:1777497613.743268:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940288 00000100:00100000:3.0:1777497613.743324:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3949 00000100:00100000:3.0:1777497613.743333:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940288:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497613.743456:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940288:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 122us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.743463:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3949 00000040:00080000:2.0:1777497613.744006:0:87342:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1777497613.744422:0:87342:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1777497613.744462:0:87342:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1777497613.744600:0:87342:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1777497613.745164:0:87342:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/32) registered 00000100:00100000:0.0:1777497613.745778:0:87375:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940288:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1777497613.745823:0:87375:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1777497613.745873:0:87375:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497613.745947:0:87375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497613.746595:0:87375:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240910fe180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497613.752607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497613.754135:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313344 00000100:00100000:1.0:1777497613.754152:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313344 00000100:00100000:1.0:1777497613.754239:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:1.0:1777497613.754253:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+6:41987:x1863837546313344:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497613.754480:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546313344:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 230us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497613.754500:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 30 00000100:00100000:2.0:1777497613.757725:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940416 00000100:00100000:2.0:1777497613.757743:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940416 00000100:00100000:2.0:1777497613.757819:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3950 00000100:00100000:2.0:1777497613.757831:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940416:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497613.758069:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940416:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 240us (12119us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.758122:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3950 00000100:00100000:0.0:1777497613.760324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00080000:0.0:1777497613.760786:0:87342:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 107374182407 00000100:00100000:1.0:1777497613.761183:0:87375:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28e00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940416:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497613.761335:0:87375:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940544:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497613.761401:0:87375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497613.761435:0:87375:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048c00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497613.763153:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313472 00000100:00100000:3.0:1777497613.763171:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313472 00000100:00100000:3.0:1777497613.763251:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:3.0:1777497613.763262:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546313472:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497613.763467:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546313472:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 205us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.763475:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 31 00000100:00100000:2.0:1777497613.764116:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940544 00000100:00100000:2.0:1777497613.764124:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940544 00000100:00100000:2.0:1777497613.764177:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3951 00000100:00100000:2.0:1777497613.764185:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940544:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497613.764305:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:87375:x1863837564940544:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 121us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.764312:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3951 00010000:00080000:0.0:1777497613.765525:0:87376:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 87376 00010000:02000000:0.0:1777497613.765553:0:87376:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00000100:00100000:3.0:1777497613.766772:0:87375:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:87375:1863837564940544:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1777497613.766866:0:87375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497613.769165:0:87375:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777497613.769311:0:87375:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1777497613.769318:0:87375:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:2.0:1777497613.769838:0:87342:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1777497613.769865:0:87342:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1777497613.769905:0:87342:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:2.0:1777497613.769940:0:87342:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1777497613.771189:0:87342:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497613.771551:0:87342:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1777497613.778792:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497613.778840:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313600 00000100:00100000:3.0:1777497613.778852:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313600 00000100:00100000:3.0:1777497613.778916:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:3.0:1777497613.778933:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+7:41987:x1863837546313600:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497613.778956:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497613.778980:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dc600/0x3e357265691cf38 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c225 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.779019:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dc600/0x3e357265691cf38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c225 expref: 8 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.779032:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dc600/0x3e357265691cf38 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c225 expref: 8 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497613.779044:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dc600, rc 0) 00000100:00100000:3.0:1777497613.779138:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313600:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 212us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.779145:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 32 00000100:00100000:0.0:1777497613.793333:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497613.793398:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313728 00000100:00100000:0.0:1777497613.793410:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313728 00000100:00100000:0.0:1777497613.793499:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:0.0:1777497613.793512:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313728:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497613.794038:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313728:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 529us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497613.794046:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 33 00000100:00100000:3.0:1777497613.797267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497613.797338:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313856 00000100:00100000:3.0:1777497613.797352:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313856 00000100:00100000:3.0:1777497613.797436:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 34 00000100:00100000:3.0:1777497613.797448:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313856:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497613.797978:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313856:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 529us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497613.797999:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 34 00010000:00080000:1.0:1777497613.801153:0:87376:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1777497613.801167:0:87376:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:3.0:1777497613.806754:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497613.806942:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546313984 00000100:00100000:2.0:1777497613.806957:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546313984 00000100:00100000:2.0:1777497613.807034:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:2.0:1777497613.807047:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924099291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+8:41987:x1863837546313984:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497613.807072:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497613.807119:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b35e00/0x3e357265691cf3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c22c expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.807160:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b35e00/0x3e357265691cf3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c22c expref: 9 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.807173:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b35e00/0x3e357265691cf3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c22c expref: 9 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497613.807205:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35e00, rc 0) 00000100:00100000:2.0:1777497613.807292:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924099291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546313984:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 236us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497613.807301:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 35 00000100:00100000:0.0:1777497613.816322:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497613.816397:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314112 00000100:00100000:3.0:1777497613.816425:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314112 00000100:00100000:3.0:1777497613.816501:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 36 00000100:00100000:3.0:1777497613.816513:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546314112:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497613.817200:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:41987:x1863837546314112:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 685us (884us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497613.817213:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 36 10000000:01000000:1.0:1777497614.434476:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777497614.434497:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff924098a46000 from 116 10000000:01000000:1.0:1777497614.434504:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497614.434579:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.434594:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.434609:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.434643:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.434762:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.434820:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497614.436867:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940672 00000100:00100000:3.0:1777497614.436885:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940672 00000100:00100000:3.0:1777497614.436972:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777497614.436984:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837564940672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497614.437005:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497614.437029:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dce00/0x3e357265691cf4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf46 expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.437063:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dce00/0x3e357265691cf4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf46 expref: 10 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.437074:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dce00/0x3e357265691cf4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf46 expref: 10 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.437084:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dce00, rc 0) 00000100:00100000:3.0:1777497614.437189:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564940672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 207us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497614.437197:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1777497614.437438:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.437462:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.437473:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.437568:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.437621:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.437659:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497614.438846:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940800 00000100:00100000:3.0:1777497614.438854:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940800 00000100:00100000:3.0:1777497614.438889:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777497614.438898:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564940800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777497614.438922:0:87349:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777497614.438946:0:87349:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777497614.438949:0:87349:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 116 00000100:00100000:3.0:1777497614.439075:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564940800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 178us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497614.439083:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1777497614.439832:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497614.439905:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497614.439916:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.439928:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497614.439939:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497614.439941:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:1.0:1777497614.439945:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497614.439980:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.439989:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.440009:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.440030:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.440075:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.440125:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497614.440403:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564940928 00000100:00100000:3.0:1777497614.440410:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564940928 00000100:00100000:3.0:1777497614.440499:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1777497614.440508:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564940928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497614.440521:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497614.440538:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240866dd800/0x3e357265691cf5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf54 expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.440565:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240866dd800/0x3e357265691cf5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf54 expref: 11 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.440577:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240866dd800/0x3e357265691cf5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf54 expref: 11 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.440587:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240866dd800, rc 0) 00000100:00100000:3.0:1777497614.440633:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564940928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497614.440640:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1777497614.440709:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564940928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.440723:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.440733:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.440807:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.440834:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.442839:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.442904:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941056 00000100:00100000:2.0:1777497614.442915:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941056 00000100:00100000:0.0:1777497614.442993:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1777497614.443006:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564941056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.443347:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564941056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.443355:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1777497614.443526:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.443590:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.443649:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.443668:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.443682:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941184 00000100:00100000:1.0:1777497614.443685:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941184 00000100:00100000:1.0:1777497614.443706:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1777497614.443714:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564941184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.443803:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564941184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.443816:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1777497614.443858:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497614.444575:0:87400:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1777497614.444642:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1777497614.444671:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497614.444996:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445009:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497614.445021:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1777497614.445024:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 113 10000000:01000000:1.0:1777497614.445027:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1777497614.445067:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445076:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445086:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.445130:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.445181:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.445205:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.445226:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941312 00000100:00100000:1.0:1777497614.445231:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941312 00000100:00100000:1.0:1777497614.445397:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1777497614.445409:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564941312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.445423:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497614.445438:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ffa00/0x3e357265691cf69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf62 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445467:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ffa00/0x3e357265691cf69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf62 expref: 12 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445490:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ffa00/0x3e357265691cf69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf62 expref: 12 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445499:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ffa00, rc 0) 00000100:00100000:1.0:1777497614.445537:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564941312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.445544:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1777497614.445590:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.445604:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.445613:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.445663:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941440:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.445691:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.445704:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8525e180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.445716:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941440 00000100:00100000:1.0:1777497614.445719:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941440 00000100:00100000:1.0:1777497614.445744:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1777497614.445750:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564941440:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497614.445765:0:87347:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777497614.445785:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497614.445789:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497614.445793:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497614.445795:0:87347:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777497614.445798:0:87347:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:1.0:1777497614.445879:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564941440:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.445886:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1777497614.445915:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941440:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497614.445999:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497614.446005:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446012:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497614.446020:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1777497614.446022:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:1.0:1777497614.446025:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497614.446041:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446048:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446055:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.446073:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.446116:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.446128:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.446139:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941568 00000100:00100000:1.0:1777497614.446142:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941568 00000100:00100000:1.0:1777497614.446157:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1777497614.446163:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564941568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.446170:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497614.446179:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff400/0x3e357265691cf77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf70 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446195:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff400/0x3e357265691cf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf70 expref: 13 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446204:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff400/0x3e357265691cf77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf70 expref: 13 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446210:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff400, rc 0) 00000100:00100000:1.0:1777497614.446234:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.446240:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1777497614.446264:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.446273:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.446538:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.446599:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.446624:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.446700:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.446893:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941696 00000100:00100000:2.0:1777497614.446898:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941696 00000100:00100000:2.0:1777497614.446922:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1777497614.446929:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.447087:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.447113:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1777497614.447167:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.447197:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.447239:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.447263:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.447273:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941824 00000100:00100000:2.0:1777497614.447417:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941824 00000100:00100000:2.0:1777497614.447446:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1777497614.447453:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.449828:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2366us (2578us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.449841:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1777497614.452161:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497614.453487:0:87401:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:0.0:1777497614.455790:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:0.0:1777497614.455838:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1777497614.455852:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.455883:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.455894:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:0.0:1777497614.455897:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:0.0:1777497614.455900:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1777497614.455951:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.455959:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.455971:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.456000:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.456079:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.456150:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863c2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.456220:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564941952 00000100:00100000:1.0:1777497614.456230:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564941952 00000100:00100000:1.0:1777497614.456393:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1777497614.456406:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564941952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.456424:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497614.456440:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff600/0x3e357265691cf85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf7e expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.456472:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff600/0x3e357265691cf85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf7e expref: 14 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.456494:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff600/0x3e357265691cf85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf7e expref: 14 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.456504:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff600, rc 0) 00000100:00100000:1.0:1777497614.456553:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84b2c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564941952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.456565:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497614.459083:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564941952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.459133:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459148:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.459175:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1777497614.459194:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459228:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.459238:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1777497614.459241:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:0.0:1777497614.459244:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1777497614.459373:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459381:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459392:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.459419:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.459500:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.459549:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.459571:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942080 00000100:00100000:0.0:1777497614.459578:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942080 00000100:00100000:0.0:1777497614.459631:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497614.459640:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564942080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.459657:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497614.459673:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef400/0x3e357265691cf93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf8c expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459698:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef400/0x3e357265691cf93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf8c expref: 15 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459720:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef400/0x3e357265691cf93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf8c expref: 15 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459730:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef400, rc 0) 00000100:00100000:0.0:1777497614.459764:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84b2e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.459771:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497614.459815:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.459825:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.459833:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.459898:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.459921:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.459932:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.459942:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942208 00000100:00100000:0.0:1777497614.459945:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942208 00000100:00100000:0.0:1777497614.459961:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777497614.459966:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.460085:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.460123:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1777497614.460150:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.460189:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.460233:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.460251:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863c2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.460262:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942336 00000100:00100000:0.0:1777497614.460265:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942336 00000100:00100000:0.0:1777497614.460629:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1777497614.460639:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.460745:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.460751:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1777497614.461435:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942336:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497614.463359:0:87402:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497614.463655:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497614.463692:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497614.463705:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.463721:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497614.463732:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497614.463735:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:2.0:1777497614.463738:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497614.463786:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.463795:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.463807:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497614.463840:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.463922:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.463975:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.465514:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942464 00000100:00100000:1.0:1777497614.465532:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942464 00000100:00100000:1.0:1777497614.465630:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1777497614.465640:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564942464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.465662:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497614.465684:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff000/0x3e357265691cfa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cf9a expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.465720:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff000/0x3e357265691cfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cf9a expref: 16 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.465732:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff000/0x3e357265691cfa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cf9a expref: 16 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.465742:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff000, rc 0) 00000100:00100000:1.0:1777497614.465824:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (1901us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.465830:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1777497614.465899:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.465918:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.465930:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.466017:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.466049:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.466065:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.466132:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942592 00000100:00100000:2.0:1777497614.466137:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942592 00000100:00100000:2.0:1777497614.466168:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1777497614.466176:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.466417:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.466435:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1777497614.466548:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.466583:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.466635:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.466691:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.468474:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942720 00000100:00100000:0.0:1777497614.468501:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942720 00000100:00100000:2.0:1777497614.474239:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1777497614.474839:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.475064:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 808us (8427us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.475074:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1777497614.475720:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942720:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497614.476718:0:87403:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:2.0:1777497614.484453:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:2.0:1777497614.484516:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497614.484530:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.484546:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497614.484556:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1777497614.484559:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1777497614.484563:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1777497614.484613:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.484624:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.484638:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497614.484671:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.484755:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.486952:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.486988:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942848 00000100:00100000:2.0:1777497614.487001:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942848 00000100:00100000:2.0:1777497614.487076:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1777497614.487088:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564942848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497614.487144:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497614.487166:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b35600/0x3e357265691cfaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfa8 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.487202:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b35600/0x3e357265691cfaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfa8 expref: 17 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.487215:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b35600/0x3e357265691cfaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfa8 expref: 17 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.487226:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b35600, rc 0) 00000100:00100000:2.0:1777497614.487323:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a62f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564942848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 238us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.487331:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1777497614.487405:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497614.487426:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.487437:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497614.487546:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.487585:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.487620:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.487635:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564942976 00000100:00100000:2.0:1777497614.487639:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564942976 00000100:00100000:2.0:1777497614.487661:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1777497614.487668:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564942976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.487836:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564942976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.487843:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1777497614.487876:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564942976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.487907:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.487955:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.487967:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d33c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.487978:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943104 00000100:00100000:2.0:1777497614.487981:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943104 00000100:00100000:2.0:1777497614.487999:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497614.488005:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564943104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.489776:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564943104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1759us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497614.489800:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497614.489851:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497614.491230:0:87404:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1777497614.492962:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1777497614.493015:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1777497614.493028:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.493044:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497614.493055:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777497614.493058:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:3.0:1777497614.493062:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777497614.493138:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.493147:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.493160:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497614.493192:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.493287:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497614.493339:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.493550:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943232 00000100:00100000:0.0:1777497614.493560:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943232 00000100:00100000:0.0:1777497614.493625:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497614.493637:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564943232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.493656:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497614.493673:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefa00/0x3e357265691cfbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfb6 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.493701:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefa00/0x3e357265691cfbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfb6 expref: 18 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.493713:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefa00/0x3e357265691cfbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfb6 expref: 18 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.493722:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefa00, rc 0) 00000100:00100000:0.0:1777497614.493775:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82ca8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.493793:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1777497614.493841:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.493857:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.493866:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.493948:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.493977:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.494001:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408c265840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.494017:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943360 00000100:00100000:0.0:1777497614.494021:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943360 00000100:00100000:0.0:1777497614.494039:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777497614.494045:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82caa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.494183:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82caa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.494189:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1777497614.494217:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.494246:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.495463:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.495832:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcc23600 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.495871:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943488 00000100:00100000:0.0:1777497614.495880:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943488 00000100:00100000:2.0:1777497614.498827:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1777497614.498851:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.499080:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82ca9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (3622us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.499089:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1777497614.499798:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497614.500632:0:87405:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1777497614.500723:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1777497614.500757:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497614.500771:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.500786:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.500799:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497614.500802:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:0.0:1777497614.500805:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497614.500847:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.500856:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.500866:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.500896:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.500963:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.501001:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.501155:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943616 00000100:00100000:0.0:1777497614.501164:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943616 00000100:00100000:0.0:1777497614.501206:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1777497614.501216:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564943616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.501232:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497614.501260:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef800/0x3e357265691cfcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfc4 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.501289:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef800/0x3e357265691cfcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfc4 expref: 19 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.501301:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef800/0x3e357265691cfcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfc4 expref: 19 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.501310:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef800, rc 0) 00000100:00100000:0.0:1777497614.501354:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82ca8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564943616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.501361:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1777497614.501403:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.501419:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.501428:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.501505:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.501532:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.501547:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.501563:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943744 00000100:00100000:0.0:1777497614.501567:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943744 00000100:00100000:0.0:1777497614.501581:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1777497614.501586:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564943744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.501712:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82ca9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564943744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.501727:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1777497614.501752:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.501779:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.501821:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.501829:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcc23780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.501845:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564943872 00000100:00100000:0.0:1777497614.501848:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564943872 00000100:00100000:0.0:1777497614.501864:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1777497614.501869:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564943872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.501953:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564943872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.501960:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1777497614.501995:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564943872:0@lo:503:ll_cfg_requeue.0 00010000:00010000:3.0:1777497614.502740:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1777497614.503975:0:87406:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1777497614.504147:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1777497614.504199:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497614.504214:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.504250:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497614.504261:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1777497614.504264:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1777497614.504268:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497614.504336:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.504498:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.504510:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497614.504540:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.504620:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497614.504684:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.505041:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944000 00000100:00100000:2.0:1777497614.505072:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944000 00000100:00100000:2.0:1777497614.505168:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1777497614.505178:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564944000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497614.505197:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497614.505216:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88b34a00/0x3e357265691cfd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfd2 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.505245:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88b34a00/0x3e357265691cfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfd2 expref: 20 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.505257:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88b34a00/0x3e357265691cfd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfd2 expref: 20 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.505266:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88b34a00, rc 0) 00000100:00100000:2.0:1777497614.508728:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3543us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.508740:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1777497614.516585:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.516627:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.516645:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.519662:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.519774:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.519845:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568e900 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.519870:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944128 00000100:00100000:2.0:1777497614.519887:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944128 00000100:00100000:2.0:1777497614.519961:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1777497614.519972:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.520190:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.520198:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1777497614.521528:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.521608:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.521682:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.521731:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568e900 going to sleep for 11 seconds 00000100:00100000:2.0:1777497614.521758:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944256 00000100:00100000:2.0:1777497614.521770:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944256 00000100:00100000:2.0:1777497614.521830:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1777497614.521838:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.523510:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1666us (1821us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497614.523521:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1777497614.523853:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497614.527593:0:87408:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1777497614.528076:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1777497614.528141:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1777497614.528154:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.528169:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497614.528180:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497614.528184:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:2.0:1777497614.528187:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497614.528250:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.528259:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497614.528280:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497614.528312:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497614.528400:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497614.528447:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924089f97f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.528772:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944384 00000100:00100000:0.0:1777497614.528783:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944384 00000100:00100000:0.0:1777497614.528846:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1777497614.528857:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564944384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.528875:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497614.528892:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeea00/0x3e357265691cfe7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfe0 expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.528921:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeea00/0x3e357265691cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfe0 expref: 21 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.528933:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeea00/0x3e357265691cfe7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfe0 expref: 21 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.528943:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeea00, rc 0) 00000100:00100000:0.0:1777497614.528998:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.529006:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1777497614.529127:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.529145:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.529154:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497614.529232:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.529264:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497614.529301:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.529484:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944512 00000100:00100000:0.0:1777497614.529488:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944512 00000100:00100000:0.0:1777497614.531471:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1777497614.531507:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.531730:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (2463us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.531737:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777497614.536264:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.536943:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.537049:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497614.537144:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.537544:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944640 00000100:00100000:1.0:1777497614.537554:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944640 00000100:00100000:1.0:1777497614.537611:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1777497614.537622:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408938d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497614.537830:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408938d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.537838:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1777497614.537972:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497614.543817:0:87411:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1777497614.548582:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1777497614.548635:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777497614.548649:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.548690:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497614.548703:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1777497614.548707:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:3.0:1777497614.548711:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1777497614.548769:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.548779:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497614.548794:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497614.548828:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497614.548918:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497614.549023:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497614.552413:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944768 00000100:00100000:1.0:1777497614.552429:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944768 00000100:00100000:1.0:1777497614.552545:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1777497614.552559:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564944768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497614.552595:0:87349:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497614.552619:0:87349:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fe600/0x3e357265691cff5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cfee expref: -99 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.552668:0:87349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fe600/0x3e357265691cff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cfee expref: 22 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.552681:0:87349:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fe600/0x3e357265691cff5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cfee expref: 22 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497614.552691:0:87349:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe600, rc 0) 00000100:00100000:1.0:1777497614.552790:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085253050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564944768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497614.552797:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1777497614.554204:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.554236:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554251:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.554297:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1777497614.554303:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554312:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497614.554322:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1777497614.554326:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:0.0:1777497614.554329:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1777497614.554365:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554373:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554383:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.554420:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.554488:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.554529:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568e900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.554552:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564944896 00000100:00100000:0.0:1777497614.554557:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564944896 00000100:00100000:0.0:1777497614.554609:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1777497614.554620:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564944896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.554634:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497614.554650:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691d003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691cffc expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554843:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691d003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691cffc expref: 23 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554856:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeec00/0x3e357265691d003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691cffc expref: 23 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554864:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:0.0:1777497614.554905:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564944896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 287us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497614.554912:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1777497614.554947:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564944896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497614.554957:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.554966:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497614.555037:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564945024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.555064:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497614.555073:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568e900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497614.555091:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945024 00000100:00100000:0.0:1777497614.555125:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945024 00000100:00100000:0.0:1777497614.555142:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1777497614.555148:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564945024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497614.555224:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085250050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564945024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (159us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497614.555230:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1777497614.555252:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564945024:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1777497614.555369:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1777497614.555375:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497614.555383:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497615.522387:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497616.546277:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497617.215585:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497617.215793:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314368 00000100:00100000:0.0:1777497617.215807:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314368 00000100:00100000:0.0:1777497617.215862:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1280 00000100:00100000:0.0:1777497617.215872:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546314368:12345-192.168.202.4@tcp:38:kworker.0 00010000:00080000:0.0:1777497617.215914:0:73210:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID '6d03493e-1218-49f3-bdd0-b10716c402e0' at ffff9240bb685000, cookie 0x3e357265691ce74 00010000:00080000:0.0:1777497617.215920:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from 6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp recovering/t107374182408 exp ffff9240bb685000 cur 3746 last 1777497613 00010000:02000400:0.0:1777497617.215944:0:73210:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00000100:00100000:1.0:1777497617.222250:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497617.222298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497617.222332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497617.222434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497617.222484:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314496 00000100:00100000:1.0:1777497617.222496:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314496 00000100:00100000:1.0:1777497617.222578:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1250 00000100:00100000:1.0:1777497617.222589:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546314496:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497617.222687:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546314496:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 101us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497617.222696:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1250 00000100:00100000:1.0:1777497617.222726:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314752 00000100:00100000:1.0:1777497617.222730:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314752 00000100:00100000:1.0:1777497617.222775:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2551 00000100:00100000:1.0:1777497617.222782:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546314752:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497617.222809:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2415:x1863837546314752:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497617.222815:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2551 00000100:00100000:1.0:1777497617.222826:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314624 00000100:00100000:1.0:1777497617.222829:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314624 00000100:00100000:1.0:1777497617.222851:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2552 00000100:00100000:1.0:1777497617.222857:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546314624:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497617.222886:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2415:x1863837546314624:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497617.222892:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2552 00000100:00080000:1.0:1777497617.222913:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497617.222917:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497617.222920:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497617.224226:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314240 00000100:00100000:1.0:1777497617.224237:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314240 00000100:00100000:1.0:1777497617.224334:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 72 00000100:00100000:1.0:1777497617.224343:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546314240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497617.224428:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085251c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2415:x1863837546314240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 86us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497617.224436:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 72 00010000:00080000:0.0:1777497617.224971:0:73210:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:0.0:1777497617.225323:0:73210:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1777497617.225536:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240aef6d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497617.225599:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546314368:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 9727us (10026us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497617.225609:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1280 00000100:00100000:0.0:1777497617.232271:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497617.232517:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546302720 00000100:00100000:2.0:1777497617.232531:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546302720 00000100:00100000:2.0:1777497617.232627:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1281 00000100:00100000:2.0:1777497617.232639:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546302720:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00080000:2.0:1777497617.232666:0:63727:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 107374182408, current: 107374182408, replaying 00000100:00100000:2.0:1777497617.232683:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546302720:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 48us (429us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497617.232690:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1281 00010000:00080000:0.0:1777497617.233181:0:87376:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000100:00100000:1.0:1777497617.446458:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497617.446487:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564945152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497617.446587:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497617.446657:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945152 00000100:00100000:1.0:1777497617.446676:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945152 00000100:00100000:1.0:1777497617.446756:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1777497617.446765:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564945152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497617.446804:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497617.446856:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564945152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497617.446863:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00080000:1.0:1777497617.446890:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497617.446937:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564945152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497617.452110:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564945280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497617.452218:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497617.452518:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945280 00000100:00100000:3.0:1777497617.452529:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945280 00000100:00100000:3.0:1777497617.452608:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:3.0:1777497617.452619:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564945280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497617.452655:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497617.452707:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564945280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497617.452714:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00080000:0.0:1777497617.454416:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497617.454523:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564945280:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777497617.571543:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497618.596741:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497618.978920:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497618.978929:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497618.978934:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497618.978950:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497618.978979:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f8df29880 x1863837564945536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497618.979008:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497618.979011:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497618.979013:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497618.979018:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497618.979028:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f8df28000 x1863837564945792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497618.979079:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497618.979083:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497618.979085:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497618.979092:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497618.979132:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f8df28a80 x1863837564946048/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497618.979153:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497618.979156:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497618.979158:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497618.979163:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497618.979171:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f8df2a680 x1863837564946432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497618.979195:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1777497618.979198:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497618.979199:0:82203:0:(import.c:65:import_set_state_nolock()) ffff9240aef6f800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497618.979203:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240aef6f800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497618.979213:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f8df28e00 x1863837564946944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497618.979247:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564945664:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979345:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979389:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564946560:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979419:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979463:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1777497618.979475:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564945408:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979511:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979553:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564946304:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979580:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979615:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564945920:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979652:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979673:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564946688:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979696:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979718:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1777497618.979724:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564946176:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979746:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979762:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564946816:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979802:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497618.979845:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946560 00000100:00100000:0.0:1777497618.979854:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946560 00000100:00100000:0.0:1777497618.979913:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1777497618.979923:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564946560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.979991:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564946560:12345-0@lo:400:kworker.0 Request processed in 69us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980000:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3952 00000100:00100000:0.0:1777497618.980027:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946304 00000100:00100000:0.0:1777497618.980031:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946304 00000100:00100000:0.0:1777497618.980058:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946688 00000100:00100000:0.0:1777497618.980060:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946688 00000100:00100000:0.0:1777497618.980092:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946176 00000100:00100000:0.0:1777497618.980123:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946176 00000100:00100000:0.0:1777497618.980143:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946816 00000100:00100000:0.0:1777497618.980152:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946816 00000100:00100000:0.0:1777497618.980179:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1777497618.980186:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564946304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980219:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564946304:12345-0@lo:400:kworker.0 Request processed in 34us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980226:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:0.0:1777497618.980237:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1777497618.980243:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564946688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980275:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564946688:12345-0@lo:400:kworker.0 Request processed in 32us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980281:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1777497618.980292:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1777497618.980298:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564946176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980329:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564946176:12345-0@lo:400:kworker.0 Request processed in 31us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980335:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1777497618.980347:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1777497618.980353:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564946816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980380:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564946816:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980386:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:0.0:1777497618.980405:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945664 00000100:00100000:0.0:1777497618.980409:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945664 00000100:00100000:0.0:1777497618.980452:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945920 00000100:00100000:0.0:1777497618.980455:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945920 00000100:00100000:0.0:1777497618.980478:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1777497618.980484:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564945664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980524:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564945664:12345-0@lo:400:kworker.0 Request processed in 40us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980531:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1777497618.980543:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1777497618.980550:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aee29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564945920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980576:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aee29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564945920:12345-0@lo:400:kworker.0 Request processed in 27us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497618.980581:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:0.0:1777497618.980636:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564946304:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980650:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564945664:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980659:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564946560:0@lo:400:kworker.0 00000100:00080000:0.0:1777497618.980691:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497618.980695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497618.980697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497618.980717:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564946176:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980726:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564946816:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980735:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564945920:0@lo:400:kworker.0 00000100:00100000:0.0:1777497618.980744:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564946688:0@lo:400:kworker.0 00000100:00100000:3.0:1777497618.981057:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564945536:0@lo:38:kworker.0 00000100:00100000:3.0:1777497618.981127:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497618.981149:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564945792:0@lo:38:kworker.0 00000100:00100000:3.0:1777497618.981170:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497618.981187:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564946048:0@lo:38:kworker.0 00000100:00100000:3.0:1777497618.981209:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497618.981228:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564946432:0@lo:38:kworker.0 00000100:00100000:3.0:1777497618.981250:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497618.981264:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564946944:0@lo:38:kworker.0 00000100:00100000:3.0:1777497618.981283:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497618.981316:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945536 00000100:00100000:3.0:1777497618.981320:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945536 00000100:00100000:3.0:1777497618.981341:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945792 00000100:00100000:3.0:1777497618.981343:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945792 00000100:00100000:3.0:1777497618.981350:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946432 00000100:00100000:3.0:1777497618.981353:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946432 00000100:00100000:3.0:1777497618.981360:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946944 00000100:00100000:3.0:1777497618.981362:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946944 00000100:00100000:3.0:1777497618.981371:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1777497618.981376:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564945536:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.981405:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3748 last 0 00000020:00000080:3.0:1777497618.981459:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691d00a 00000004:00100000:3.0:1777497618.981477:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497618.981659:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f82ab0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497618.981711:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837564945536:12345-0@lo:38:kworker.0 Request processed in 333us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497618.981718:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1777497618.981735:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1777497618.981747:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564945792:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.981760:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3748 last 0 00000020:00000080:3.0:1777497618.981783:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691d011 00000004:00100000:3.0:1777497618.981790:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497618.981810:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f88a89800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497618.981836:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837564945792:12345-0@lo:38:kworker.0 Request processed in 89us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497618.981842:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1777497618.981853:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1777497618.981856:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564946432:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.981868:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3748 last 0 00000020:00000080:3.0:1777497618.981894:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691d018 00000004:00100000:3.0:1777497618.981900:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497618.981913:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240849d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497618.981936:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837564946432:12345-0@lo:38:kworker.0 Request processed in 78us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497618.981942:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1777497618.981954:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1777497618.981957:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564946944:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.981968:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3748 last 0 00000020:00000080:3.0:1777497618.981993:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691d01f 00000004:00100000:3.0:1777497618.981998:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497618.982011:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240849d2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497618.982037:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564946944:12345-0@lo:38:kworker.0 Request processed in 78us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497618.982051:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:3.0:1777497618.982086:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564946048 00000100:00100000:3.0:1777497618.982091:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564946048 00000100:00100000:3.0:1777497618.982143:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3953 00000100:00100000:3.0:1777497618.982147:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564946048:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.982161:0:8406:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9240b539c800, cookie 0x3e357265691ce7b 00010000:00080000:3.0:1777497618.982166:0:8406:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff9240b539c800 cur 3748 last 1777497613 00000004:00100000:3.0:1777497618.982176:0:8406:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497618.982192:0:8406:0:(import.c:65:import_set_state_nolock()) ffff923f86084000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497618.982225:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564946048:12345-0@lo:38:kworker.0 Request processed in 77us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497618.982230:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3953 00010000:00080000:3.0:1777497618.982300:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f8df29880 x1863837564945536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497618.982316:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 26 00000100:00080000:3.0:1777497618.983228:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff923f8df29880 x1863837564945536/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497618.983240:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777497618.983245:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497618.983249:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497618.983255:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564945536:0@lo:38:kworker.0 00010000:00080000:3.0:1777497618.983282:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f8df28000 x1863837564945792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497618.983293:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 26 00000100:00080000:3.0:1777497618.984209:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff923f8df28000 x1863837564945792/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497618.984220:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777497618.984224:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497618.984227:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497618.984234:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564945792:0@lo:38:kworker.0 00000100:00080000:3.0:1777497618.984269:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 26 00000100:00080000:3.0:1777497618.984278:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1777497618.984283:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1777497618.984285:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 81604378625 gen 3 00000100:00080000:3.0:1777497618.984290:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 81604378625 last 0 00000100:00080000:3.0:1777497618.984293:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:2.0:1777497618.985180:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564945408 00000100:00100000:2.0:1777497618.985192:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564945408 00000100:00100000:2.0:1777497618.985256:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1777497618.985266:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564945408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497618.985380:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085252850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564945408:12345-0@lo:400:kworker.0 Request processed in 116us (5868us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497618.985388:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1777497618.985546:0:87376:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1777497618.985555:0:87376:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 107374182408 00000020:00080000:0.0:1777497618.985562:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497618.985566:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 107374182408, next_transno: 107374182408 00010000:00080000:0.0:1777497618.985571:0:87376:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (107374182408) 00000020:00080000:0.0:1777497618.985590:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497618.985602:0:87376:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546302720 t107374182408 from 192.168.202.4@tcp req@ffff923f8df29500 x1863837546302720/t0(107374182408) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:373/0 lens 528/0 e 0 to 0 dl 1777497628 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497618.985734:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564945408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497618.986243:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564946048:0@lo:38:kworker.0 00010000:00080000:2.0:1777497618.986267:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f8df2a680 x1863837564946432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497618.986282:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 26 00000100:00080000:2.0:1777497618.987182:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff923f8df2a680 x1863837564946432/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497643 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497618.987194:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1777497618.987199:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497618.987204:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777497618.987210:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564946432:0@lo:38:kworker.0 00010000:00080000:2.0:1777497618.987247:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f8df28e00 x1863837564946944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497618.987276:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 26 00000100:00080000:2.0:1777497618.987284:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1777497618.987289:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1777497618.987291:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1777497618.987296:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564946944:0@lo:38:kworker.0 00010000:00080000:2.0:1777497618.987359:0:87579:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1777497618.987365:0:87579:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1777497618.987371:0:87579:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1777497618.987835:0:87579:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1777497618.987903:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564947072:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1777497618.987984:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497618.988048:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947072 00000100:00100000:2.0:1777497618.988055:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947072 00000100:00100000:2.0:1777497618.988135:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3954 00000100:00100000:2.0:1777497618.988145:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564947072:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1777497618.988165:0:23359:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff92409882a300 x1863837564947072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:374/0 lens 224/0 e 0 to 0 dl 1777497629 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497618.988175:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564947072:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 32us (192us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497618.988182:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3954 00000004:00080000:2.0:1777497618.993337:0:87376:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7648us 00000100:00100000:2.0:1777497618.993460:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497618.993488:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564947200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497618.993588:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497618.993736:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947200 00000100:00100000:2.0:1777497618.993747:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947200 00000100:00100000:2.0:1777497618.993803:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1777497618.993812:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564947200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497618.993859:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:2.0:1777497618.993910:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564947200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497618.993918:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3955 00000100:00100000:2.0:1777497618.993993:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409882b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564947200:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1777497619.048190:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048219:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048238:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048253:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048259:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048266:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048776:0:87376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048805:0:87376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048812:0:87376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048819:0:87376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fea00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497619.048824:0:87376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048832:0:87376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048848:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924086627500) 00010000:00010000:1.0:1777497619.048851:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497619.048856:0:87376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048862:0:87376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691d026 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497619.048882:0:87376:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005c5de240 reply state 000000003f4a1f7b transno 107374182408 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048893:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.048900:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627b00) 00010000:00010000:1.0:1777497619.048902:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497619.048906:0:87376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497619.049050:0:87376:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497619.049130:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497619.049134:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000020:00080000:1.0:1777497619.049140:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497619.049142:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182409 00000001:00080000:1.0:1777497619.052464:0:87343:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182408 is committed 00010000:00010000:2.0:1777497619.052548:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052564:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052573:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052581:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497619.052587:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052595:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052621:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff924086627b00) 00010000:00010000:2.0:1777497619.052624:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497619.052630:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.052725:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691d02d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497619.058908:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497619.060033:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546303232 00000100:00100000:1.0:1777497619.060050:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546303232 00000100:00100000:1.0:1777497619.060152:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1286 00000100:00100000:1.0:1777497619.060165:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546303232:12345-192.168.202.4@tcp:36:rm.0 00010000:00080000:1.0:1777497619.060191:0:64885:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 107374182409, current: 107374182409, replaying 00000100:00100000:1.0:1777497619.060211:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546303232:12345-192.168.202.4@tcp:36:rm.0 Request processed in 49us (1317us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497619.060218:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1286 00000020:00080000:0.0:1777497619.060352:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.060358:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182409, next_transno: 107374182409 00010000:00080000:0.0:1777497619.060363:0:87376:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (107374182409) 00000020:00080000:0.0:1777497619.060367:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.060378:0:87376:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546303232 t107374182409 from 192.168.202.4@tcp req@ffff924086e9fb80 x1863837546303232/t0(107374182409) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:375/0 lens 512/0 e 0 to 0 dl 1777497630 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777497619.060730:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060750:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060767:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060783:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060790:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060796:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060918:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060940:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.060946:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061375:0:87376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061384:0:87376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 2/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061489:0:87376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061496:0:87376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497619.061500:0:87376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 3/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061547:0:87376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 4/0,0 mode: EX/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061561:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0xa:0x0].0x0 (ffff92409c15e700) 00010000:00010000:0.0:1777497619.061564:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777497619.061570:0:87376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061576:0:87376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d042 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0xa:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061604:0:87376:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061617:0:87376:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061623:0:87376:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061628:0:87376:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497619.061630:0:87376:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061635:0:87376:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061723:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e300) 00010000:00010000:0.0:1777497619.061726:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497619.061730:0:87376:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061735:0:87376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691d034 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497619.061748:0:87376:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b20ff8a3 reply state 00000000385a1822 transno 107374182409 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061760:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.061767:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409c15ec00) 00010000:00010000:0.0:1777497619.061770:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497619.061772:0:87376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1777497619.061907:0:87376:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1777497619.061934:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.061938:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000020:00080000:0.0:1777497619.061942:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.061945:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182410 00000100:00100000:2.0:1777497619.067356:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497619.067459:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305280 00000100:00100000:3.0:1777497619.067473:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305280 00000100:00100000:3.0:1777497619.067557:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1287 00000100:00100000:3.0:1777497619.067570:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546305280:12345-192.168.202.4@tcp:36:dd.0 00010000:00080000:3.0:1777497619.067599:0:63728:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 107374182410, current: 107374182412, replaying 00000100:00100000:3.0:1777497619.070904:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409882b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546305280:12345-192.168.202.4@tcp:36:dd.0 Request processed in 3321us (3545us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497619.070920:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1287 00000020:00080000:0.0:1777497619.070999:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.071005:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182412, next_transno: 107374182410 00010000:00080000:0.0:1777497619.071010:0:87376:0:(ldlm_lib.c:2244:check_for_next_transno()) lustre-MDT0000: waking for gap in transno, VBR is OFF (skip: 107374182410, ql: 1, comp: 1, conn: 2, next: 107374182412, next_update 0 last_committed: 107374182408) 00000020:00080000:0.0:1777497619.071016:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.071027:0:87376:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546305280 t107374182412 from 192.168.202.4@tcp req@ffff92409882b480 x1863837546305280/t0(107374182412) o36->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:375/0 lens 488/0 e 0 to 0 dl 1777497630 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1777497619.071500:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: --/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.072292:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.072308:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497619.072386:0:87376:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 107374182412 00000004:00010000:0.0:1777497619.072424:0:87376:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d3bc249a reply state 00000000aaf4f657 transno 107374182412 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: PW/PW res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.072447:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.072455:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:0.0:1777497619.072459:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497619.072471:0:87376:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1777497619.073060:0:87376:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1777497619.073076:0:87376:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000020:00080000:0.0:1777497619.073131:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.073134:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000020:00080000:0.0:1777497619.073140:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.073142:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182413 00000100:00100000:1.0:1777497619.077303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497619.077404:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546305664 00000100:00100000:3.0:1777497619.077417:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546305664 00000100:00100000:3.0:1777497619.077498:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1288 00000100:00100000:3.0:1777497619.077519:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2411:x1863837546305664:12345-192.168.202.4@tcp:101:dd.0 00010000:00080000:3.0:1777497619.077561:0:63729:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 107374182413, current: 107374182413, replaying 00000100:00100000:3.0:1777497619.077582:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2411:x1863837546305664:12345-192.168.202.4@tcp:101:dd.0 Request processed in 67us (293us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497619.077590:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1288 00000020:00080000:0.0:1777497619.077875:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.077881:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 107374182413, next_transno: 107374182413 00010000:00080000:0.0:1777497619.077885:0:87376:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (107374182413) 00000020:00080000:0.0:1777497619.077889:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.077901:0:87376:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546305664 t107374182413 from 192.168.202.4@tcp req@ffff9240bcd34700 x1863837546305664/t0(107374182413) o101->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:375/0 lens 640/0 e 0 to 0 dl 1777497630 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1777497619.077929:0:87376:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497619.077956:0:87376:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d050 lrc: 2/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c1e6 expref: -99 pid: 87376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078029:0:87376:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 3/0,1 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078047:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078062:0:87376:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 3/0,1 mode: EX/EX res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497619.078372:0:87376:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x283:0x0], count =127 00000004:00080000:0.0:1777497619.078378:0:87376:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x283:0x0]+127 in llog 00000004:00080000:0.0:1777497619.078423:0:87376:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x302:0x0], index 0: 0 00000004:00080000:0.0:1777497619.078430:0:87376:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x303:0x0], index 1: 0 00010000:00010000:0.0:1777497619.078563:0:87376:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 14 pid: 87376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078574:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:0.0:1777497619.078576:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1777497619.078594:0:87376:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691d050 lrc: 0/0,0 mode: --/EX res: [0x20000a811:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 14 pid: 87376 timeout: 0 lvb_type: 3 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078608:0:87376:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 3/0,0 mode: CR/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 13 pid: 87376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.078730:0:87376:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:0.0:1777497619.078733:0:87376:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1777497619.078735:0:87376:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8c00, rc 0) 00010000:00080000:0.0:1777497619.078826:0:87376:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:0.0:1777497619.078846:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.078849:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000020:00080000:0.0:1777497619.078852:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.078854:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 107374182414 00000100:00100000:3.0:1777497619.089181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497619.089406:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546314880 00000100:00100000:0.0:1777497619.089420:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546314880 00000100:00100000:0.0:1777497619.089514:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1253 00000100:00100000:0.0:1777497619.089527:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546314880:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:0.0:1777497619.089561:0:64885:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240af501880 x1863837546314880/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:375/0 lens 224/0 e 0 to 0 dl 1777497630 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497619.089585:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546314880:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 Request processed in 62us (420us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497619.089615:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1253 00000020:00080000:0.0:1777497619.089639:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.089889:0:87376:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 107374182414 00010000:00080000:0.0:1777497619.089893:0:87376:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:0.0:1777497619.089897:0:87376:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:0.0:1777497619.089906:0:87376:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:0.0:1777497619.089909:0:87376:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:0.0:1777497619.090042:0:87376:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149696 00000001:00100000:0.0:1777497619.101628:0:87343:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:0.0:1777497619.101652:0:87343:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1777497619.101681:0:87343:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 107374182413 is committed 00000001:00080000:2.0:1777497619.101846:0:87376:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:2.0:1777497619.101898:0:87376:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:2.0:1777497619.101916:0:87376:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff92409882a300 x1863837564947072/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:374/0 lens 224/0 e 0 to 0 dl 1777497629 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777497619.102125:0:87376:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff9240af501880 x1863837546314880/t0(0) o400->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:375/0 lens 224/0 e 0 to 0 dl 1777497630 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497619.102193:0:87376:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:02, of 2 clients 2 recovered and 0 were evicted. 00010000:00010000:1.0:1777497619.103583:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103600:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103608:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103615:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeee00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497619.103621:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103629:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103689:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409c15ec00) 00010000:00010000:1.0:1777497619.103693:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497619.103698:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103704:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeee00/0x3e357265691d03b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103740:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,1 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103746:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 2/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103752:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103757:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497619.103760:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 3/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103766:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 4/0,0 mode: TXN/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103773:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:1.0:1777497619.103775:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497619.103779:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 2/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.103783:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691d049 lrc: 0/0,0 mode: --/TXN res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 87376 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497619.105648:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:0.0:1777497619.105669:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff924098829f80 x1863837564947072/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497634 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497619.105680:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff924098829f80 x1863837564947072/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497634 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497619.105688:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:0.0:1777497619.105709:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:0.0:1777497619.105717:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000a1733d9d): req@ffff9240bb160380 x1863837564925312/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497602 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497619.105735:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924098829f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564947072:0@lo:400:ldlm_lock_repla.0 00000100:00100000:0.0:1777497619.105936:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.105991:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564947328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497619.106016:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.106057:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564925312 00000100:00100000:0.0:1777497619.106081:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564925312 00000100:00100000:0.0:1777497619.106155:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947328 00000100:00100000:0.0:1777497619.106159:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947328 00000100:00100000:0.0:1777497619.106180:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1777497619.106190:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837564925312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497619.106231:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1777497619.106279:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837564925312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497619.106286:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3956 00000100:00100000:0.0:1777497619.106305:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1777497619.106311:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564947328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497619.106322:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1777497619.106348:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564947328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 38us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497619.106354:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3957 00000100:00100000:0.0:1777497619.106413:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564947328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497619.106445:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564925312:0@lo:41:osp-pre-0-1.0 00000004:00000080:0.0:1777497619.151186:0:87376:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef07ee3e10 00100000:10000000:0.0:1777497619.151208:0:87376:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1777497619.152878:0:87362:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000100:00100000:0.0:1777497619.152946:0:87362:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87362:1863837564947456:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1777497619.153033:0:87362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.153132:0:87362:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750240 going to sleep for 11 seconds 00000004:00080000:0.0:1777497619.153146:0:87364:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:0.0:1777497619.153162:0:87364:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87364:1863837564947584:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1777497619.153193:0:87364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.153511:0:87364:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497619.153543:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947456 00000100:00100000:1.0:1777497619.153552:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947456 00000100:00100000:1.0:1777497619.153603:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947584 00000100:00100000:1.0:1777497619.153606:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947584 00000100:00100000:1.0:1777497619.153635:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5869 00000100:00100000:1.0:1777497619.153646:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:87362:x1863837564947456:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777497619.153683:0:25493:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -31 00002000:02000040:1.0:1777497619.153689:0:25493:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:801) 00000100:00100000:2.0:1777497619.153741:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5870 00000100:00100000:2.0:1777497619.153753:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:87364:x1863837564947584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1777497619.153773:0:25488:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 801 -> diff = -30 00002000:02000040:2.0:1777497619.153778:0:25488:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:801) 00002000:00010000:1.0:1777497619.158865:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.158881:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.158904:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.158906:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.158913:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.158934:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.158946:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.158953:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.159037:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.159204:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.159209:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.159218:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.159219:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.159223:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.159232:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.159240:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.159247:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159306:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497619.159316:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159325:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497619.159332:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159343:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159364:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159371:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d05e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159405:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497619.159409:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159415:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497619.159418:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159447:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159458:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.159467:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.159469:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.159471:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.160074:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497619.160080:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d065 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.160212:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.163193:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.163206:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163238:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163241:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163257:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163275:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163288:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163297:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163321:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.163387:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.163392:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163400:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163402:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163405:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163415:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163423:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163468:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163483:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497619.163495:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497619.163501:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163509:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.163515:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163524:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163545:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163552:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d06c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163573:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.163576:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163594:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.163598:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163605:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163617:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163625:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691d073 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163639:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.163640:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.163643:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.163687:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.163692:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163700:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163701:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163704:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163713:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163726:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163733:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163746:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.163754:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.163758:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163765:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164fa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.163769:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163776:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163787:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163793:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691d07a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163807:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.163813:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.163815:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.163856:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.163861:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163868:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163870:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163872:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163881:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163887:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163893:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163911:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.163938:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:1.0:1777497619.163944:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.163946:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163949:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.163970:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.163970:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.163973:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.163976:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.163977:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.163998:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164022:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164030:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164037:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164050:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.164086:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164113:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164122:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164123:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164127:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164136:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164143:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164150:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164169:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497619.164176:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497619.164180:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164187:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.164190:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164196:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164207:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164210:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164220:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691d088 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164226:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691d081 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164242:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.164246:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164250:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164253:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164257:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164258:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.164262:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164282:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164293:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164300:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691d08f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164313:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164315:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164316:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.164359:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164364:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164371:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164373:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164376:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164384:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164392:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164409:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164427:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.164454:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.164459:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164474:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.164477:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.164478:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164488:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164491:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164509:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164511:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164514:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164515:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164535:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691d096 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164537:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164555:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164562:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164576:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.164583:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.164586:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164603:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.164606:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164614:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164625:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164632:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691d09d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164647:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164649:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164651:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.164693:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164698:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164706:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164708:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164710:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164721:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164723:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164726:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164729:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164739:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164747:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164765:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.164774:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.164779:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164788:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.164792:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.164811:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164816:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164824:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164826:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.164829:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164837:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164845:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164852:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164865:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.164879:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.164883:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164890:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.164892:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164899:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164910:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164926:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691d0ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164928:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.164939:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164942:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.164945:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164953:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164960:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691d0a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.164979:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164981:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.164984:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.164990:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.164997:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165005:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165007:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165010:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165031:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165039:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165046:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165064:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.165125:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.165130:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165138:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165139:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165141:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165150:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165157:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165164:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165182:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.165190:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.165194:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165200:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.165203:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165211:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165212:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.165222:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165225:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165240:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.165242:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691d0b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165245:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165263:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165267:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165269:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165273:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165277:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165284:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691d0b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165314:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.165315:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.165316:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165319:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165323:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165331:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165337:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165340:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165349:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165356:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165363:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165377:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.165387:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.165392:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165400:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.165403:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165411:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.165416:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.165423:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165427:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165450:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.165453:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691d0c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165453:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165457:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165475:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165478:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165481:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165484:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165487:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165505:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165521:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.165530:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.165535:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165557:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.165560:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.165562:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.165571:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165573:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165588:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165590:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165594:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165595:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165614:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691d0c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165615:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165633:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165641:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165652:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.165702:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.165706:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165713:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165718:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.165724:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.165725:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165726:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165731:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165740:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.165745:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165748:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165767:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165768:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165788:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165802:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.165809:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.165812:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165818:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.165821:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165828:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165848:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165855:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691d0d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165867:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165868:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165869:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165893:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165902:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691d0ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.165910:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.165916:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165919:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165922:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.165925:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165927:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165929:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.165932:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.165933:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.165943:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165951:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165958:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.165981:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.165992:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.165997:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166005:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.166009:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.166015:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.166020:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166027:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166028:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166031:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166039:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166047:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166053:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166063:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.166069:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.166072:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166077:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.166080:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166118:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166130:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166138:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d0e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166150:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.166152:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.166153:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.166187:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.166192:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166199:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166201:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166203:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166209:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166211:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166231:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166236:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166255:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691d0dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166258:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166276:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.166295:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.166299:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166306:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.166309:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.166317:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.166318:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166325:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166335:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166335:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166337:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.166341:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166350:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691d0ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166357:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.166368:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166369:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.166373:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.166376:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.166378:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.166383:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.167639:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.167652:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1777497619.170750:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777497619.171031:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.171115:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.171135:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171172:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.171178:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171191:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.171196:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.171206:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171218:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171226:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691d0f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171251:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.171253:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.171254:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.171369:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.171371:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.171378:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171394:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171506:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171514:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171538:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.171584:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.171589:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171597:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.171599:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.171601:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171610:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171614:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.171621:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171642:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.171650:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171816:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.171820:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171829:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171850:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171858:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000792539a5/0x3e357265691d0f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171876:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.171879:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171886:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.171889:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171897:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171907:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.171915:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.171917:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.171938:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497619.171943:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d0ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.171997:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.172003:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.172011:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.172012:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.172015:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.172024:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.172032:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.172040:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.175589:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497619.175611:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.175615:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.175631:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497619.175637:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.175648:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.175675:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.175717:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.175719:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.175721:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.178131:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x321:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.178147:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178180:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178183:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178192:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178215:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178226:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178234:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178268:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497619.178426:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x320:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.178446:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178456:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178458:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178461:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178470:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178490:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178497:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178514:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497619.178528:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.178535:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178544:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.178548:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178558:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178577:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178586:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d10d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x321:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178610:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.178621:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178627:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.178630:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178638:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178658:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178665:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x320:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178680:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.178682:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.178684:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.178736:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.178742:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178750:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178752:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178755:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178777:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178785:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178792:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178821:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.178830:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.178835:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178842:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dca00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.178845:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178852:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178862:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178869:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178890:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.178892:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.178894:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.178944:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.178949:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178957:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178959:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.178962:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178971:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178980:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.178987:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179004:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.179012:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.179017:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179036:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866ddc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.179039:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179046:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179058:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179066:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d122 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179082:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179085:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179087:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.179156:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.179162:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179170:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179171:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179174:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179184:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179205:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179213:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179231:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.179241:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.179246:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179253:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.179256:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179264:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179275:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179282:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d129 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179296:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179304:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179306:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.179358:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.179364:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179371:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179373:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179376:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179386:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179394:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179401:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179417:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.179424:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.179428:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179449:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dcc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.179453:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179473:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179487:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179496:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179516:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179518:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.179519:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.179565:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.179570:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179578:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179579:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.179582:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.179592:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.180878:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.180909:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.180939:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497619.181265:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x31a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.181271:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181284:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.181286:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.181291:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181304:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.181310:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.181312:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.181321:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181322:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.181344:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dde00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.181349:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181351:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.181362:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497619.181363:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181368:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181393:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.181397:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181405:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181420:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181427:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d13e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.181460:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.181462:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.181464:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.181860:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.181871:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d137 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.181893:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.181896:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.181899:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.183705:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497619.183721:0:25493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d106 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.183723:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.183760:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.184168:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.184176:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.184194:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.184197:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.184204:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.184218:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185618:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185635:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.185747:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x319:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.185754:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185769:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.185771:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.185777:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185791:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185799:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185806:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185813:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497619.185830:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497619.185841:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497619.185849:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185857:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.185863:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.185870:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497619.185873:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.185878:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.185888:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.185893:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.185895:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185898:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.185899:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185918:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691d145 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185921:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.185923:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.185924:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185927:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185938:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.185941:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.185942:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.185943:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.185952:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185960:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185975:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.185983:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.185988:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.185996:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc0d802e0) 00002000:00010000:2.0:1777497619.185999:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x318:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.185999:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186004:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.186007:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186012:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.186019:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.186023:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.186030:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186031:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.186038:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691d153 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186039:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186046:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.186052:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.186053:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.186063:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.186075:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186086:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065b1b870/0x3e357265691d14c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x319:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.186126:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x317:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.186133:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186141:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.186142:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.186145:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186155:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186163:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.186182:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186261:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.186265:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186273:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.186277:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186284:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186295:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186302:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099aac728/0x3e357265691d15a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x318:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186313:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.186316:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186329:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.186332:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186340:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186351:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.186359:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.186361:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.187034:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.187056:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497619.187062:0:25488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b85122f1/0x3e357265691d161 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x317:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187089:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.187166:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.187199:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.187211:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.187213:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.187217:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.187267:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497619.187351:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x316:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.187356:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187365:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.187367:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.187370:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.187728:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.187762:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187774:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187780:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187847:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497619.187893:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x315:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.187899:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187907:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.187908:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.187911:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187919:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187927:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187934:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.187950:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1777497619.188066:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497619.188075:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.188084:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497619.188089:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188452:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188466:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188474:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.188542:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x314:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.188549:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188559:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.188561:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.188571:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188583:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188591:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188598:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188614:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497619.188623:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497619.188629:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188636:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.188639:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188648:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.188665:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188699:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.188705:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188713:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.188717:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188725:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188736:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188742:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033e5de7f/0x3e357265691d17d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x314:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188758:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.188760:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.188762:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.188778:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497619.188852:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.188858:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188865:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.188872:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.188902:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188914:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188922:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188929:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188973:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497619.188984:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497619.188988:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.188995:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.188998:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189005:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189017:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189035:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691d168 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189052:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.189055:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189062:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.189065:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189073:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189085:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189091:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691d184 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189127:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.189129:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.189131:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497619.189175:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.189180:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189193:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.189195:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.189198:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189207:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189217:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.189224:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.189555:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.190742:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd3c4df7/0x3e357265691d176 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x315:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.190772:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.190774:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.190777:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497619.190885:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777497619.190910:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497619.190920:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.190925:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.190932:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.190936:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.190945:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.190978:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.190985:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691d18b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191001:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497619.191003:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x313:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497619.191003:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.191005:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.191011:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.191023:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.191024:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.191031:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.191043:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.191054:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497619.191061:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x303:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.191062:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191066:0:25493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191073:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.191074:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497619.191077:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191086:0:25493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191108:0:25493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191116:0:25493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.191123:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191143:0:25493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497619.191151:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191152:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497619.191156:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.191159:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096f18831/0x3e357265691d16f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x316:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191164:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497619.191167:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191175:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.191177:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.191178:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.191180:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.191185:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191192:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d199 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497619.191203:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.191205:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497619.191206:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1777497619.191242:0:25493:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00000100:00100000:1.0:1777497619.191360:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:87362:x1863837564947456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 37710us (38321us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497619.191371:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5869 00010000:00010000:3.0:1777497619.192258:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497619.192275:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.192283:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192298:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.192302:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192312:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192348:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192356:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7b9ed16/0x3e357265691d192 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x313:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192378:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.192380:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.192383:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.192511:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x312:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.192517:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192530:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.192533:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.192538:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192552:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192561:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192569:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192598:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497619.192885:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x311:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.192892:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.192898:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.192902:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.192905:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.192905:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192909:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192928:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.192928:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.192934:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192944:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.192948:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.192964:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.192973:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.192978:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d7a1dab/0x3e357265691d1a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x312:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193004:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.193007:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497619.193008:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193017:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dcc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.193020:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193027:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193035:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193047:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf26d8c3/0x3e357265691d1a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x311:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.193059:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.193061:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.193063:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497619.193932:0:87362:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87362:1863837564947456:0@lo:5:osp-pre-0-0.0 00002000:00010000:3.0:1777497619.193946:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x310:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:1.0:1777497619.193959:0:87362:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x321:0x0] from OST, last_created [0x280000401:0x321:0x0]last_used is [0x280000401:0x302:0x0] 00010000:00010000:3.0:1777497619.194027:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194044:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194046:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194060:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194074:0:87362:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87362:1863837564947840:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497619.194075:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194088:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194118:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194149:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1777497619.194199:0:87362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1777497619.194213:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.194219:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194228:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194230:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194232:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194242:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194251:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194252:0:87362:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326240 going to sleep for 11 seconds 00010000:00010000:3.0:1777497619.194274:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194279:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564947712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777497619.194294:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1777497619.194315:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1777497619.194345:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.194352:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194361:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194363:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.194366:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194370:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947840 00010000:00010000:3.0:1777497619.194375:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194381:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947840 00010000:00010000:3.0:1777497619.194387:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194395:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194410:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777497619.194422:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497619.194427:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497619.194450:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5871 00010000:00010000:3.0:1777497619.194461:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd400 already unused, calling callback (ffffffffc0d802e0) 00000100:00100000:1.0:1777497619.194463:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:87362:x1863837564947840:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497619.194467:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194478:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194496:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194504:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001020e880/0x3e357265691d1ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x310:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1777497619.194523:0:25491:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 802 00010000:00010000:3.0:1777497619.194527:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.194531:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194537:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866ddc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.194540:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194548:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194558:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194574:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e7d5104/0x3e357265691d1b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194587:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.194590:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194596:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dca00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.194599:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194606:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194616:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.194623:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000033f96f5/0x3e357265691d1bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195199:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.195203:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.195211:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497619.195269:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.195276:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195284:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.195293:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.195296:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.195300:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195310:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195318:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195325:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195352:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497619.195374:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497619.195381:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195390:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dc200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497619.195394:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497619.195396:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.195406:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195407:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195427:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.195429:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.195442:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195443:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195465:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ca407a4/0x3e357265691d1c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195467:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.195482:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.195485:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.195487:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.195494:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195501:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195524:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497619.195564:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1777497619.195570:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.195570:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195581:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.195583:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dd000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497619.195589:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195596:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.195598:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.195599:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195602:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.195615:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.195618:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.195629:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004204827d/0x3e357265691d1ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.195642:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.195643:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497619.195645:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.196165:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.196172:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.196248:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196256:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497619.196271:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947712 00010000:00010000:3.0:1777497619.196280:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1777497619.196281:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947712 00000100:00100000:2.0:1777497619.196332:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00002000:00010000:3.0:1777497619.196340:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x30a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:2.0:1777497619.196345:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564947712:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1777497619.196347:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196359:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.196360:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.196362:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196369:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1777497619.196372:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16015168 pending 896 free 3922481152 avail 3690958848 00010000:00010000:3.0:1777497619.196374:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196382:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196393:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497619.196399:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.196402:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196406:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240866dde00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.196409:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196415:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196431:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196454:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f20a900/0x3e357265691d1d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196480:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1777497619.196480:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564947712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (2164us total) trans 0 rc 0/0 00010000:00010000:3.0:1777497619.196485:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497619.196492:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00010000:00010000:3.0:1777497619.196499:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.196503:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196510:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196522:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.196530:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037d7abe/0x3e357265691d1d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497619.196563:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497619.196920:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+6:87362:x1863837564947840:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2459us (2722us total) trans 4294969456 rc 0/0 00000100:00100000:1.0:1777497619.196929:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5871 00000100:00100000:1.0:1777497619.197009:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564947712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497619.197070:0:87362:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f81b4b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:87362:1863837564947840:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1777497619.197085:0:87362:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x321:0x0]-[0x280000401:0x341:0x0] 00010000:00010000:3.0:1777497619.198545:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.198551:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.198562:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1777497619.198571:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x309:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.198582:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198603:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198605:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198611:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198626:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198637:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198645:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198669:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1777497619.198707:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x308:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.198720:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198727:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198728:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198731:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198740:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198747:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198753:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198765:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1777497619.198799:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x307:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.198803:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198809:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198811:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198813:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198820:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198832:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198838:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198850:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777497619.198858:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497619.198867:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.198879:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.198885:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.198888:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x306:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.198897:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.198901:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198906:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198909:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.198913:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198922:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.198926:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198929:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.198944:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d972efc5/0x3e357265691d1df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x309:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198946:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.198961:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777497619.198982:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497619.198985:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.198993:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902bc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.198997:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199005:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.199015:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x305:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497619.199020:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199035:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497619.199037:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199037:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.199041:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199055:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2a068a8/0x3e357265691d1e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x308:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199059:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199072:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199074:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.199079:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199085:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199092:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ae00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.199120:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199130:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497619.199138:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199148:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199156:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003de919e1/0x3e357265691d1ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x307:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497619.199168:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x304:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497619.199171:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497619.199174:0:25488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199176:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199183:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.199186:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497619.199190:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199197:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.199203:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199204:0:25488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199216:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199233:0:25488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199235:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199252:0:25488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199254:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b82373f/0x3e357265691d1f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x306:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497619.199275:0:25488:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497619.199281:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497619.199285:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199292:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.199294:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1777497619.199306:0:25488:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00010000:00010000:3.0:1777497619.199308:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199319:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199332:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000263f223d/0x3e357265691d1fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x305:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199347:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497619.199350:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199357:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497619.199361:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199368:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199378:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199386:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000749df11a/0x3e357265691d202 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x304:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497619.199400:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.199403:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497619.199405:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497619.199408:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:87364:x1863837564947584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 45654us (46208us total) trans 0 rc 0/0 00010000:00010000:3.0:1777497619.199413:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497619.199422:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5870 00000100:00100000:0.0:1777497619.199644:0:87364:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87364:1863837564947584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1777497619.199661:0:87364:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x321:0x0] from OST, last_created [0x2c0000401:0x321:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:1.0:1777497619.199760:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497619.199770:0:87364:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87364:1863837564948096:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777497619.199772:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564947968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497619.199812:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.199812:0:87364:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497619.199833:0:87364:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750480 going to sleep for 11 seconds 00000100:00100000:0.0:1777497619.199853:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948096 00000100:00100000:0.0:1777497619.199860:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948096 00000100:00100000:0.0:1777497619.199907:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5872 00000100:00100000:0.0:1777497619.199916:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:87364:x1863837564948096:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1777497619.199949:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564947968 00002000:00080000:0.0:1777497619.199961:0:25489:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 802 00000100:00100000:3.0:1777497619.199968:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564947968 00000100:00100000:3.0:1777497619.200003:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1777497619.200240:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564947968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497619.200261:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8650560 pending 896 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497619.200311:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564947968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 301us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497619.200317:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1777497619.200364:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564947968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1777497619.201236:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497619.201554:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:87364:x1863837564948096:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1636us (1739us total) trans 4294969451 rc 0/0 00000100:00100000:0.0:1777497619.201563:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5872 00010000:00010000:0.0:1777497619.201591:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497619.201598:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497619.203411:0:87364:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:87364:1863837564948096:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1777497619.203441:0:87364:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x321:0x0]-[0x2c0000401:0x341:0x0] 00000001:02000400:0.0:1777497619.426677:0:87612:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000001:00100000:1.0:1777497619.500568:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1777497619.636460:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777497620.533927:0:87665:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497620.534185:0:87665:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497620.642406:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1777497621.611800:0:87715:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497621.612513:0:87715:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1777497621.668619:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497622.337335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497622.337671:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497622.337712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497622.337751:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497622.337793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497622.337826:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315264 00000100:00100000:3.0:1777497622.337836:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315264 00000100:00100000:3.0:1777497622.337893:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315136 00000100:00100000:3.0:1777497622.337896:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315136 00000100:00100000:3.0:1777497622.337922:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1254 00000100:00100000:3.0:1777497622.337931:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546315264:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497622.337953:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315008 00000100:00100000:1.0:1777497622.337957:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315008 00000100:00100000:1.0:1777497622.337985:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:1.0:1777497622.337991:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924085251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546315008:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497622.337998:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546315264:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 69us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497622.338004:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1254 00000100:00100000:1.0:1777497622.338014:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924085251450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546315008:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497622.338019:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 74 00000100:00100000:3.0:1777497622.338020:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1255 00000100:00100000:3.0:1777497622.338025:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546315136:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497622.338056:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546315136:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497622.338062:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1255 00000100:00080000:1.0:1777497622.338069:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497622.338072:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497622.338082:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315520 00000100:00100000:1.0:1777497622.338085:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315520 00000100:00100000:1.0:1777497622.338136:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315392 00000100:00100000:1.0:1777497622.338139:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315392 00000100:00100000:1.0:1777497622.338161:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2557 00000100:00100000:1.0:1777497622.338168:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546315520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497622.338204:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546315520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497622.338209:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2557 00000100:00100000:1.0:1777497622.338220:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2558 00000100:00100000:1.0:1777497622.338226:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546315392:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497622.338256:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546315392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497622.338261:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2558 00000100:00080000:1.0:1777497622.338291:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497622.338306:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497622.564483:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564948224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497622.564560:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497622.565286:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497622.565297:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564948352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497622.565329:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497622.565527:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948224 00000100:00100000:3.0:1777497622.565536:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948224 00000100:00100000:3.0:1777497622.565600:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948352 00000100:00100000:3.0:1777497622.565604:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948352 00000100:00100000:3.0:1777497622.565630:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1777497622.565640:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564948224:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497622.565648:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1777497622.565656:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564948352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497622.565669:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1777497622.565671:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:0.0:1777497622.565735:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497622.565739:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497622.565764:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564948224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (1203us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497622.565771:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1777497622.571540:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564948352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 5874us (6199us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497622.571557:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:0.0:1777497622.573452:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564948352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497622.573476:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564948224:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777497622.690266:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497623.516622:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497623.516742:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315648 00000100:00100000:0.0:1777497623.516766:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315648 00000100:00100000:0.0:1777497623.516836:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1289 00000100:00100000:0.0:1777497623.516845:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:69169:x1863837546315648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497623.516866:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497623.516889:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691d209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c233 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.516956:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.516970:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.516983:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497623.517033:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497623.517037:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497623.517073:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.517141:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691d209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 9 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.517159:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 8 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497623.517167:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:0.0:1777497623.517170:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497623.517173:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8400, rc 0) 00000100:00100000:0.0:1777497623.517249:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69169:x1863837546315648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 405us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497623.517257:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1289 00000100:00100000:1.0:1777497623.533242:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497623.533352:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315776 00000100:00100000:3.0:1777497623.533362:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315776 00000100:00100000:3.0:1777497623.533436:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1290 00000100:00100000:3.0:1777497623.533447:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69169:x1863837546315776:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497623.533490:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1777497623.533570:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69169:x1863837546315776:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 125us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497623.534064:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1290 00000100:00100000:2.0:1777497623.538218:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497623.538303:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546315904 00000100:00100000:3.0:1777497623.538314:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546315904 00000100:00100000:3.0:1777497623.538372:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1291 00000100:00100000:3.0:1777497623.538382:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69169:x1863837546315904:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497623.538445:0:73210:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497623.538523:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924098829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69169:x1863837546315904:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 142us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497623.538529:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1291 00000100:00100000:2.0:1777497623.544524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497623.544615:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316032 00000100:00100000:3.0:1777497623.544626:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316032 00000100:00100000:3.0:1777497623.544830:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2090 00000100:00100000:3.0:1777497623.544841:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69169:x1863837546316032:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497623.544874:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497623.544949:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69169:x1863837546316032:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 111us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497623.544956:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2090 00000100:00100000:1.0:1777497623.553180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497623.554201:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316160 00000100:00100000:2.0:1777497623.554216:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316160 00000100:00100000:2.0:1777497623.554280:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2091 00000100:00100000:2.0:1777497623.554290:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+7:69169:x1863837546316160:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497623.554330:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497623.554421:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+7:69169:x1863837546316160:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 133us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497623.554429:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2091 00010000:00010000:0.0:1777497623.714232:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497624.099092:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564948864:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099244:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099292:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564949376:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099320:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099336:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564949888:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099694:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099723:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777497624.099728:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564948736:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099748:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099764:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564949248:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099784:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099801:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564949760:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.099839:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497624.099881:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949376 00000100:00100000:3.0:1777497624.099891:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949376 00000100:00100000:3.0:1777497624.099958:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949888 00000100:00100000:3.0:1777497624.099962:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949888 00000100:00100000:3.0:1777497624.099987:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949248 00000100:00100000:3.0:1777497624.099990:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949248 00000100:00100000:3.0:1777497624.100009:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949760 00000100:00100000:3.0:1777497624.100012:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949760 00000100:00100000:3.0:1777497624.100036:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1777497624.100045:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564949376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.100119:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564949376:12345-0@lo:400:kworker.0 Request processed in 51us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497624.100127:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:3.0:1777497624.100149:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1777497624.100155:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564949888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.100182:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564949888:12345-0@lo:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497624.100187:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1777497624.100195:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1777497624.100199:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564949248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.100230:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564949248:12345-0@lo:400:kworker.0 Request processed in 30us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497624.100236:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:3.0:1777497624.100246:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1777497624.100252:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564949760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.100278:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564949760:12345-0@lo:400:kworker.0 Request processed in 26us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497624.100292:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:3.0:1777497624.100341:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948864 00000100:00100000:3.0:1777497624.100345:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948864 00000100:00100000:0.0:1777497624.100599:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564948608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100629:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100649:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564949120:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100670:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100682:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564949632:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100696:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100711:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1777497624.100715:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564948480:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100735:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100762:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564948992:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100782:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100799:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564949504:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100821:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100838:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564950016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.100856:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.100887:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949120 00000100:00100000:0.0:1777497624.100891:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949120 00000100:00100000:1.0:1777497624.101045:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948480 00000100:00100000:1.0:1777497624.101049:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948480 00000100:00100000:1.0:1777497624.101078:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1777497624.101084:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564948480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497624.101140:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564948480:12345-0@lo:400:kworker.0 Request processed in 57us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497624.101147:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1777497624.101180:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949632 00000100:00100000:1.0:1777497624.101183:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949632 00000100:00100000:1.0:1777497624.101217:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1777497624.101224:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564949632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497624.101259:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564949632:12345-0@lo:400:kworker.0 Request processed in 35us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497624.101265:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3958 00000100:00100000:1.0:1777497624.101308:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564948480:0@lo:400:kworker.0 00000100:00100000:1.0:1777497624.101320:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564949632:0@lo:400:kworker.0 00000100:00100000:1.0:1777497624.101347:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948736 00000100:00100000:1.0:1777497624.101350:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948736 00000100:00100000:1.0:1777497624.101398:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948608 00000100:00100000:1.0:1777497624.101402:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948608 00000100:00100000:3.0:1777497624.104522:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564948992 00000100:00100000:3.0:1777497624.104539:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564948992 00000100:00100000:3.0:1777497624.104563:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564949504 00000100:00100000:3.0:1777497624.104566:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564949504 00000100:00100000:0.0:1777497624.105705:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3959 00000100:00100000:0.0:1777497624.105727:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564949120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.105865:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564949120:12345-0@lo:400:kworker.0 Request processed in 144us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.105893:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3959 00000100:00100000:0.0:1777497624.105941:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950016 00000100:00100000:0.0:1777497624.105950:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950016 00000100:00100000:0.0:1777497624.105978:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1777497624.105986:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564948736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.106029:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564948736:12345-0@lo:400:kworker.0 Request processed in 44us (6279us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.106035:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:0.0:1777497624.106050:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1777497624.106056:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564948864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.106080:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564948864:12345-0@lo:400:kworker.0 Request processed in 25us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.106084:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1257 00000100:00100000:0.0:1777497624.106108:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1777497624.106116:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564948992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.106145:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564948992:12345-0@lo:400:kworker.0 Request processed in 31us (5362us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.106151:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:0.0:1777497624.106164:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1777497624.106170:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564950016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.106191:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564950016:12345-0@lo:400:kworker.0 Request processed in 23us (5334us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.106194:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:0.0:1777497624.107786:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564950144:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497624.107890:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497624.107976:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564948992:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.107994:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564950016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.108008:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564949120:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.108082:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950144 00000100:00100000:0.0:1777497624.108088:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950144 00000100:00100000:0.0:1777497624.108168:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1777497624.108178:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564950144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497624.109509:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497624.109613:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564950144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1434us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.109625:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3960 00000100:00100000:0.0:1777497624.109719:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564950144:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1777497624.109886:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497624.109894:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497624.109898:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497624.109901:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497624.109936:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564948736:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.109952:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564949248:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.109966:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564949760:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.109981:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564948864:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.109996:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564949376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497624.110011:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564949888:0@lo:400:kworker.0 00000100:00080000:1.0:1777497624.110276:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497624.110336:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1777497624.110350:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564948608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497624.110438:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564948608:12345-0@lo:400:kworker.0 Request processed in 93us (9807us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497624.110445:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:1.0:1777497624.110494:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564948608:0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.113112:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:3.0:1777497624.113131:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564949504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497624.114516:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564949504:12345-0@lo:400:kworker.0 Request processed in 1383us (13684us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497624.114531:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1777497624.114684:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564949504:0@lo:400:kworker.0 00000100:00100000:2.0:1777497624.611019:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564950272:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497624.611153:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497624.614508:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497624.614530:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497624.614610:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497624.614660:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950400 00000100:00100000:2.0:1777497624.614670:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950400 00000100:00100000:2.0:1777497624.614724:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1777497624.614734:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564950400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497624.614772:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497624.614824:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564950400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497624.614832:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1777497624.614904:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497624.616715:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497624.616738:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564950528:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497624.616809:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497624.617079:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950528 00000100:00100000:2.0:1777497624.617087:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950528 00000100:00100000:2.0:1777497624.617164:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:2.0:1777497624.617173:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564950528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497624.617206:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497624.617252:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564950528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497624.617272:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:2.0:1777497624.617445:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564950528:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1777497624.620290:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969456 is committed 00000100:00100000:0.0:1777497624.621088:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950272 00000100:00100000:0.0:1777497624.621118:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950272 00000100:00100000:0.0:1777497624.621196:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3961 00000100:00100000:0.0:1777497624.621206:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564950272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497624.621258:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1777497624.623759:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564950272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2540us (12592us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497624.623779:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3961 00000001:00080000:2.0:1777497624.624509:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969451 is committed 00000100:00100000:1.0:1777497624.629253:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564950272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1777497624.742711:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497625.762393:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497626.786417:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497627.240314:0:87812:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00000100:00100000:2.0:1777497627.461327:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497627.461380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497627.461416:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497627.461479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497627.461510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497627.461536:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316544 00000100:00100000:0.0:1777497627.461540:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316288 00000100:00100000:0.0:1777497627.461546:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316288 00000100:00100000:3.0:1777497627.461547:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316544 00000100:00100000:3.0:1777497627.461589:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316416 00000100:00100000:3.0:1777497627.461592:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316416 00000100:00100000:0.0:1777497627.461594:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:0.0:1777497627.461603:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546316288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497627.461610:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1262 00000100:00100000:3.0:1777497627.461616:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546316544:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497627.461669:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546316544:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 53us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497627.461676:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1262 00000100:00100000:3.0:1777497627.461694:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1263 00000100:00100000:3.0:1777497627.461700:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2412:x1863837546316416:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497627.464970:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546316288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 3355us (3638us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497627.464985:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:3.0:1777497627.465182:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2412:x1863837546316416:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 3479us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497627.465210:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1263 00000100:00080000:0.0:1777497627.465372:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497627.465378:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497627.465819:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316800 00000100:00100000:1.0:1777497627.465828:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316800 00000100:00100000:1.0:1777497627.465923:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316672 00000100:00100000:1.0:1777497627.465927:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316672 00000100:00100000:0.0:1777497627.466029:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2563 00000100:00100000:0.0:1777497627.466041:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546316800:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497627.466114:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546316800:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (4696us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497627.466121:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2563 00000100:00080000:2.0:1777497627.466252:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497627.466392:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2564 00000100:00100000:1.0:1777497627.466400:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546316672:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497627.466437:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546316672:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 39us (4926us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497627.466444:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2564 00000100:00080000:0.0:1777497627.466531:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497627.682454:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564950656:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497627.682535:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497627.682639:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950656 00000100:00100000:1.0:1777497627.682648:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950656 00000100:00100000:1.0:1777497627.682820:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:1.0:1777497627.682831:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564950656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497627.682870:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497627.682920:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564950656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497627.682928:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:3.0:1777497627.682960:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497627.682970:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564950784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497627.683001:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497627.683028:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950784 00000100:00100000:3.0:1777497627.683032:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950784 00000100:00100000:3.0:1777497627.683073:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1777497627.683079:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564950784:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497627.683110:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497627.683142:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564950784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497627.683148:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1777497627.683186:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564950784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497627.683538:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564950656:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1777497627.683668:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497627.683673:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497627.810277:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497628.834276:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497629.122805:0:87860:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00000100:00100000:0.0:1777497629.218486:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564950912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497629.218561:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.218646:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564950912 00000100:00100000:0.0:1777497629.218653:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564950912 00000100:00100000:0.0:1777497629.218709:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1777497629.218718:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564950912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497629.218764:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497629.218810:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564950912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497629.218815:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3962 00000100:00100000:0.0:1777497629.218844:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564951040:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.218872:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.218903:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564951552:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.218922:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.218936:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564952064:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.218955:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.218970:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1777497629.218974:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564951168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.218989:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.219001:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564951680:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.219016:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497629.219022:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951552 00000100:00100000:2.0:1777497629.219028:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951552 00000100:00100000:0.0:1777497629.219028:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564952192:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.219047:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.219069:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951040 00000100:00100000:0.0:1777497629.219072:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951040 00000100:00100000:2.0:1777497629.219080:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952064 00000100:00100000:2.0:1777497629.219085:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952064 00000100:00100000:0.0:1777497629.219125:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1777497629.219131:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564951040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497629.219136:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951168 00000100:00100000:2.0:1777497629.219140:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951168 00000100:00100000:2.0:1777497629.219168:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1777497629.219174:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837564951040:12345-0@lo:400:kworker.0 Request processed in 43us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497629.219180:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8c08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564951552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.219184:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1777497629.219212:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:0.0:1777497629.219219:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497629.219231:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8c08df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564951552:12345-0@lo:400:kworker.0 Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497629.219239:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1777497629.219247:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837564952064:12345-0@lo:400:kworker.0 Request processed in 29us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497629.219251:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1777497629.219453:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1777497629.219466:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564951168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497629.219500:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564951168:12345-0@lo:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497629.219505:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1777497629.219710:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951680 00000100:00100000:1.0:1777497629.219716:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951680 00000100:00100000:1.0:1777497629.219745:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1777497629.219751:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564951680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.219784:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564951680:12345-0@lo:400:kworker.0 Request processed in 33us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.219790:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3963 00000100:00100000:1.0:1777497629.219811:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564951424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.219837:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497629.219995:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564951296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497629.220132:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952192 00000100:00100000:3.0:1777497629.220138:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952192 00000100:00100000:3.0:1777497629.220170:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1777497629.220177:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564952192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497629.220210:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564952192:12345-0@lo:400:kworker.0 Request processed in 34us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497629.220216:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00080000:3.0:1777497629.220232:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497629.220238:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497629.220240:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497629.226823:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564951168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.226839:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564951680:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.226850:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 2 00000100:00100000:0.0:1777497629.226868:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564952192:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.226880:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564952064:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.226890:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564951552:0@lo:400:kworker.0 00000100:00100000:0.0:1777497629.226899:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564951040:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.232715:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951424 00000100:00100000:1.0:1777497629.232730:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951424 00000100:00100000:1.0:1777497629.232797:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1777497629.232806:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564951424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.232889:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564951424:12345-0@lo:400:kworker.0 Request processed in 84us (13050us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.232897:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1777497629.232925:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497629.232955:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564951808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.232988:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497629.233007:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564952320:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233026:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497629.233057:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951296 00000100:00100000:1.0:1777497629.233061:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951296 00000100:00100000:1.0:1777497629.233088:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1777497629.233111:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564951296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233145:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564951296:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.233160:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1777497629.233182:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951808 00000100:00100000:1.0:1777497629.233186:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951808 00000100:00100000:1.0:1777497629.233209:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952320 00000100:00100000:1.0:1777497629.233212:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952320 00000100:00100000:1.0:1777497629.233230:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1777497629.233236:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564951808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233265:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564951808:12345-0@lo:400:kworker.0 Request processed in 30us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.233271:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:1.0:1777497629.233282:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1777497629.233287:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564952320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233550:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564952320:12345-0@lo:400:kworker.0 Request processed in 261us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.233556:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000100:00100000:1.0:1777497629.233594:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564951296:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233604:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564951808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233612:0:3659:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 2 00000100:00100000:1.0:1777497629.233627:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564952320:0@lo:400:kworker.0 00000100:00080000:1.0:1777497629.233652:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497629.233655:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497629.233658:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497629.233660:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497629.233676:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564951424:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233683:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564951936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233725:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497629.233753:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564952448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233776:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497629.233797:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952448 00000100:00100000:1.0:1777497629.233801:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952448 00000100:00100000:3.0:1777497629.233811:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564951936 00000100:00100000:3.0:1777497629.233822:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564951936 00000100:00100000:1.0:1777497629.233830:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1269 00000100:00100000:1.0:1777497629.233837:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564952448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497629.233867:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1777497629.233878:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564951936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497629.233885:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564952448:12345-0@lo:400:kworker.0 Request processed in 35us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497629.233894:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1269 00000100:00100000:3.0:1777497629.233920:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564951936:12345-0@lo:400:kworker.0 Request processed in 44us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497629.233927:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:1.0:1777497629.233931:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564952448:0@lo:400:kworker.0 00000100:00080000:3.0:1777497629.233954:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497629.233954:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564950912:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497629.233981:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564951936:0@lo:400:kworker.0 00000100:00100000:2.0:1777497629.730403:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497629.730425:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497629.730490:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497629.730541:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952576 00000100:00100000:2.0:1777497629.730548:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952576 00000100:00100000:2.0:1777497629.730608:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:2.0:1777497629.730617:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564952576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497629.730644:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497629.730687:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564952576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497629.730693:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:2.0:1777497629.730752:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564952576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497629.731946:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497629.731993:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497629.732166:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564952832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497629.732196:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497629.732272:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952704 00000100:00100000:0.0:1777497629.732278:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952704 00000100:00100000:0.0:1777497629.732322:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1777497629.732330:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564952704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497629.732363:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497629.732407:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564952704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497629.732427:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:0.0:1777497629.732467:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564952704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497629.733341:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952832 00000100:00100000:2.0:1777497629.733348:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952832 00000100:00100000:2.0:1777497629.733397:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3964 00000100:00100000:2.0:1777497629.733405:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564952832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497629.733433:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497629.733490:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564952832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497629.733496:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3964 00000100:00100000:3.0:1777497629.733796:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564952832:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1777497629.859087:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497630.883341:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497631.002256:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.008642:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546316928 00000100:00100000:1.0:1777497631.008657:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546316928 00000100:00100000:1.0:1777497631.008820:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1292 00000100:00100000:1.0:1777497631.008833:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69616:x1863837546316928:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:1.0:1777497631.008877:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:1.0:1777497631.008972:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69616:x1863837546316928:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 142us (6725us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.008980:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1292 00000100:00080000:3.0:1777497631.013436:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497631.018563:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.023540:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317056 00000100:00100000:1.0:1777497631.023554:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317056 00000100:00100000:1.0:1777497631.023648:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1293 00000100:00100000:1.0:1777497631.023675:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69616:x1863837546317056:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:1.0:1777497631.023867:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497631.023957:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69616:x1863837546317056:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 287us (5403us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.023964:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1293 00000100:00080000:3.0:1777497631.023992:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497631.028824:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497631.029302:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317184 00000100:00100000:2.0:1777497631.029335:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317184 00000100:00100000:2.0:1777497631.029425:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2098 00000100:00100000:2.0:1777497631.029436:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69616:x1863837546317184:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497631.029464:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00080000:3.0:1777497631.029683:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497631.029859:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+6:69616:x1863837546317184:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 424us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497631.029866:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2098 00000100:00100000:2.0:1777497631.039262:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497631.039859:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317312 00000100:00100000:0.0:1777497631.039869:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317312 00000100:00100000:0.0:1777497631.039995:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2099 00000100:00100000:0.0:1777497631.040006:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+7:69616:x1863837546317312:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:0.0:1777497631.040032:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497631.040136:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6d03493e-1218-49f3-bdd0-b10716c402e0+7:69616:x1863837546317312:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 133us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497631.040143:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2099 00000100:00080000:3.0:1777497631.047896:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497631.100697:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.102542:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317568 00000100:00100000:1.0:1777497631.102558:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317568 00000100:00100000:1.0:1777497631.102636:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1294 00000100:00100000:1.0:1777497631.102648:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69633:x1863837546317568:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497631.102668:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497631.102688:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c23a expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102766:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102783:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102794:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102808:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102815:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102822:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102918:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102926:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102932:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102939:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102945:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.102949:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102956:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102968:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:1.0:1777497631.102971:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.102977:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102983:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735a00/0x3e357265691d21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.102996:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103003:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103016:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103021:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.103024:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103030:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103038:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240aeddf000) 00010000:00010000:1.0:1777497631.103040:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.103043:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103048:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734a00/0x3e357265691d225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103079:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d217 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c23a expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103090:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:1.0:1777497631.103165:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497631.103171:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c23a expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.103181:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734c00, rc 0) 00000100:00100000:1.0:1777497631.103249:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69633:x1863837546317568:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 604us (2577us total) trans 0 rc 301/301 00000100:00100000:1.0:1777497631.103266:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1294 00000100:00100000:3.0:1777497631.105589:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.106164:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317696 00000100:00100000:1.0:1777497631.106178:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317696 00000100:00100000:1.0:1777497631.106257:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1295 00000100:00100000:1.0:1777497631.106269:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69633:x1863837546317696:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:1.0:1777497631.107275:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107296:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107308:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107515:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107525:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107533:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107609:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107618:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107625:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497631.107690:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1777497631.107695:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497631.107709:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107725:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107730:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107736:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107742:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107748:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.107752:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107759:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107771:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:1.0:1777497631.107774:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.107778:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107784:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d22c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107808:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107815:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107820:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107826:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.107829:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107834:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107841:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240aeddfc00) 00010000:00010000:1.0:1777497631.107843:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.107846:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107851:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d233 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107867:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107873:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107878:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107889:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.107892:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107898:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107906:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:1.0:1777497631.107908:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.107912:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.107917:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d23a lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497631.109028:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69633:x1863837546317696:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 2753us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.109041:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1295 00000100:00100000:0.0:1777497631.154990:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.163484:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546317952 00000100:00100000:1.0:1777497631.163506:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546317952 00000100:00100000:1.0:1777497631.163601:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1296 00000100:00100000:1.0:1777497631.163614:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69637:x1863837546317952:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497631.164142:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497631.164176:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c241 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169899:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169925:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169938:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169961:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169969:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.169977:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170071:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170079:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170144:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170151:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170158:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497631.170162:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170170:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170181:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:2.0:1777497631.170184:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497631.170189:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170196:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170211:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170217:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170235:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170241:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497631.170249:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170256:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170264:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff924090680400) 00010000:00010000:2.0:1777497631.170267:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497631.170270:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170276:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d24f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170348:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d241 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c241 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170358:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:2.0:1777497631.170361:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777497631.170365:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691d241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c241 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.170374:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735c00, rc 0) 00000100:00100000:2.0:1777497631.170453:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69637:x1863837546317952:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 6841us (15478us total) trans 0 rc 301/301 00000100:00100000:2.0:1777497631.170462:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1296 00000100:00100000:0.0:1777497631.176238:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.176367:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318080 00000100:00100000:1.0:1777497631.176380:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318080 00000100:00100000:1.0:1777497631.176479:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1297 00000100:00100000:1.0:1777497631.176490:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69637:x1863837546318080:12345-192.168.202.4@tcp:34:lfs.0 00010000:00010000:1.0:1777497631.176592:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176613:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176627:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176646:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176653:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176660:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176748:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176757:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176764:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497631.176825:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00000004:00200000:1.0:1777497631.176830:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497631.176845:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176868:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176874:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176881:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176888:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176895:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.176899:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176907:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176920:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:1.0:1777497631.176923:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.176927:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176934:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176948:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176954:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176965:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176970:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.176973:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176979:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176986:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff9240aeddfc00) 00010000:00010000:1.0:1777497631.176988:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.176991:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.176996:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691d25d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177011:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177017:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 2/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177023:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177029:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497631.177031:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177047:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 4/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177054:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:1.0:1777497631.177056:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497631.177059:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 2/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497631.177064:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691d264 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497631.177207:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69637:x1863837546318080:12345-192.168.202.4@tcp:34:lfs.0 Request processed in 718us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.177216:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1297 00000100:00100000:0.0:1777497631.215526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497631.216152:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318336 00000100:00100000:2.0:1777497631.216169:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318336 00000100:00100000:2.0:1777497631.216254:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1298 00000100:00100000:2.0:1777497631.216265:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+8:69644:x1863837546318336:12345-192.168.202.4@tcp:101:md5sum.0 00010000:00010000:2.0:1777497631.216311:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497631.216341:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d26b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c248 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216430:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216448:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216460:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216476:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216483:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216490:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216602:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ae00/0x3e357265691d280 lrc: 3/1,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216609:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ae00/0x3e357265691d280 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216616:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ae00/0x3e357265691d280 lrc: 3/1,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497631.216626:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000a811:0x9:0x0]: returning size 1048576 00010000:00010000:2.0:1777497631.216730:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216737:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216743:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216749:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216755:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497631.216759:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216765:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216778:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:2.0:1777497631.216781:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497631.216786:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216792:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216807:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216812:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216817:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216827:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902bc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497631.216829:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216834:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216842:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xae972c0d (ffff924090680400) 00010000:00010000:2.0:1777497631.216844:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497631.216846:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216851:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691d279 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xae972c0d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216923:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a600/0x3e357265691d26b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c248 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216937:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ae00/0x3e357265691d280 lrc: 3/0,0 mode: PR/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c248 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497631.216944:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:2.0:1777497631.216947:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497631.216949:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ae00, rc 0) 00000100:00100000:2.0:1777497631.217032:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+10:69644:x1863837546318336:12345-192.168.202.4@tcp:101:md5sum.0 Request processed in 769us (1520us total) trans 111669149697 rc 0/0 00000100:00100000:2.0:1777497631.217040:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1298 00000100:00100000:2.0:1777497631.235556:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497631.235693:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318464 00000100:00100000:1.0:1777497631.235711:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318464 00002000:00100000:1.0:1777497631.235780:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9240b5bbdc00 x1863837546318464/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/0 e 0 to 0 dl 1777497642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497631.235792:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbdc00 with x1863837546318464 ext(0->32767) 00002000:00010000:1.0:1777497631.235799:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9240b5bbdc00 00000100:00100000:1.0:1777497631.235839:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1005 00000100:00100000:1.0:1777497631.235850:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546318464:12345-192.168.202.4@tcp:3:md5sum.0 00000100:00100000:1.0:1777497631.244847:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546318464:12345-192.168.202.4@tcp:3:md5sum.0 Request processed in 8984us (9286us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.244865:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1005 00002000:00100000:1.0:1777497631.244883:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x302:0x0] (0->32767) req@ffff9240b5bbdc00 x1863837546318464/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/440 e 0 to 0 dl 1777497642 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497631.244919:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbdc00 with x1863837546318464 ext(0->32767) 00002000:00010000:1.0:1777497631.244928:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9240b5bbdc00 00000100:00100000:0.0:1777497631.279805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497631.279853:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497631.279930:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318592 00000100:00100000:2.0:1777497631.279946:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318592 00002000:00100000:2.0:1777497631.280013:0:24168:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff923f8df2aa00 x1863837546318592/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/0 e 0 to 0 dl 1777497642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497631.280026:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f8df2aa00 with x1863837546318592 ext(32768->1048575) 00002000:00010000:2.0:1777497631.280033:0:24168:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f8df2aa00 00000100:00100000:2.0:1777497631.280074:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318720 00000100:00100000:2.0:1777497631.280077:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318720 00002000:00100000:2.0:1777497631.280092:0:24168:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff923f8df29180 x1863837546318720/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/0 e 0 to 0 dl 1777497642 ref 1 fl New:/600/ffffffff rc 0/-1 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497631.280141:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f8df29180 with x1863837546318720 ext(1048576->2097151) 00002000:00010000:2.0:1777497631.280145:0:24168:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f8df29180 00000100:00100000:2.0:1777497631.280164:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1006 00000100:00100000:2.0:1777497631.280174:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546318592:12345-192.168.202.4@tcp:3:md5sum.0 00000100:00100000:0.0:1777497631.280348:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1007 00000100:00100000:0.0:1777497631.280366:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546318720:12345-192.168.202.4@tcp:3:md5sum.0 00000100:00100000:1.0:1777497631.289338:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546318592:12345-192.168.202.4@tcp:3:md5sum.0 Request processed in 9140us (9517us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497631.289354:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1006 00002000:00100000:1.0:1777497631.289371:0:24168:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x302:0x0] (32768->1048575) req@ffff923f8df2aa00 x1863837546318592/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/440 e 0 to 0 dl 1777497642 ref 1 fl Complete:/600/0 rc 0/0 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497631.289383:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f8df2aa00 with x1863837546318592 ext(32768->1048575) 00002000:00010000:1.0:1777497631.289389:0:24168:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff923f8df2aa00 00000100:00100000:2.0:1777497631.322069:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546318720:12345-192.168.202.4@tcp:3:md5sum.0 Request processed in 41694us (42198us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1777497631.322084:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1007 00002000:00100000:2.0:1777497631.322143:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x302:0x0] (1048576->2097151) req@ffff923f8df29180 x1863837546318720/t0(0) o3->6d03493e-1218-49f3-bdd0-b10716c402e0@192.168.202.4@tcp:387/0 lens 488/440 e 0 to 0 dl 1777497642 ref 1 fl Complete:/600/0 rc 1048576/1048576 job:'md5sum.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497631.322155:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f8df29180 with x1863837546318720 ext(1048576->2097151) 00002000:00010000:2.0:1777497631.322162:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f8df29180 00000100:00100000:3.0:1777497631.339767:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497631.339910:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546318976 00000100:00100000:0.0:1777497631.339925:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546318976 00000100:00100000:0.0:1777497631.339992:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 232 00000100:00100000:0.0:1777497631.340003:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:69644:x1863837546318976:12345-192.168.202.4@tcp:35:md5sum.0 00000100:00100000:0.0:1777497631.340452:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+11:69644:x1863837546318976:12345-192.168.202.4@tcp:35:md5sum.0 Request processed in 449us (696us total) trans 111669149698 rc 0/0 00000100:00100000:0.0:1777497631.340477:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 232 00010000:00010000:2.0:1777497631.906412:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497632.578040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497632.578121:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497632.579518:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497632.579557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497632.579594:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497632.579627:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319488 00000100:00100000:0.0:1777497632.579636:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319488 00000100:00100000:0.0:1777497632.579680:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319616 00000100:00100000:0.0:1777497632.579683:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319616 00000100:00100000:0.0:1777497632.579703:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2569 00000100:00100000:1.0:1777497632.580301:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319104 00000100:00100000:1.0:1777497632.580317:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319104 00000100:00100000:1.0:1777497632.580357:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:1.0:1777497632.580365:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546319104:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497632.580533:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319232 00000100:00100000:3.0:1777497632.580539:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319232 00000100:00100000:3.0:1777497632.580571:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319360 00000100:00100000:3.0:1777497632.580574:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319360 00000100:00100000:3.0:1777497632.580596:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1270 00000100:00100000:3.0:1777497632.580602:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2413:x1863837546319232:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497632.580666:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546319488:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497632.581699:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+11:2413:x1863837546319232:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1092us (3665us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497632.581734:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1270 00000100:00100000:3.0:1777497632.581762:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1271 00000100:00100000:3.0:1777497632.581772:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546319360:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497632.581805:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546319360:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 36us (2248us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497632.581811:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1271 00000100:00100000:0.0:1777497632.582135:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2413:x1863837546319488:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2423us (4013us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497632.582145:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2569 00000100:00100000:0.0:1777497632.582163:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2570 00000100:00100000:0.0:1777497632.582171:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546319616:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497632.582197:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2413:x1863837546319616:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497632.582203:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2570 00000100:00100000:1.0:1777497632.589867:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2413:x1863837546319104:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 9491us (10343us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497632.589882:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:1.0:1777497632.805690:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497632.805712:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564952960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497632.805774:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497632.805821:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564952960 00000100:00100000:1.0:1777497632.805828:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564952960 00000100:00100000:1.0:1777497632.805885:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1777497632.805896:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564952960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497632.805925:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497632.805982:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc7e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564952960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497632.805989:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00080000:1.0:1777497632.806010:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497632.806046:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564952960:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497632.811055:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564953088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497632.811150:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497632.811222:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953088 00000100:00100000:2.0:1777497632.811230:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953088 00000100:00100000:2.0:1777497632.811297:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1777497632.811316:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564953088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497632.811346:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497632.811389:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564953088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497632.811396:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00080000:2.0:1777497632.811705:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497632.811745:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564953088:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1777497632.937288:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497633.955529:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497634.340780:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564953216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.340855:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.340895:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564953728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.340924:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.340945:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564954240:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.340972:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.340992:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564954752:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341015:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341045:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497634.341052:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564953600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341076:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341134:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564954112:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341162:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341185:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564954624:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341209:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341241:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564953344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341267:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341286:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8c08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564953856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341336:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341361:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564954368:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341384:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341405:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777497634.341411:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc7e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564953472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341434:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341453:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564953984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341473:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341489:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564954496:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341507:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.341540:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953216 00000100:00100000:1.0:1777497634.341547:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953216 00000100:00100000:1.0:1777497634.341593:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1777497634.341602:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564953216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341652:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bda1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564953216:12345-0@lo:400:kworker.0 Request processed in 52us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.341659:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1777497634.341691:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953728 00000100:00100000:1.0:1777497634.341694:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953728 00000100:00100000:1.0:1777497634.341723:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954240 00000100:00100000:1.0:1777497634.341726:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954240 00000100:00100000:1.0:1777497634.341741:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954752 00000100:00100000:1.0:1777497634.341743:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954752 00000100:00100000:1.0:1777497634.341752:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953600 00000100:00100000:1.0:1777497634.341755:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953600 00000100:00100000:1.0:1777497634.341765:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953344 00000100:00100000:1.0:1777497634.341767:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953344 00000100:00100000:1.0:1777497634.341777:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953472 00000100:00100000:1.0:1777497634.341780:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953472 00000100:00100000:1.0:1777497634.341792:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1777497634.341805:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564953728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341838:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564953728:12345-0@lo:400:kworker.0 Request processed in 34us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.341843:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1777497634.341856:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1777497634.341860:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564954240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341883:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837564954240:12345-0@lo:400:kworker.0 Request processed in 23us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.341888:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1273 00000100:00100000:1.0:1777497634.341901:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1777497634.341906:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564954752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341929:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564954752:12345-0@lo:400:kworker.0 Request processed in 24us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.341934:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:1.0:1777497634.341946:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1777497634.341951:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564953600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.341974:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564953600:12345-0@lo:400:kworker.0 Request processed in 23us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.341979:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:1.0:1777497634.341988:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1777497634.341994:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564953344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342024:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564953344:12345-0@lo:400:kworker.0 Request processed in 30us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342030:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1777497634.342041:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1777497634.342054:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564953472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342081:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564953472:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342087:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1277 00000100:00100000:1.0:1777497634.342172:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954112 00000100:00100000:1.0:1777497634.342175:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954112 00000100:00100000:1.0:1777497634.342201:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954624 00000100:00100000:1.0:1777497634.342203:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954624 00000100:00100000:1.0:1777497634.342220:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953984 00000100:00100000:1.0:1777497634.342222:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953984 00000100:00100000:1.0:1777497634.342241:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954496 00000100:00100000:1.0:1777497634.342243:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954496 00000100:00100000:1.0:1777497634.342260:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1777497634.342266:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564954112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342310:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564954112:12345-0@lo:400:kworker.0 Request processed in 44us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342316:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1777497634.342327:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1777497634.342334:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564954624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342359:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564954624:12345-0@lo:400:kworker.0 Request processed in 27us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342363:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1777497634.342375:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1777497634.342382:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564953984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342410:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564953984:12345-0@lo:400:kworker.0 Request processed in 30us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342415:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:1.0:1777497634.342433:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1777497634.342438:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564954496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342463:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564954496:12345-0@lo:400:kworker.0 Request processed in 25us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342467:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:1.0:1777497634.342494:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564953856 00000100:00100000:1.0:1777497634.342498:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564953856 00000100:00100000:1.0:1777497634.342525:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954368 00000100:00100000:1.0:1777497634.342528:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954368 00000100:00100000:1.0:1777497634.342556:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1777497634.342562:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564953856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342595:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564953856:12345-0@lo:400:kworker.0 Request processed in 33us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342601:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3965 00000100:00100000:1.0:1777497634.342613:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3966 00000100:00100000:1.0:1777497634.342619:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564954368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342645:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564954368:12345-0@lo:400:kworker.0 Request processed in 27us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342650:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3966 00000100:00080000:1.0:1777497634.342688:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497634.342692:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497634.342695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497634.342697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497634.342717:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497634.342728:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564954880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497634.342759:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497634.342786:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564954880 00000100:00100000:1.0:1777497634.342789:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564954880 00000100:00100000:1.0:1777497634.342819:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1777497634.342825:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564954880:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497634.342860:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497634.342894:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564954880:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497634.342900:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3967 00000100:00100000:1.0:1777497634.342945:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564954880:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497634.342979:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564953472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.342991:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564953984:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343000:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564954496:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343010:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564953344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343019:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8c08fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564953856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343028:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564954368:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343069:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564953600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343081:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564954112:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343091:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564954624:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343122:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564953216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343134:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc7eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564953728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343145:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837564954240:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.343156:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564954752:0@lo:400:kworker.0 00000100:00100000:1.0:1777497634.850417:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564955008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497634.850488:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497634.850570:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955008 00000100:00100000:3.0:1777497634.850578:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955008 00000100:00100000:3.0:1777497634.850632:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:3.0:1777497634.850641:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564955008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497634.850668:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497634.850834:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564955136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497634.850864:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497634.850889:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497634.850895:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564955264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497634.850916:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497634.850942:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955136 00000100:00100000:2.0:1777497634.850946:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955136 00000100:00100000:2.0:1777497634.850983:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3968 00000100:00100000:2.0:1777497634.850989:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564955136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497634.851011:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:2.0:1777497634.851045:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564955136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497634.851052:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3968 00000100:00100000:2.0:1777497634.851088:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955264 00000100:00100000:2.0:1777497634.851113:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955264 00000100:00100000:2.0:1777497634.851136:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1777497634.851156:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564955264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497634.851171:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497634.851198:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564955264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497634.851204:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1777497634.851247:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564955264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497634.851261:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564955136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497634.851759:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564955008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1118us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497634.851767:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1777497634.855139:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564955008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1777497634.978725:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497636.002366:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777497636.393534:0:87343:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149698 is committed 00010000:00010000:2.0:1777497637.026760:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497637.693377:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.693427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.693484:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.693510:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.693538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.693574:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319744 00000100:00100000:2.0:1777497637.693587:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319744 00000100:00100000:2.0:1777497637.693649:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1777497637.693661:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546319744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497637.693755:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb6e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:95f1b493-372d-4153-ad35-48e1115be1b1+9:2412:x1863837546319744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.693764:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1777497637.693827:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546319872 00000100:00100000:2.0:1777497637.693832:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546319872 00000100:00100000:2.0:1777497637.693876:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320000 00000100:00100000:2.0:1777497637.693879:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320000 00000100:00100000:2.0:1777497637.693905:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1278 00000100:00100000:2.0:1777497637.693923:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2412:x1863837546319872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497637.693957:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2412:x1863837546319872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.693964:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1278 00000100:00100000:2.0:1777497637.693978:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1279 00000100:00100000:2.0:1777497637.693984:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546320000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497637.694007:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546320000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.694013:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1279 00000100:00100000:2.0:1777497637.694034:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320128 00000100:00100000:2.0:1777497637.694052:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320128 00000100:00100000:2.0:1777497637.694080:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320256 00000100:00100000:2.0:1777497637.694083:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320256 00000100:00100000:2.0:1777497637.694138:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2575 00000100:00100000:2.0:1777497637.694145:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546320128:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497637.694173:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2412:x1863837546320128:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 29us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.694179:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2575 00000100:00100000:2.0:1777497637.694192:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2576 00000100:00100000:2.0:1777497637.694198:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546320256:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497637.694220:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2412:x1863837546320256:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.694226:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2576 00000100:00080000:2.0:1777497637.694390:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497637.694401:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497637.694404:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497637.694406:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1777497637.818255:0:88055:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 133: check resend of ongoing requests for lwp during failover ========================================================== 17:20:36 (1777497636) 00000100:00100000:3.0:1777497637.915394:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497637.915993:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320512 00000100:00100000:1.0:1777497637.916010:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320512 00000100:00100000:1.0:1777497637.916135:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1299 00000100:00100000:1.0:1777497637.916151:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+6:70224:x1863837546320512:12345-192.168.202.4@tcp:36:mkdir.0 00000100:00100000:1.0:1777497637.916350:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:63727:1863837564955392:0@lo:900:mdt00_000.0 00000100:00100000:1.0:1777497637.916423:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.916463:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085215840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497637.916488:0:63739:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955392 00000100:00100000:1.0:1777497637.916493:0:63739:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955392 00000100:00100000:1.0:1777497637.916521:0:63739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1777497637.916528:0:63739:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409101f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:63727:x1863837564955392:12345-0@lo:900:mdt00_000.0 00000100:00100000:1.0:1777497637.916586:0:63739:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409101f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:63727:x1863837564955392:12345-0@lo:900:mdt00_000.0 Request processed in 58us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497637.916595:0:63739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1777497637.916716:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID:63727:1863837564955392:0@lo:900:mdt00_000.0 00000100:00100000:1.0:1777497637.916787:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.916825:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.916843:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f841e5000 going to sleep for 11 seconds 00000100:00100000:1.0:1777497637.916861:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955520 00000100:00100000:1.0:1777497637.916865:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955520 00000100:00100000:1.0:1777497637.916896:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1777497637.916903:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955520:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.916997:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955520:12345-0@lo:1000:mdt00_000.0 Request processed in 94us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497637.917005:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3969 00000100:00100000:1.0:1777497637.917035:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955520:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917125:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917151:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.917168:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497637.917182:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955648 00000100:00100000:1.0:1777497637.917186:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955648 00000100:00100000:1.0:1777497637.917211:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1777497637.917218:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955648:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917298:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955648:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497637.917304:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3970 00000100:00100000:1.0:1777497637.917336:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955648:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917375:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917396:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.917410:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497637.917420:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955776 00000100:00100000:1.0:1777497637.917424:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955776 00000100:00100000:1.0:1777497637.917443:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3971 00000100:00100000:1.0:1777497637.917448:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497637.917525:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955776:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (127us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497637.917532:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3971 00000100:00100000:1.0:1777497637.917567:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955776:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1777497637.917644:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917656:0:63727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917668:0:63727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497637.917680:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955904:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1777497637.917703:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.917717:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240885c3780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497637.917728:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564955904 00000100:00100000:1.0:1777497637.917731:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564955904 00000100:00100000:1.0:1777497637.917750:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3972 00000100:00100000:1.0:1777497637.917755:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:63727:x1863837564955904:12345-0@lo:101:mdt00_000.0 00010000:00010000:1.0:1777497637.917765:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497637.917783:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d28e expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917811:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 8 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917822:0:8406:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917851:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 8 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.917877:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 8 pid: 64885 timeout: 3867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497637.917890:0:8406:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8406:1863837564956032:192.168.202.4@tcp:104: 00000100:00100000:1.0:1777497637.917964:0:8406:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497637.921610:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497637.921702:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320640 00000100:00100000:3.0:1777497637.921714:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320640 00010000:00010000:3.0:1777497637.921770:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 9 pid: 64885 timeout: 3867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497637.921824:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2542 00000100:00100000:3.0:1777497637.921837:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:2415:x1863837546320640:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497637.921857:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497637.921866:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 9 pid: 64885 timeout: 3867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.921891:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 9 pid: 64885 timeout: 3867 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.921929:0:19127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:3.0:1777497637.921937:0:19127:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.921951:0:19127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.921962:0:19127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922002:0:19127:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497637.922019:0:19127:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19127:1863837564956160:0@lo:105: 00000100:00100000:3.0:1777497637.922126:0:19127:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.922176:0:19127:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.922211:0:13186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777497637.922223:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956160 00000100:00100000:3.0:1777497637.922227:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956160 00000100:00100000:3.0:1777497637.922270:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1777497637.922278:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19127:x1863837564956160:12345-0@lo:105: 00010000:00010000:3.0:1777497637.922290:0:13186:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922313:0:13186:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922323:0:13186:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922331:0:13186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922337:0:13186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922346:0:13186:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922361:0:13186:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff923f89735600) 00000100:00100000:3.0:1777497637.922404:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:19127:x1863837564956160:12345-0@lo:105: Request processed in 127us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.922411:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:3.0:1777497637.922506:0:8406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691d210 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c233 expref: 9 pid: 64885 timeout: 3867 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497637.922524:0:8406:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbc000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8406:1863837564956032:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497637.922558:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 7 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.922579:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:3.0:1777497637.922582:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497637.922585:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734000, rc 0) 00000100:00100000:3.0:1777497637.922627:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63727:x1863837564955904:12345-0@lo:101:mdt00_000.0 Request processed in 4872us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.922635:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3972 00000100:00100000:3.0:1777497637.922668:0:19127:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-MDT0000_UUID:19127:1863837564956160:0@lo:105: 00010000:00010000:3.0:1777497637.922678:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497637.922723:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2415:x1863837546320640:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 889us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.922731:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2542 00000100:00100000:3.0:1777497637.922891:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564955904:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1777497637.922908:0:63727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497637.922932:0:63727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777497637.922978:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923051:0:63727:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923063:0:63727:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497637.923081:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956288:0@lo:101:mdt00_000.0 00000100:00100000:3.0:1777497637.923152:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.923175:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.923191:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956288 00000100:00100000:3.0:1777497637.923196:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956288 00000100:00100000:3.0:1777497637.923230:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1777497637.923238:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63727:x1863837564956288:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1777497637.923273:0:80394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497637.923291:0:80394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d29c expref: -99 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923316:0:80394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d29c expref: 8 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923330:0:80394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d29c expref: 8 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923336:0:80394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9240c216f800) 00010000:00010000:3.0:1777497637.923339:0:80394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497637.923341:0:80394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39200, rc 0) 00000100:00100000:3.0:1777497637.923371:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956288:12345-0@lo:101:mdt00_000.0 Request processed in 134us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.923377:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3973 00000100:00100000:3.0:1777497637.923408:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956288:0@lo:101:mdt00_000.0 00010000:00010000:3.0:1777497637.923418:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.923427:0:63727:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497637.923449:0:63727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:3.0:1777497637.923489:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.923517:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.923534:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.923549:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956416 00000100:00100000:3.0:1777497637.923553:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956416 00000100:00100000:3.0:1777497637.923576:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3974 00000100:00100000:3.0:1777497637.923583:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956416:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.923659:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956416:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.923667:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3974 00000100:00100000:3.0:1777497637.923695:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956416:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.923736:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.923757:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.923771:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.923783:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956544 00000100:00100000:3.0:1777497637.923786:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956544 00000100:00100000:3.0:1777497637.923806:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1777497637.923812:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956544:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.923898:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956544:12345-0@lo:1000:mdt00_000.0 Request processed in 86us (139us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497637.923904:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3975 00000100:00100000:3.0:1777497637.923930:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956544:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924018:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956672:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924053:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.924067:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.924077:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956672 00000100:00100000:3.0:1777497637.924081:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956672 00000100:00100000:3.0:1777497637.924131:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1777497637.924137:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956672:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924191:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956672:12345-0@lo:1000:mdt00_000.0 Request processed in 54us (136us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497637.924197:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3976 00000100:00100000:3.0:1777497637.924222:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956672:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924288:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956800:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924310:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.924323:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.924333:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956800 00000100:00100000:3.0:1777497637.924336:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956800 00000100:00100000:3.0:1777497637.924355:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1777497637.924360:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956800:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924422:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956800:12345-0@lo:1000:mdt00_000.0 Request processed in 61us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.924429:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3977 00000100:00100000:3.0:1777497637.924454:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956800:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924501:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956928:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924524:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.924538:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a000 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.924548:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564956928 00000100:00100000:3.0:1777497637.924557:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564956928 00000100:00100000:3.0:1777497637.924579:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1777497637.924585:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956928:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1777497637.924632:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63727:x1863837564956928:12345-0@lo:1000:mdt00_000.0 Request processed in 47us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.924638:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3978 00000100:00100000:3.0:1777497637.924662:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:63727:1863837564956928:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1777497637.926267:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497637.926288:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564957056:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497637.926352:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497637.926398:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957056 00000100:00100000:2.0:1777497637.926405:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957056 00000100:00100000:2.0:1777497637.926467:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:2.0:1777497637.926476:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564957056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497637.926509:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 16014272 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497637.926555:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564957056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.926561:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00080000:2.0:1777497637.926602:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497637.926642:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564957056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497637.926835:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497637.926846:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564957184:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497637.926881:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497637.926951:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957184 00000100:00100000:2.0:1777497637.926956:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957184 00000100:00100000:2.0:1777497637.927002:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1777497637.927009:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564957184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497637.927028:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497637.927062:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564957184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.927068:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1777497637.927291:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564957184:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497637.927310:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1777497637.928380:0:63727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].2, 1000 off35920 00000040:00080000:3.0:1777497637.928509:0:63727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].2, 1152 off36272 00000004:00080000:3.0:1777497637.928517:0:63727:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff923f84e4a0c0 with version 9 00000004:00080000:2.0:1777497637.931292:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 9 rpc_version 9 00000020:00100000:2.0:1777497637.931370:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777497637.931386:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9240b5bbed80 x1863837564957440/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2440/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497637.931421:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564957440:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497637.931514:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497637.931549:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f853263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.931647:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957440 00000100:00100000:3.0:1777497637.931656:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957440 00000100:00100000:3.0:1777497637.931717:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3979 00000100:00100000:3.0:1777497637.931728:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72705:x1863837564957440:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777497637.939919:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72705:x1863837564957440:12345-0@lo:1000:osp_up0-1.0 Request processed in 8183us (8395us total) trans 111669149699 rc 0/0 00000100:00100000:1.0:1777497637.939936:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3979 00000100:00100000:2.0:1777497637.946537:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564957440:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1777497637.946916:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.946940:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.946958:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497637.946982:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004ea1055d reply state 00000000dba64874 transno 81604378735 ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.946996:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.947004:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:3.0:1777497637.947015:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497637.947020:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777497637.947029:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00080000:3.0:1777497637.947044:0:63727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777497637.947057:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.947066:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.947074:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.947170:0:63727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1777497637.947177:0:63727:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777497637.947183:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947185:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497637.947191:0:63727:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947192:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947201:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:2.0:1777497637.947207:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497637.947215:0:6502:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947269:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947276:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497637.947313:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947320:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f89735600/0x3e357265691d28e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d295 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.947350:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497637.947352:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497637.947353:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497637.947355:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:70224:x1863837546320512:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 31206us (31974us total) trans 81604378735 rc 0/0 00000100:00100000:2.0:1777497637.947364:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497637.947365:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1299 00000100:00100000:2.0:1777497637.947387:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564957568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497637.947457:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497637.948434:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957568 00000100:00100000:3.0:1777497637.948446:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957568 00000100:00100000:3.0:1777497637.948549:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:3.0:1777497637.948559:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3658:x1863837564957568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497637.948578:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497637.948620:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691d295 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d28e expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.948639:0:25500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409c15e400) 00010000:00010000:3.0:1777497637.948650:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497637.948707:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+8:3658:x1863837564957568:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.948714:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1777497637.948837:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564957568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497637.959241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497637.959473:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320768 00000100:00100000:1.0:1777497637.959487:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320768 00000100:00100000:1.0:1777497637.959581:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1300 00000100:00100000:1.0:1777497637.959593:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+8:70225:x1863837546320768:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497637.959624:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497637.959657:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691d2b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c24f expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959753:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959771:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959800:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497637.959857:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1777497637.959862:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497637.959886:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959915:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691d2b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c24f expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959937:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c24f expref: 9 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.959947:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240aeddf000) 00010000:00010000:1.0:1777497637.959950:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497637.959954:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734600, rc 0) 00000100:00100000:1.0:1777497637.960041:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546320768:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 449us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497637.960048:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1300 00000100:00100000:1.0:1777497637.962516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497637.962860:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546320896 00000100:00100000:2.0:1777497637.962874:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546320896 00000100:00100000:2.0:1777497637.962977:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1301 00000100:00100000:2.0:1777497637.962989:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546320896:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497637.963016:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497637.963043:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691d2bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c256 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963146:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963164:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963177:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963189:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963226:0:65418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d29c expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963234:0:65418:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.963288:0:65418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d29c expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497637.963306:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837564957696:0@lo:104: 00000100:00100000:2.0:1777497637.963384:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497637.965715:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f853263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497637.966035:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957696 00000100:00100000:3.0:1777497637.966047:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957696 00000100:00100000:3.0:1777497637.966140:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1777497637.966152:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65418:x1863837564957696:12345-0@lo:104: 00010000:00010000:3.0:1777497637.966173:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966394:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777497637.966401:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65418:x1863837564957696:12345-0@lo:104: Request processed in 253us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497637.966410:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:3.0:1777497637.966436:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497637.966443:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966453:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39000 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:3.0:1777497637.966460:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497637.966471:0:16604:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966531:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966540:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497637.966566:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 1/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966575:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d39000/0x3e357265691d29c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691d2a3 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497637.966596:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497637.966598:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497637.966599:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497637.967349:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497637.967372:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564957824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497637.967436:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.967486:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957824 00000100:00100000:1.0:1777497637.967491:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957824 00010000:00010000:1.0:1777497637.967521:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x3e357265691d29c expref: 8 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497637.967566:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1777497637.967575:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+8:3657:x1863837564957824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497637.967590:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1777497637.968039:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837564957696:0@lo:104: 00010000:00010000:1.0:1777497637.968070:0:65418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497637.970450:0:87343:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149699 is committed 00010000:00010000:1.0:1777497637.970580:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39200/0x3e357265691d2a3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d29c expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.970607:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9240c216f800) 00010000:00010000:1.0:1777497637.970613:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.970625:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.970635:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.970672:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497637.970779:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564957824:12345-0@lo:103:ldlm_bl.0 Request processed in 3204us (3341us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497637.970792:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1777497637.970918:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564957824:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497637.970955:0:65418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497637.970981:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497637.971180:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837564957952:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497637.972775:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497637.974065:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f861ed780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497637.983792:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564957952 00000100:00100000:2.0:1777497637.983809:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564957952 00000100:00100000:2.0:1777497637.983898:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1777497637.983911:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837564957952:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497637.984088:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837564957952:12345-0@lo:1000:mdt00_004.0 Request processed in 179us (11318us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.984117:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3980 00000100:00100000:2.0:1777497637.984223:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837564957952:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1777497637.984324:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984347:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984361:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497637.984406:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984426:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984433:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984440:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984447:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984454:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497637.984459:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984467:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984481:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240aeddf000) 00010000:00010000:2.0:1777497637.984484:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497637.984490:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984498:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691d2c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984513:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984526:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984532:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984537:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497637.984540:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984546:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984556:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9240c216f800) 00010000:00010000:2.0:1777497637.984559:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497637.984562:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984567:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691d2cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984616:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691d2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c256 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984632:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c256 expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497637.984641:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff924090680200) 00010000:00010000:2.0:1777497637.984644:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777497637.984652:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b200, rc 0) 00000100:00100000:2.0:1777497637.984711:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+10:70225:x1863837546320896:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 21725us (22209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497637.984719:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1301 00000100:00100000:0.0:1777497638.003061:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.003132:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321024 00000100:00100000:0.0:1777497638.003146:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321024 00000100:00100000:0.0:1777497638.003228:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1302 00000100:00100000:0.0:1777497638.003248:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+8:70225:x1863837546321024:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497638.003293:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497638.003321:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d2db lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c25d expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.003406:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d2e2 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.003425:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d2e2 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.003439:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d2e2 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497638.003509:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1777497638.003514:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1777497638.003561:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d2db lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c25d expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.003580:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d2e2 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c25d expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.003590:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:0.0:1777497638.003593:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1777497638.003597:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8600, rc 0) 00000100:00100000:0.0:1777497638.003671:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321024:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 426us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497638.003678:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1302 00000100:00100000:0.0:1777497638.011719:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.012380:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321152 00000100:00100000:1.0:1777497638.012396:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321152 00000100:00100000:1.0:1777497638.012475:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1303 00000100:00100000:1.0:1777497638.012487:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321152:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497638.012518:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497638.012546:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d2e9 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c264 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012655:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012673:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012687:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012705:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012712:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012733:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012795:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012803:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012811:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012818:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012825:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497638.012829:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012838:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012851:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:1.0:1777497638.012855:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497638.012860:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012867:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d2f0 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012885:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012898:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012904:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012909:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497638.012912:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012918:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012927:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff92409f6ded00) 00010000:00010000:1.0:1777497638.012930:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497638.012932:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012938:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d2f7 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012981:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d2e9 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c264 expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.012992:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:1.0:1777497638.012995:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497638.012998:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d2e9 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c264 expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.013008:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735000, rc 0) 00000100:00100000:1.0:1777497638.013125:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321152:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 640us (1419us total) trans 0 rc 301/301 00000100:00100000:1.0:1777497638.013133:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1303 00000100:00100000:0.0:1777497638.016639:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.016681:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321280 00000100:00100000:0.0:1777497638.016695:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321280 00000100:00100000:0.0:1777497638.016763:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1304 00000100:00100000:0.0:1777497638.016788:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321280:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497638.016821:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497638.016852:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9c00/0x3e357265691d2fe lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c26b expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.016949:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.016966:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.016980:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.016997:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.017005:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.017012:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.017066:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.017073:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018520:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018530:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018537:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497638.018543:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018552:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018568:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:0.0:1777497638.018571:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497638.018576:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018583:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d305 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018602:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018608:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018613:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018618:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497638.018631:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018637:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018644:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9240b565d600) 00010000:00010000:0.0:1777497638.018647:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497638.018649:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018655:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d30c lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018718:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9c00/0x3e357265691d2fe lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c26b expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018730:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:0.0:1777497638.018732:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497638.018735:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9c00/0x3e357265691d2fe lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c26b expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.018745:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9c00, rc 0) 00000100:00100000:0.0:1777497638.021503:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321280:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 4719us (4868us total) trans 0 rc 301/301 00000100:00100000:0.0:1777497638.021517:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1304 00000100:00100000:0.0:1777497638.033567:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.033612:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321408 00000100:00100000:0.0:1777497638.033626:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321408 00000100:00100000:0.0:1777497638.033696:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1305 00000100:00100000:0.0:1777497638.033716:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+9:70225:x1863837546321408:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497638.033745:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497638.033956:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c272 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034060:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034080:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034112:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497638.034169:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1777497638.034174:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497638.034198:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034394:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c272 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034420:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c272 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.034432:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:0.0:1777497638.034436:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1777497638.034441:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9800, rc 0) 00000100:00100000:0.0:1777497638.034539:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:70225:x1863837546321408:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 824us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497638.034559:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1305 00000100:00100000:0.0:1777497638.045033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.048184:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321664 00000100:00100000:0.0:1777497638.048207:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321664 00000100:00100000:0.0:1777497638.048303:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1306 00000100:00100000:0.0:1777497638.048315:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+10:70225:x1863837546321664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:0.0:1777497638.048341:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497638.048369:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d321 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c279 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497638.048509:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1777497638.048650:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d321 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c279 expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.048667:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240b565d300) 00010000:00010000:0.0:1777497638.048670:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497638.048676:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d321 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c279 expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.048696:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00000100:00100000:0.0:1777497638.050697:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d03493e-1218-49f3-bdd0-b10716c402e0+11:70225:x1863837546321664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2367us (5660us total) trans 81604378736 rc 301/301 00000100:00100000:0.0:1777497638.050711:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1306 00010000:00010000:1.0:1777497638.051004:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497638.059472:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.059616:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546321920 00000100:00100000:1.0:1777497638.059630:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546321920 00000100:00100000:1.0:1777497638.059781:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1307 00000100:00100000:1.0:1777497638.059884:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+11:70225:x1863837546321920:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:1.0:1777497638.060953:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497638.061010:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9800/0x3e357265691d31a lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c272 expref: 11 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.061040:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:1.0:1777497638.061047:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497638.061965:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.061990:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.062004:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.062023:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.062030:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.062037:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.063000:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.063016:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.063024:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497638.063043:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001b96107e reply state 00000000b8b25751 transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.063056:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.063063:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff92409f6de000) 00010000:00010000:1.0:1777497638.063066:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497638.063072:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1777497638.065360:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1777497638.065396:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065408:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065416:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065424:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065431:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497638.065459:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065468:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065487:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:1.0:1777497638.065491:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497638.065495:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065502:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735000/0x3e357265691d32f lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497638.065525:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001b96107e reply state 00000000b8b25751 transno 81604378737 ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065539:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.065548:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff92409f6ded00) 00010000:00010000:1.0:1777497638.065550:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497638.065554:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1777497638.066368:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6d03493e-1218-49f3-bdd0-b10716c402e0+12:70225:x1863837546321920:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 6477us (6902us total) trans 81604378737 rc 0/0 00000100:00100000:1.0:1777497638.066381:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1307 00000100:00100000:2.0:1777497638.074538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.074605:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546322176 00000100:00100000:0.0:1777497638.074618:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546322176 00000100:00100000:0.0:1777497638.074751:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00100000:0.0:1777497638.074782:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+12:70225:x1863837546322176:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1777497638.075141:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+13:70225:x1863837546322176:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 361us (612us total) trans 81604378738 rc 0/0 00000100:00100000:0.0:1777497638.075150:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 233 00000100:00100000:0.0:1777497638.132504:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.132580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.132717:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546322304 00000100:00100000:1.0:1777497638.132732:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546322304 00000100:00100000:1.0:1777497638.132873:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546322432 00000100:00100000:1.0:1777497638.132877:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546322432 00000100:00100000:3.0:1777497638.134933:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.149198:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546322560 00000100:00100000:1.0:1777497638.149219:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546322560 00000100:00100000:1.0:1777497638.149388:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 710 00000100:00100000:1.0:1777497638.149401:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95f1b493-372d-4153-ad35-48e1115be1b1+11:2414:x1863837546322304:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497638.149424:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777497638.149444:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 711 00010000:00010000:1.0:1777497638.149452:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff200/0x3e357265691cf31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c21e expref: 11 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497638.149460:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f1b493-372d-4153-ad35-48e1115be1b1+11:2414:x1863837546322432:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497638.149473:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497638.149482:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497638.149487:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd200/0x3e357265691cf2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c217 expref: 10 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497638.149501:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497638.149582:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f1b493-372d-4153-ad35-48e1115be1b1+9:2414:x1863837546322432:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 128us (17001us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497638.149598:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 711 00000100:00100000:3.0:1777497638.149627:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 712 00000100:00100000:3.0:1777497638.149634:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f1b493-372d-4153-ad35-48e1115be1b1+8:2412:x1863837546322560:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497638.149648:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497638.149657:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dc600/0x3e357265691cf38 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c225 expref: 8 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497638.149668:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497638.153046:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:95f1b493-372d-4153-ad35-48e1115be1b1+7:2414:x1863837546322304:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3630us (20540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497638.153062:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 710 00000100:00100000:3.0:1777497638.158296:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:95f1b493-372d-4153-ad35-48e1115be1b1+6:2412:x1863837546322560:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 8643us (23357us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497638.158316:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 712 00000100:00100000:1.0:1777497638.158340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.158389:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546322944 00000100:00100000:1.0:1777497638.158402:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546322944 00000100:00100000:1.0:1777497638.158467:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5873 00000100:00100000:1.0:1777497638.158477:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+7:2411:x1863837546322944:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:1.0:1777497638.158517:0:25499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cc1a 00000020:00010000:1.0:1777497638.158527:0:25499:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240b521c000: total 0 00000100:00080000:1.0:1777497638.158533:0:25499:0:(import.c:65:import_set_state_nolock()) ffff9240b521c800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497638.158593:0:25499:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969451 00000020:00010000:0.0:1777497638.158597:0:8412:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240b521c000: total 0 00010000:00010000:0.0:1777497638.158660:0:8412:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240b521c000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1777497638.158735:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004aa24b7/0x3e357265691cd5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1ed expref: 6 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.159038:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c829b178/0x3e357265691cd6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x303:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1fb expref: 5 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.159054:0:8412:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240b521c000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1777497638.159159:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497638.159162:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497638.159164:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497638.159928:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:6d03493e-1218-49f3-bdd0-b10716c402e0+2:2411:x1863837546322944:12345-192.168.202.4@tcp:9:umount.0 Request processed in 1448us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497638.159939:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5873 00000100:00100000:3.0:1777497638.167482:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.167791:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546323200 00000100:00100000:0.0:1777497638.167807:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546323200 00000100:00100000:0.0:1777497638.167887:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5874 00000100:00100000:0.0:1777497638.167899:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+6:2411:x1863837546323200:12345-192.168.202.4@tcp:9:umount.0 00000020:00000080:0.0:1777497638.167944:0:25494:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cc13 00000020:00010000:0.0:1777497638.167956:0:25494:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f826cb800: total 0 00000100:00080000:0.0:1777497638.167963:0:25494:0:(import.c:65:import_set_state_nolock()) ffff92408a0a7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777497638.168038:0:25494:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:0.0:1777497638.168317:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:6d03493e-1218-49f3-bdd0-b10716c402e0+4:2411:x1863837546323200:12345-192.168.202.4@tcp:9:umount.0 Request processed in 420us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497638.168345:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5874 00000020:00010000:2.0:1777497638.168739:0:83956:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f826cb800: total 0 00010000:00010000:2.0:1777497638.168745:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497638.168799:0:83956:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f826cb800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1777497638.168839:0:83956:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb size from disk: 1048576 -> 2097152 00002000:00010000:2.0:1777497638.168844:0:83956:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb atime from disk: 0 -> 1777497581 00002000:00010000:2.0:1777497638.168848:0:83956:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x302:0x0] updating lvb blocks from disk: 0 -> 2048 00010000:00010000:2.0:1777497638.168883:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691cd63 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x302:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1f4 expref: 3 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497638.168916:0:83956:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f826cb800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1777497638.168929:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497638.168931:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497638.168932:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497638.192872:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497638.193137:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546323712 00000100:00100000:0.0:1777497638.193153:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546323712 00000100:00100000:0.0:1777497638.193242:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1308 00000100:00100000:0.0:1777497638.193264:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546323712:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:0.0:1777497638.193328:0:63727:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce74 00000020:00010000:0.0:1777497638.193350:0:63727:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240bb685000: total 0 00000100:00080000:0.0:1777497638.193355:0:63727:0:(import.c:65:import_set_state_nolock()) ffff9240aef6d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1777497638.193385:0:63727:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 26, last_transno is 111669149699 00000100:00100000:0.0:1777497638.193606:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d03493e-1218-49f3-bdd0-b10716c402e0+8:2411:x1863837546323712:12345-192.168.202.4@tcp:39:umount.0 Request processed in 354us (748us total) trans 111669149700 rc 0/0 00000100:00100000:0.0:1777497638.193615:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1308 00000020:00010000:1.0:1777497638.194133:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240bb685000: total 0 00010000:00010000:1.0:1777497638.194228:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240bb685000, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1777497638.194281:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:1.0:1777497638.194285:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497638.194298:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ae00/0x3e357265691d280 lrc: 0/0,0 mode: --/PR res: [0x20000a811:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c248 expref: 7 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.194339:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff924090680200) 00010000:00010000:1.0:1777497638.194342:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497638.194347:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d2d4 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c256 expref: 6 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.194386:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000a811:0x9:0x0].0x0 (ffff92409c15e800) 00010000:00010000:1.0:1777497638.194389:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1777497638.194392:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691d057 lrc: 0/0,0 mode: --/CR res: [0x20000a811:0x9:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c1e6 expref: 5 pid: 87376 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.194409:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240aeddf000) 00010000:00010000:1.0:1777497638.194411:0:6502:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497638.194415:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691d2b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c24f expref: 4 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.194430:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240bb685000, canceled 4 locks, left on hash table 0. 00010000:00010000:1.0:1777497638.194446:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497638.194448:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497638.194450:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497638.210166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497638.210620:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546323968 00000100:00100000:2.0:1777497638.210634:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546323968 00000100:00100000:2.0:1777497638.210725:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1309 00000100:00100000:2.0:1777497638.210746:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+13:2411:x1863837546323968:12345-192.168.202.4@tcp:39:umount.0 00000020:00000080:2.0:1777497638.210808:0:73210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e3572656917b85 00000020:00010000:2.0:1777497638.210827:0:73210:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f82c7e800: total 0 00000100:00080000:2.0:1777497638.210833:0:73210:0:(import.c:65:import_set_state_nolock()) ffff92409fb65000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497638.210894:0:73210:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378738 00010000:00010000:0.0:1777497638.210936:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.210949:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.210957:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.210963:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497638.210980:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.210988:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211007:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff92409f6ded00) 00010000:00010000:0.0:1777497638.211028:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497638.211035:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211041:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734800/0x3e357265691d336 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211068:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211073:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211078:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211083:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497638.211086:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211133:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211143:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff92409f6de000) 00010000:00010000:0.0:1777497638.211146:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497638.211149:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497638.211155:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734200/0x3e357265691d33d lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497638.211351:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:6d03493e-1218-49f3-bdd0-b10716c402e0+10:2411:x1863837546323968:12345-192.168.202.4@tcp:39:umount.0 Request processed in 615us (1197us total) trans 81604378739 rc 0/0 00000100:00100000:2.0:1777497638.211370:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1309 00000020:00010000:3.0:1777497638.211818:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f82c7e800: total 0 00010000:00010000:3.0:1777497638.211901:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f82c7e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1777497638.211936:0:16604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:3.0:1777497638.211939:0:16604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1777497638.211946:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d2e2 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c25d expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497638.211963:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f82c7e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1777497638.211976:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497638.211979:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497638.211980:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497638.212184:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212194:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212202:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212220:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497638.212224:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212230:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212241:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216fd00) 00010000:00010000:1.0:1777497638.212243:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497638.212247:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497638.212263:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d2aa lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497638.246350:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497638.246472:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324224 00000100:00100000:1.0:1777497638.246487:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324224 00000100:00100000:1.0:1777497638.246560:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 81 00000100:00100000:1.0:1777497638.246572:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+6:2411:x1863837546324224:12345-192.168.202.4@tcp:251:umount.0 00000020:00000080:1.0:1777497638.246630:0:87350:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cdfd 00000020:00010000:1.0:1777497638.246652:0:87350:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240a68cb800: total 0 00000100:00080000:1.0:1777497638.246658:0:87350:0:(import.c:65:import_set_state_nolock()) ffff9240a68c9000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1777497638.246764:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f669050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:95f1b493-372d-4153-ad35-48e1115be1b1+3:2411:x1863837546324224:12345-192.168.202.4@tcp:251:umount.0 Request processed in 194us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497638.246773:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 81 00000020:00010000:3.0:1777497638.246911:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240a68cb800: total 0 00010000:00010000:3.0:1777497638.246991:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240a68cb800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1777497638.247040:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b35e00/0x3e357265691cf3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c22c expref: 2 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497638.247057:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240a68cb800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1777497638.247137:0:6503:0:(genops.c:906:class_export_put()) final put ffff9240a68cb800/95f1b493-372d-4153-ad35-48e1115be1b1 00010000:00010000:3.0:1777497638.247150:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497638.247152:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497638.247155:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777497638.247225:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a68cb800/95f1b493-372d-4153-ad35-48e1115be1b1 for MGS 00000020:00000080:1.0:1777497638.247283:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240a68c9000 for MGS 00010000:00010000:3.0:1777497639.077640:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497639.265342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.265451:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324352 00000100:00100000:2.0:1777497639.265461:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324352 00000100:00100000:2.0:1777497639.265589:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:2.0:1777497639.265599:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2411:x1863837546324352:12345-192.168.202.4@tcp:250:mount.lustre.0 00010000:00080000:2.0:1777497639.265631:0:87349:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp t0 exp 0000000000000000 cur 3768 last 0 00000020:00000080:2.0:1777497639.265667:0:87349:0:(genops.c:1406:class_connect()) connect: client 34a4158d-137e-4629-9769-4a4bd53f7f61, cookie 0x3e357265691d344 00000100:00080000:2.0:1777497639.265707:0:87349:0:(import.c:65:import_set_state_nolock()) ffff92409c469800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497639.265785:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+4:2411:x1863837546324352:12345-192.168.202.4@tcp:250:mount.lustre.0 Request processed in 186us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.265794:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:0.0:1777497639.272682:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.272916:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324480 00000100:00100000:2.0:1777497639.272926:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324480 00000100:00100000:2.0:1777497639.273060:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:2.0:1777497639.273071:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+4:70248:x1863837546324480:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:2.0:1777497639.273088:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497639.273496:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a600/0x3e357265691d34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c28e expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497639.273531:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a600/0x3e357265691d34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c28e expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497639.273542:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a600/0x3e357265691d34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c28e expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497639.273562:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a600, rc 0) 00000100:00100000:2.0:1777497639.273633:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70248:x1863837546324480:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 564us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.273641:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 83 00000100:00100000:3.0:1777497639.282658:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.282745:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324608 00000100:00100000:2.0:1777497639.282754:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324608 00000100:00100000:2.0:1777497639.282801:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:2.0:1777497639.282808:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409f668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70248:x1863837546324608:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1777497639.282911:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409f668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70248:x1863837546324608:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 102us (260us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777497639.282929:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:0.0:1777497639.295822:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.296048:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324736 00000100:00100000:2.0:1777497639.296060:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324736 00000100:00100000:3.0:1777497639.297607:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:3.0:1777497639.297627:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70248:x1863837546324736:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1777497639.297652:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497639.297673:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39c00/0x3e357265691d352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c295 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.297706:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39c00/0x3e357265691d352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c295 expref: 6 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.297717:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39c00/0x3e357265691d352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c295 expref: 6 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.297727:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39c00, rc 0) 00000100:00100000:3.0:1777497639.297808:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a68b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70248:x1863837546324736:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 191us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.297815:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:0.0:1777497639.309272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.309499:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324864 00000100:00100000:1.0:1777497639.309526:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324864 00000100:00100000:1.0:1777497639.309596:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1777497639.309756:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70248:x1863837546324864:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:1.0:1777497639.309955:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70248:x1863837546324864:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 350us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.309964:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:0.0:1777497639.321292:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.321698:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546324992 00000100:00100000:3.0:1777497639.321710:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546324992 00000100:00100000:3.0:1777497639.321774:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:3.0:1777497639.321784:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70248:x1863837546324992:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:3.0:1777497639.321942:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70248:x1863837546324992:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 159us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.321960:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:0.0:1777497639.327013:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.327831:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325120 00000100:00100000:1.0:1777497639.327843:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325120 00000100:00100000:1.0:1777497639.327908:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1777497639.327920:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325120:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1777497639.329849:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325120:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 1921us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.329863:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:0.0:1777497639.366849:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.376544:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325248 00000100:00100000:2.0:1777497639.376578:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325248 00000100:00100000:2.0:1777497639.376675:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:2.0:1777497639.376687:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325248:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777497639.376929:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866db850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325248:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 244us (10091us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.376937:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:0.0:1777497639.395233:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.396802:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325376 00000100:00100000:1.0:1777497639.396817:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325376 00000100:00100000:1.0:1777497639.396904:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:1.0:1777497639.396915:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325376:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1777497639.397207:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70267:x1863837546325376:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 292us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.397215:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:0.0:1777497639.403446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.403648:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325504 00000100:00100000:3.0:1777497639.403664:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325504 00000100:00100000:3.0:1777497639.403759:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:3.0:1777497639.403772:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70248:x1863837546325504:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:3.0:1777497639.403800:0:87347:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497639.403825:0:87347:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39000/0x3e357265691d359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c2c6 expref: -99 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.403866:0:87347:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39000/0x3e357265691d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2c6 expref: 8 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.403881:0:87347:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39000/0x3e357265691d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2c6 expref: 8 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497639.403893:0:87347:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39000, rc 0) 00000100:00100000:3.0:1777497639.403974:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70248:x1863837546325504:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 205us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.403983:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:0.0:1777497639.408387:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.408524:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325632 00000100:00100000:2.0:1777497639.408542:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325632 00000100:00100000:2.0:1777497639.409918:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1777497639.409932:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70248:x1863837546325632:12345-192.168.202.4@tcp:256:mount.lustre.0 20000000:01000000:2.0:1777497639.409969:0:87349:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1777497639.410402:0:87349:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1777497639.410407:0:87349:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1777497639.410420:0:87349:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1777497639.410424:0:87349:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1777497639.410426:0:87349:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 116 00000100:00100000:2.0:1777497639.415898:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70248:x1863837546325632:12345-192.168.202.4@tcp:256:mount.lustre.0 Request processed in 5956us (7511us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.415915:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:0.0:1777497639.419927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.420308:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325760 00000100:00100000:1.0:1777497639.420328:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325760 00000100:00100000:1.0:1777497639.420465:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:1.0:1777497639.420478:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70248:x1863837546325760:12345-192.168.202.4@tcp:101:mount.lustre.0 00010000:00010000:1.0:1777497639.420504:0:87350:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497639.420550:0:87350:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735000/0x3e357265691d360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c2cd expref: -99 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497639.420595:0:87350:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735000/0x3e357265691d360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2cd expref: 9 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497639.420623:0:87350:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735000/0x3e357265691d360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2cd expref: 9 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497639.420634:0:87350:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735000, rc 0) 00000100:00100000:1.0:1777497639.420736:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70248:x1863837546325760:12345-192.168.202.4@tcp:101:mount.lustre.0 Request processed in 260us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.420746:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 93 00000100:00100000:0.0:1777497639.423853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.423991:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546325888 00000100:00100000:2.0:1777497639.424006:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546325888 00000100:00100000:2.0:1777497639.424144:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:2.0:1777497639.424157:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70248:x1863837546325888:12345-192.168.202.4@tcp:501:mount.lustre.0 00000100:00100000:2.0:1777497639.424402:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84000050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70248:x1863837546325888:12345-192.168.202.4@tcp:501:mount.lustre.0 Request processed in 247us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.424411:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 94 00000100:00100000:0.0:1777497639.426915:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.427031:0:87350:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326016 00000100:00100000:1.0:1777497639.427044:0:87350:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326016 00000100:00100000:1.0:1777497639.427176:0:87350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:1.0:1777497639.427189:0:87350:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70248:x1863837546326016:12345-192.168.202.4@tcp:503:mount.lustre.0 00000100:00100000:1.0:1777497639.427411:0:87350:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70248:x1863837546326016:12345-192.168.202.4@tcp:503:mount.lustre.0 Request processed in 224us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.427420:0:87350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 95 00000100:00100000:0.0:1777497639.430861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.430984:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326144 00000100:00100000:2.0:1777497639.430998:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326144 00000100:00100000:2.0:1777497639.431072:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:2.0:1777497639.431086:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70272:x1863837546326144:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777497639.431357:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70272:x1863837546326144:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 275us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.431366:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 96 00000100:00100000:0.0:1777497639.445561:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497639.446032:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326272 00000100:00100000:2.0:1777497639.446049:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326272 00000100:00100000:2.0:1777497639.446253:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:2.0:1777497639.446267:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70272:x1863837546326272:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777497639.446483:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70272:x1863837546326272:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 218us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.446503:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 97 00000100:00100000:0.0:1777497639.451470:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497639.451541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.451668:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326400 00000100:00100000:3.0:1777497639.451695:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326400 00000100:00100000:3.0:1777497639.451750:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326656 00000100:00100000:3.0:1777497639.451753:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326656 00000100:00100000:3.0:1777497639.451778:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1310 00000100:00100000:3.0:1777497639.451788:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84f43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546326400:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:3.0:1777497639.451827:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3768 last 0 00000020:00000080:3.0:1777497639.451895:0:64885:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691d367 00000004:00100000:3.0:1777497639.451951:0:64885:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1777497639.452137:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f826cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497639.452221:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84f43050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546326400:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 433us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.452229:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1310 00000100:00100000:1.0:1777497639.454023:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1311 00000100:00100000:1.0:1777497639.454041:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546326656:12345-192.168.202.4@tcp:38:mount.lustre.0 00010000:00080000:1.0:1777497639.454121:0:65418:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3768 last 0 00000020:00000080:1.0:1777497639.454196:0:65418:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691d36e 00000004:00100000:1.0:1777497639.454251:0:65418:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1777497639.454404:0:65418:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497639.456296:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546326656:12345-192.168.202.4@tcp:38:mount.lustre.0 Request processed in 2246us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.456330:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1311 00000100:00100000:1.0:1777497639.458389:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497639.458413:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564958080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497639.458505:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497639.458636:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958080 00000100:00100000:2.0:1777497639.458647:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958080 00000100:00100000:2.0:1777497639.458862:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3981 00000100:00100000:2.0:1777497639.458873:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564958080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497639.458913:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497639.458973:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564958080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.458980:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3981 00000100:00100000:2.0:1777497639.459059:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564958080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497639.459350:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564958336:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.459401:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497639.459915:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564958464:0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.459962:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564958592:0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.459992:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564958208:0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.460020:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497639.460068:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564958720:0@lo:400:kworker.0 00000100:00100000:0.0:1777497639.460266:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958208 00000100:00100000:0.0:1777497639.460273:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958208 00000100:00100000:0.0:1777497639.460332:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1777497639.460335:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564958848:0@lo:400:kworker.0 00000100:00100000:0.0:1777497639.460353:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564958208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.460367:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.460386:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564959360:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.460420:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497639.460429:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086f14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564958208:12345-0@lo:400:kworker.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497639.460438:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777497639.460481:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959360 00000100:00100000:0.0:1777497639.460485:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959360 00000100:00100000:1.0:1777497639.460499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497639.460530:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:2.0:1777497639.460548:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958848 00000100:00100000:2.0:1777497639.460553:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958848 00000100:00100000:2.0:1777497639.460582:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3982 00000100:00100000:2.0:1777497639.460588:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564958848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.460631:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564958848:12345-0@lo:400:kworker.0 Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.460638:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3982 00000100:00100000:0.0:1777497639.460651:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564959360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.460682:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000100:00100000:0.0:1777497639.460691:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564959360:12345-0@lo:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000004:00080000:2.0:1777497639.460703:0:3657:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 111669149699 committed transno 111669149699 00000100:00100000:0.0:1777497639.460710:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00080000:0.0:1777497639.460732:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497639.460738:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564958848:0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.460756:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564959360:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.464394:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.464626:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958336 00000100:00100000:3.0:1777497639.464638:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958336 00000100:00100000:1.0:1777497639.464781:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.464814:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.464855:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564959232:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.464899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.464944:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564958208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.464971:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326528 00000100:00100000:1.0:1777497639.464975:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326528 00000100:00100000:3.0:1777497639.465114:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326912 00000100:00100000:3.0:1777497639.465118:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326912 00000100:00100000:3.0:1777497639.465131:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546326784 00000100:00100000:3.0:1777497639.465133:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546326784 00000100:00100000:2.0:1777497639.465173:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958720 00000100:00100000:2.0:1777497639.465178:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958720 00000100:00080000:0.0:1777497639.465219:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497639.465223:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497639.465234:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959232 00000100:00100000:0.0:1777497639.465237:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959232 00000100:00100000:0.0:1777497639.465273:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1777497639.465282:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564958336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497639.465349:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564958336:12345-0@lo:400:kworker.0 Request processed in 68us (5947us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497639.465356:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:0.0:1777497639.465389:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1777497639.465396:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564959232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497639.465428:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564959232:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497639.465434:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1281 00000100:00100000:0.0:1777497639.465447:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1312 00000100:00100000:0.0:1777497639.465454:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:70248:x1863837546326912:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:0.0:1777497639.465494:0:63727:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:0.0:1777497639.465567:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:70248:x1863837546326912:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 113us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497639.465574:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1312 00000100:00100000:0.0:1777497639.465612:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564958336:0@lo:400:kworker.0 00000100:00100000:0.0:1777497639.465640:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564959232:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467051:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1313 00000100:00100000:1.0:1777497639.467062:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:0:x1863837546326528:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:1.0:1777497639.467087:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:1.0:1777497639.467170:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:0:x1863837546326528:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 110us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.467191:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1313 00000100:00100000:1.0:1777497639.467407:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.467449:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564959104:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467707:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.467726:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564959616:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467754:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.467797:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958592 00000100:00100000:1.0:1777497639.467804:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958592 00000100:00100000:1.0:1777497639.467830:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959616 00000100:00100000:1.0:1777497639.467833:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959616 00000100:00100000:1.0:1777497639.467846:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1777497639.467852:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564958592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467889:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564958592:12345-0@lo:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.467895:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:1.0:1777497639.467908:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1777497639.467915:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564959616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467941:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564959616:12345-0@lo:400:kworker.0 Request processed in 26us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.467945:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1777497639.467980:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564958592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.467991:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564959616:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.468016:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.468036:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564958976:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.468067:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.468083:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564959488:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.468944:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.468989:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958464 00000100:00100000:1.0:1777497639.468993:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958464 00000100:00100000:1.0:1777497639.469027:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1777497639.469034:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469072:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564958464:12345-0@lo:400:kworker.0 Request processed in 38us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.469077:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1777497639.469280:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959104 00000100:00100000:1.0:1777497639.469285:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959104 00000100:00100000:1.0:1777497639.469314:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564958976 00000100:00100000:1.0:1777497639.469317:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564958976 00000100:00100000:1.0:1777497639.469334:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959488 00000100:00100000:1.0:1777497639.469336:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959488 00000100:00100000:1.0:1777497639.469352:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1777497639.469357:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564959104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469517:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564959104:12345-0@lo:400:kworker.0 Request processed in 159us (1810us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.469523:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:1.0:1777497639.469536:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1777497639.469542:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564958976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469569:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564958976:12345-0@lo:400:kworker.0 Request processed in 28us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.469575:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:1.0:1777497639.469585:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1777497639.469601:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564959488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469630:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564959488:12345-0@lo:400:kworker.0 Request processed in 30us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.469636:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:1.0:1777497639.469686:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564959104:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469720:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564958464:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469730:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564958976:0@lo:400:kworker.0 00000100:00100000:1.0:1777497639.469738:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564959488:0@lo:400:kworker.0 00000100:00080000:0.0:1777497639.472425:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497639.472437:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497639.472441:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497639.472443:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497639.474182:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1314 00000100:00100000:3.0:1777497639.474198:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:0:x1863837546326784:12345-192.168.202.4@tcp:41:mount.lustre.0 00000004:00000024:3.0:1777497639.474253:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:3.0:1777497639.474648:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:0:x1863837546326784:12345-192.168.202.4@tcp:41:mount.lustre.0 Request processed in 173us (9583us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.474657:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1314 00000100:00100000:3.0:1777497639.474747:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.474851:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327040 00000100:00100000:3.0:1777497639.474858:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327040 00000100:00100000:3.0:1777497639.474890:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1315 00000100:00100000:3.0:1777497639.474897:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327040:12345-192.168.202.4@tcp:40:mount.lustre.0 00000100:00100000:3.0:1777497639.474940:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327040:12345-192.168.202.4@tcp:40:mount.lustre.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.475009:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1315 00000100:00100000:2.0:1777497639.475309:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1285 00000100:00100000:2.0:1777497639.475317:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564958720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497639.475377:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564958720:12345-0@lo:400:kworker.0 Request processed in 49us (10551us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.475383:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1285 00000100:00100000:0.0:1777497639.475880:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564958720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497639.480832:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.480894:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497639.481021:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.481210:0:63739:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327424 00000100:00100000:1.0:1777497639.481226:0:63739:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327424 00000100:00100000:1.0:1777497639.481306:0:63739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:1.0:1777497639.481316:0:63739:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327424:12345-192.168.202.4@tcp:900:mount.lustre.0 00000100:00100000:1.0:1777497639.481415:0:63739:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327424:12345-192.168.202.4@tcp:900:mount.lustre.0 Request processed in 100us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.481422:0:63739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 12 00000100:00100000:2.0:1777497639.483392:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327168 00000100:00100000:2.0:1777497639.483409:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327168 00000100:00100000:2.0:1777497639.483447:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327296 00000100:00100000:2.0:1777497639.483450:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327296 00000100:00100000:2.0:1777497639.483491:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5875 00000100:00100000:2.0:1777497639.483499:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:0+-99:2411:x1863837546327168:12345-192.168.202.4@tcp:8:mount.lustre.0 00010000:00080000:2.0:1777497639.483536:0:25491:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3768 last 0 00000020:00000080:2.0:1777497639.483576:0:25491:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691d375 00002000:00100000:2.0:1777497639.483591:0:25491:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff92409c46d800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1777497639.483605:0:25491:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1777497639.483673:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5876 00000100:00100000:3.0:1777497639.483685:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:0+-99:2411:x1863837546327296:12345-192.168.202.4@tcp:8:mount.lustre.0 00002000:00080000:2.0:1777497639.483720:0:25491:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00010000:00080000:3.0:1777497639.483733:0:25488:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3768 last 0 00000020:00000080:3.0:1777497639.483777:0:25488:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691d37c 00002000:00100000:3.0:1777497639.483789:0:25488:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff924090d1c000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1777497639.483801:0:25488:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1777497639.483905:0:25488:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1777497639.483925:0:25491:0:(import.c:65:import_set_state_nolock()) ffff92409c763800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1777497639.483940:0:25488:0:(import.c:65:import_set_state_nolock()) ffff9240bb783800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497639.484058:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546327168:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 557us (3161us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497639.484066:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5875 00000100:00100000:3.0:1777497639.486863:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546327296:12345-192.168.202.4@tcp:8:mount.lustre.0 Request processed in 3159us (5822us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.486882:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5876 00000100:00100000:3.0:1777497639.487529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497639.487636:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327552 00000100:00100000:1.0:1777497639.487651:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327552 00000100:00100000:1.0:1777497639.487720:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:1.0:1777497639.487729:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327552:12345-192.168.202.4@tcp:33:mount.lustre.0 00000004:00200000:1.0:1777497639.487819:0:66634:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1777497639.487896:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:70248:x1863837546327552:12345-192.168.202.4@tcp:33:mount.lustre.0 Request processed in 169us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.487905:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 234 00000100:00100000:1.0:1777497639.970607:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497639.970672:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564959744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497639.970770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497639.970856:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959744 00000100:00100000:1.0:1777497639.970868:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959744 00000100:00100000:1.0:1777497639.970941:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:1.0:1777497639.970953:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564959744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497639.971009:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1777497639.971074:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564959744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.971083:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1777497639.971189:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564960000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497639.971293:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497639.971352:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497639.971359:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564959872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497639.971384:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497639.971420:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564959872 00000100:00100000:3.0:1777497639.971427:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564959872 00000100:00100000:3.0:1777497639.971470:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3983 00000100:00100000:3.0:1777497639.971479:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564959872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497639.971519:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1777497639.971575:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3658:x1863837564959872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497639.971599:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3983 00000100:00100000:3.0:1777497639.971650:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564959872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497639.971996:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564959744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497639.972074:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960000 00000100:00100000:1.0:1777497639.972078:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960000 00000100:00100000:1.0:1777497639.972159:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:1.0:1777497639.972166:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564960000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497639.972492:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497639.972542:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564960000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 377us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497639.972549:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:3.0:1777497639.972625:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564960000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1777497640.100306:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497641.122359:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497641.219739:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497641.219820:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327680 00000100:00100000:3.0:1777497641.219830:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327680 00000100:00100000:3.0:1777497641.219909:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1316 00000100:00100000:3.0:1777497641.219920:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546327680:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497641.219941:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497641.219969:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c2fe expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220039:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220054:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220069:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497641.220149:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497641.220154:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497641.220175:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220198:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220245:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497641.220254:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240c216fb00) 00010000:00010000:3.0:1777497641.220258:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497641.220261:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38800, rc 0) 00000100:00100000:3.0:1777497641.220328:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+7:70315:x1863837546327680:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 411us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497641.220334:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1316 00000100:00080000:0.0:1777497641.220579:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497641.233666:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497641.233880:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327808 00000100:00100000:3.0:1777497641.233891:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327808 00000100:00100000:3.0:1777497641.233961:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1317 00000100:00100000:3.0:1777497641.233973:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546327808:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497641.234017:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:3.0:1777497641.234118:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546327808:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 148us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497641.234125:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1317 00000100:00080000:0.0:1777497641.234431:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497641.236649:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497641.236831:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546327936 00000100:00100000:0.0:1777497641.236840:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546327936 00000100:00100000:0.0:1777497641.236919:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2108 00000100:00100000:0.0:1777497641.236929:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546327936:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:0.0:1777497641.236955:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497641.237026:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546327936:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 98us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497641.237033:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2108 00000100:00080000:1.0:1777497641.237273:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497641.241345:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497641.241455:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328064 00000100:00100000:3.0:1777497641.241473:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328064 00000100:00080000:1.0:1777497641.241574:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497641.241596:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2109 00000100:00100000:3.0:1777497641.241615:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546328064:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497641.241656:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497641.242288:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:70315:x1863837546328064:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 675us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497641.242300:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2109 00010000:00010000:3.0:1777497642.147323:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497642.147523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497642.147658:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328192 00000100:00100000:3.0:1777497642.147671:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328192 00000100:00100000:3.0:1777497642.147741:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1318 00000100:00100000:3.0:1777497642.147759:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546328192:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1777497642.147779:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497642.147799:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38600/0x3e357265691d391 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c305 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147863:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147879:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147890:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147904:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147912:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147918:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147974:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.147981:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148002:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497642.148040:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148053:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148059:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148065:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148071:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497642.148074:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148081:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148126:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240c216fb00) 00010000:00010000:3.0:1777497642.148130:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497642.148134:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148140:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691d398 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148152:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148164:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148168:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148173:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497642.148176:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148182:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148189:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff9240c216f100) 00010000:00010000:3.0:1777497642.148191:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497642.148194:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148198:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691d39f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148240:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38600/0x3e357265691d391 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c305 expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148253:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c305 expref: 8 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.148260:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240c216f400) 00010000:00010000:3.0:1777497642.148262:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497642.148271:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38c00, rc 0) 00000100:00100000:3.0:1777497642.148340:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328192:12345-192.168.202.4@tcp:101:cp.0 Request processed in 591us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497642.148348:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1318 00000100:00100000:2.0:1777497642.162743:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497642.162962:0:63739:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328320 00000100:00100000:1.0:1777497642.162972:0:63739:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328320 00000100:00100000:1.0:1777497642.163034:0:63739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:1.0:1777497642.163045:0:63739:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d146155b-4321-4b14-9284-f644ed9631fb+6:70349:x1863837546328320:12345-192.168.202.4@tcp:900:cp.0 00000100:00100000:1.0:1777497642.163159:0:63739:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:d146155b-4321-4b14-9284-f644ed9631fb+6:70349:x1863837546328320:12345-192.168.202.4@tcp:900:cp.0 Request processed in 116us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497642.163177:0:63739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1777497642.166194:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497642.166248:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328448 00000100:00100000:0.0:1777497642.166258:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328448 00000100:00100000:0.0:1777497642.166316:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1319 00000100:00100000:0.0:1777497642.166328:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:70349:x1863837546328448:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1777497642.166351:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497642.166376:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d3ad lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c30c expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.166443:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d3b4 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.166470:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d3b4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.166482:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d3b4 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497642.166529:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:0.0:1777497642.166533:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1777497642.166590:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8600/0x3e357265691d3ad lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c30c expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.166605:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d3b4 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c30c expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.166613:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:0.0:1777497642.166616:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1777497642.166619:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00000100:00100000:0.0:1777497642.166695:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546328448:12345-192.168.202.4@tcp:101:cp.0 Request processed in 367us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497642.166701:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1319 00000100:00100000:3.0:1777497642.169820:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497642.170000:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328576 00000100:00100000:0.0:1777497642.170010:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328576 00000100:00100000:0.0:1777497642.170078:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1320 00000100:00100000:0.0:1777497642.170089:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546328576:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:0.0:1777497642.170154:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497642.170192:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d3bb lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c313 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170295:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170312:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170326:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170344:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170350:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170356:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170456:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170463:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170470:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497642.170514:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:0.0:1777497642.170519:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497642.170544:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170574:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170580:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170587:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170593:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170599:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497642.170604:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170612:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170625:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:0.0:1777497642.170628:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497642.170634:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170641:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8a00/0x3e357265691d3c2 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170658:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170664:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170676:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170681:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497642.170684:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170690:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170697:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff9240b565d600) 00010000:00010000:0.0:1777497642.170699:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497642.170702:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170707:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9a00/0x3e357265691d3c9 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170743:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9000/0x3e357265691d3bb lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c313 expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170771:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c313 expref: 8 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497642.170777:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:0.0:1777497642.170779:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1777497642.170782:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9600, rc 0) 00000100:00100000:0.0:1777497642.170842:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328576:12345-192.168.202.4@tcp:101:cp.0 Request processed in 754us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497642.170857:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1320 00000100:00100000:2.0:1777497642.193086:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497642.198414:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328704 00000100:00100000:1.0:1777497642.198430:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328704 00000100:00100000:1.0:1777497642.198502:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1321 00000100:00100000:1.0:1777497642.198512:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328704:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1777497642.198538:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497642.198563:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691d3d7 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c31a expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198643:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198660:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198673:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198686:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198692:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198698:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198737:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198767:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 2/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198773:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198778:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497642.198782:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198788:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198799:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:1.0:1777497642.198802:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497642.198806:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198812:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735c00/0x3e357265691d3de lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198823:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198828:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198833:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198837:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497642.198845:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198850:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198857:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff92409f6deb00) 00010000:00010000:1.0:1777497642.198859:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497642.198861:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198866:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735200/0x3e357265691d3e5 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198900:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691d3d7 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c31a expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198909:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:1.0:1777497642.198911:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497642.198915:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691d3d7 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c31a expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497642.198925:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734a00, rc 0) 00000100:00100000:1.0:1777497642.199002:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328704:12345-192.168.202.4@tcp:101:cp.0 Request processed in 492us (5924us total) trans 0 rc 301/301 00000100:00100000:1.0:1777497642.199010:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1321 00000100:00100000:3.0:1777497642.204892:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497642.204935:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328832 00000100:00100000:3.0:1777497642.204948:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328832 00000100:00100000:3.0:1777497642.205011:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1322 00000100:00100000:3.0:1777497642.205022:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328832:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1777497642.205044:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497642.205066:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38600/0x3e357265691d3ec lrc: 2/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c321 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205160:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205189:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205203:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205228:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205236:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205243:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205301:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205309:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 4/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205315:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205321:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205327:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497642.205331:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 4/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205338:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 5/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205350:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:3.0:1777497642.205353:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497642.205357:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 3/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205363:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38a00/0x3e357265691d3f3 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205377:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205382:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 2/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205394:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205398:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497642.205401:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205406:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 4/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205414:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff9240c216f100) 00010000:00010000:3.0:1777497642.205416:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497642.205419:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 2/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205424:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39800/0x3e357265691d3fa lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205458:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38600/0x3e357265691d3ec lrc: 1/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c321 expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205469:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:3.0:1777497642.205472:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497642.205476:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38600/0x3e357265691d3ec lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c321 expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497642.205485:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38600, rc 0) 00000100:00100000:3.0:1777497642.205565:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328832:12345-192.168.202.4@tcp:101:cp.0 Request processed in 543us (682us total) trans 0 rc 301/301 00000100:00100000:3.0:1777497642.205581:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1322 00000100:00100000:1.0:1777497642.211149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497642.211963:0:63736:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328960 00000100:00100000:3.0:1777497642.211974:0:63736:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328960 00000100:00100000:3.0:1777497642.212030:0:63736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:3.0:1777497642.212040:0:63736:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328960:12345-192.168.202.4@tcp:700:cp.0 00000020:02000000:3.0:1777497642.212056:0:63736:0:(tgt_handler.c:872:tgt_request_handle()) *** cfs_fail_loc=123, val=2147483648*** 00000100:00100000:3.0:1777497642.221357:0:63736:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546328960:12345-192.168.202.4@tcp:700:cp.0 Request processed in 9304us (10203us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497642.221377:0:63736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 13 00000100:00100000:2.0:1777497643.042528:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777497643.042556:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564960256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497643.042623:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497643.042662:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564960128:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497643.042684:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497643.045979:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960256 00000100:00100000:1.0:1777497643.045994:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960256 00000100:00100000:1.0:1777497643.046289:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960128 00000100:00100000:1.0:1777497643.046308:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960128 00000100:00100000:3.0:1777497643.046373:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1777497643.046389:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564960256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497643.046425:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497643.046506:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564960256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497643.046513:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:3.0:1777497643.046574:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564960256:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497643.051970:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497643.051981:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497643.052340:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:1.0:1777497643.052358:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564960128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497643.052394:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497643.052480:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564960128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 130us (9793us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497643.052486:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1777497643.052653:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3add500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564960128:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497643.170854:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497643.558511:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00100000:1.0:1777497643.558526:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:1.0:1777497643.558530:0:9460:0:(genops.c:906:class_export_put()) final put ffff9240b521c000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497643.560077:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b521c000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0001 00000020:00000080:3.0:1777497643.560150:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240b521c800 for lustre-OST0001 00000001:00100000:0.0:1777497643.567755:0:87343:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00100000:0.0:1777497643.567770:0:87343:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:0.0:1777497643.567779:0:87343:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 111669149700 is committed 00000020:00000080:0.0:1777497643.567784:0:87343:0:(genops.c:906:class_export_put()) final put ffff9240bb685000/6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00100000:0.0:1777497643.571361:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00100000:0.0:1777497643.571375:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:0.0:1777497643.571379:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f826cb800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00000080:3.0:1777497643.572837:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb685000/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0000 00000020:00000080:3.0:1777497643.572941:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240aef6d000 for lustre-MDT0000 00000020:00000080:3.0:1777497643.574604:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826cb800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-OST0000 00000020:00000080:3.0:1777497643.574669:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92408a0a7800 for lustre-OST0000 00000001:00100000:1.0:1777497643.576187:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00100000:1.0:1777497643.576197:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6d03493e-1218-49f3-bdd0-b10716c402e0 00000001:00080000:1.0:1777497643.576213:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378739 is committed 00000020:00000080:1.0:1777497643.576225:0:72699:0:(genops.c:906:class_export_put()) final put ffff923f82c7e800/6d03493e-1218-49f3-bdd0-b10716c402e0 00000020:00080000:1.0:1777497643.576241:0:72699:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff923f84e4a000 refcount 2 committed 0 result 0 batchid 77309411386 00000020:00080000:1.0:1777497643.576246:0:72699:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff923f84325800 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff923f84e4a0c0 00000020:00080000:1.0:1777497643.576249:0:72699:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].2 00000020:00080000:1.0:1777497643.576252:0:72699:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff923f84325d00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff924091126a00 00000020:00080000:1.0:1777497643.576256:0:72699:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].2 00000020:00080000:3.0:1777497643.576310:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411386 committed batchid 77309411385 00000020:00080000:3.0:1777497643.576380:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411385 00000020:00000080:0.0:1777497643.576474:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82c7e800/6d03493e-1218-49f3-bdd0-b10716c402e0 for lustre-MDT0001 00000020:00000080:0.0:1777497643.576546:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409fb65000 for lustre-MDT0001 00010000:00010000:1.0:1777497644.194500:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497644.578417:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564960768:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578496:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.578511:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564960384:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578523:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564961280:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578552:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578571:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564961792:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578591:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578623:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564960512:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578643:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578657:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564961024:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578693:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578720:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564961536:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578739:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578757:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777497644.578763:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564960640:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578781:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578797:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564961152:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578814:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578830:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564961664:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.578848:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.578879:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960768 00000100:00100000:3.0:1777497644.579570:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960768 00000100:00100000:3.0:1777497644.579660:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960512 00000100:00100000:3.0:1777497644.579664:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960512 00000100:00100000:0.0:1777497644.579670:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961024 00000100:00100000:0.0:1777497644.579673:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961024 00000100:00100000:3.0:1777497644.579685:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960640 00000100:00100000:3.0:1777497644.579688:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960640 00000100:00100000:0.0:1777497644.579696:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961536 00000100:00100000:0.0:1777497644.579699:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961536 00000100:00100000:3.0:1777497644.579707:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1777497644.579715:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1777497644.579721:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564960768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497644.579721:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564961024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.579774:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564960768:12345-0@lo:400:kworker.0 Request processed in 55us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497644.579775:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564961024:12345-0@lo:400:kworker.0 Request processed in 55us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.579782:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:0.0:1777497644.579782:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3984 00000100:00100000:3.0:1777497644.579797:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1777497644.579797:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1777497644.579803:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564960512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497644.579803:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564961536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.579827:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564960512:12345-0@lo:400:kworker.0 Request processed in 25us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497644.579827:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564961536:12345-0@lo:400:kworker.0 Request processed in 25us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.579834:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1777497644.579834:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3985 00000100:00100000:3.0:1777497644.579845:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1777497644.579850:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564960640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.579877:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564960640:12345-0@lo:400:kworker.0 Request processed in 27us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.579882:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1777497644.580242:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961280 00000100:00100000:3.0:1777497644.580247:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961280 00000100:00100000:3.0:1777497644.580280:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961792 00000100:00100000:3.0:1777497644.580283:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961792 00000100:00100000:3.0:1777497644.580304:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961152 00000100:00100000:3.0:1777497644.580307:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961152 00000100:00100000:3.0:1777497644.580322:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961664 00000100:00100000:3.0:1777497644.580325:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961664 00000100:00100000:3.0:1777497644.580341:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1777497644.580346:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564961280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580379:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564961280:12345-0@lo:400:kworker.0 Request processed in 33us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.580384:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:3.0:1777497644.580403:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1777497644.580408:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564961792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580449:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564961792:12345-0@lo:400:kworker.0 Request processed in 30us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497644.580455:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1777497644.580467:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564961152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497644.580507:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564961152:12345-0@lo:400:kworker.0 Request processed in 46us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.580597:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:3.0:1777497644.580609:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:3.0:1777497644.580615:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564961664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580643:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564961664:12345-0@lo:400:kworker.0 Request processed in 29us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.580649:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00080000:3.0:1777497644.580689:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497644.580693:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497644.580695:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497644.580697:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497644.580744:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564960768:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580756:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564961280:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580765:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564961792:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580799:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564960640:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580809:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564961152:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580818:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564961664:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580826:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564960512:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580835:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564961024:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.580843:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564961536:0@lo:400:kworker.0 00000100:00100000:2.0:1777497644.582286:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.582341:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564960896:0@lo:400:kworker.0 00000100:00100000:2.0:1777497644.582387:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.582405:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564961408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497644.582428:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.582444:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564961920:0@lo:400:kworker.0 00000100:00100000:2.0:1777497644.582465:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.582517:0:87349:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960384 00000100:00100000:2.0:1777497644.582524:0:87349:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960384 00000100:00100000:3.0:1777497644.582574:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564960896 00000100:00100000:2.0:1777497644.582574:0:87349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1777497644.582577:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564960896 00000100:00100000:2.0:1777497644.582581:0:87349:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924099291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564960384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582608:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961408 00000100:00100000:3.0:1777497644.582610:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961408 00000100:00100000:3.0:1777497644.582624:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564961920 00000100:00100000:3.0:1777497644.582627:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564961920 00000100:00100000:2.0:1777497644.582630:0:87349:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924099291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564960384:12345-0@lo:400:kworker.0 Request processed in 50us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497644.582636:0:87349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1777497644.582641:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1777497644.582646:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564960896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582675:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3add500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837564960896:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.582680:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1289 00000100:00100000:3.0:1777497644.582691:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1777497644.582694:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564960384:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582696:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564961408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497644.582706:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837564960896:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582718:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3add880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564961408:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.582723:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:2.0:1777497644.582725:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564961408:0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582733:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1777497644.582738:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564961920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497644.582779:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3aded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837564961920:12345-0@lo:400:kworker.0 Request processed in 41us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.582784:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1777497644.582799:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497644.582806:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564962048:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497644.582835:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497644.582875:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837564961920:0@lo:400:kworker.0 00000100:00080000:3.0:1777497644.582898:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497644.583677:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1777497644.583709:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962048 00000100:00100000:0.0:1777497644.583714:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962048 00000100:00100000:0.0:1777497644.583791:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3986 00000100:00100000:0.0:1777497644.583799:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564962048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497644.583837:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:0.0:1777497644.583899:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564962048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497644.583905:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3986 00000100:00100000:2.0:1777497644.585279:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564962048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497644.862477:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497644.862526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497644.862571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497644.862596:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497644.862623:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497644.862656:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329472 00000100:00100000:1.0:1777497644.862666:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329472 00000100:00100000:1.0:1777497644.862732:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329600 00000100:00100000:1.0:1777497644.862736:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329600 00000100:00100000:1.0:1777497644.862759:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2585 00000100:00100000:1.0:1777497644.862768:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546329472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497644.862846:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546329472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.862854:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2585 00000100:00100000:1.0:1777497644.862896:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2586 00000100:00100000:1.0:1777497644.862903:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546329600:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497644.862932:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546329600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.862938:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2586 00000100:00100000:1.0:1777497644.862960:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329216 00000100:00100000:1.0:1777497644.862964:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329216 00000100:00100000:1.0:1777497644.862993:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329344 00000100:00100000:1.0:1777497644.862996:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329344 00000100:00100000:1.0:1777497644.863049:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1292 00000100:00100000:1.0:1777497644.863057:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546329216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497644.863086:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546329216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.863127:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1292 00000100:00100000:1.0:1777497644.863141:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1293 00000100:00100000:2.0:1777497644.863301:0:87347:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329088 00000100:00100000:2.0:1777497644.863306:0:87347:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329088 00000100:00100000:2.0:1777497644.863339:0:87347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:2.0:1777497644.863346:0:87347:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aeeec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546329088:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497644.863377:0:87347:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aeeec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546329088:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 31us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497644.863383:0:87347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 100 00000100:00100000:1.0:1777497644.864322:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546329344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497644.864370:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546329344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1222us (1772us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.864388:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1293 00000100:00080000:1.0:1777497644.864418:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497644.864422:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497644.864425:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497644.864427:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:1.0:1777497644.941376:0:88250:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1777497644.941435:0:88250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.941451:0:88250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.941458:0:88250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.941465:0:88250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.941487:0:88250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1777497644.941493:0:88250:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1777497644.941527:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777497644.941532:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1777497644.941538:0:88250:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1777497644.942545:0:88250:0:(import.c:65:import_set_state_nolock()) ffff9240aef6f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1777497644.942719:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497644.942728:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.942737:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b35000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497644.942741:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.942749:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497644.942756:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497644.942762:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1777497644.942764:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1777497644.942767:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1777497644.942792:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.942815:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497644.942846:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.942853:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35000/0x3e357265691cf07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf0e expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.942866:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497644.942867:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497644.942869:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497644.942914:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564962304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.942985:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.943128:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564962176:0@lo:39:umount.0 00000100:00100000:3.0:1777497644.943180:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497644.945981:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962304 00000100:00100000:0.0:1777497644.945995:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962304 00000100:00100000:0.0:1777497644.946284:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:0.0:1777497644.946296:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564962304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497644.946313:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497644.946333:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefc00/0x3e357265691cf0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf07 expref: 23 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.946347:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497644.946407:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837564962304:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (3423us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497644.946414:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:1.0:1777497644.946478:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962176 00000100:00100000:1.0:1777497644.946484:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962176 00000100:00100000:1.0:1777497644.946535:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:1.0:1777497644.946542:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564962176:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777497644.946584:0:65418:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d01f 00000100:00080000:1.0:1777497644.946593:0:65418:0:(import.c:65:import_set_state_nolock()) ffff9240849d2800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1777497644.946650:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837564962176:12345-0@lo:39:umount.0 Request processed in 109us (3469us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.946656:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000020:00000080:1.0:1777497644.946664:0:65418:0:(genops.c:906:class_export_put()) final put ffff9240849d7000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1777497644.946693:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497644.946829:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497644.946889:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240849d2800 for lustre-MDT0000 00000100:00080000:3.0:1777497644.947045:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1777497644.947067:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564962176:0@lo:39:umount.0 00000100:00100000:3.0:1777497644.947161:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564962304:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1777497644.947315:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497644.947319:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1777497644.947325:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1777497644.948961:0:88250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.948979:0:88250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949002:0:88250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949009:0:88250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949039:0:88250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497644.949045:0:88250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949051:0:88250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949056:0:88250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949062:0:88250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949076:0:88250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497644.949084:0:88250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949090:0:88250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949128:0:88250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949336:0:88250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949387:0:88250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777497644.949394:0:88250:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949399:0:88250:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949404:0:88250:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497644.949410:0:88250:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949558:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777497644.949566:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949574:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497644.949577:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949586:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497644.949593:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497644.949599:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497644.949601:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1777497644.949633:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949640:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497644.949680:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949697:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691ce2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce35 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949715:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497644.949719:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949725:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497644.949728:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949734:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497644.949740:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497644.949745:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497644.949747:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1777497644.949749:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1777497644.949765:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949770:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497644.949777:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949783:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fee00/0x3e357265691cf46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf4d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949804:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497644.949807:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949812:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497644.949815:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949821:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497644.949826:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497644.949831:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1777497644.949833:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1777497644.949835:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1777497644.949848:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949853:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497644.949869:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949875:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691cef9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691cf00 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949884:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497644.949887:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949897:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88b34800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497644.949900:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949907:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497644.949913:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497644.949919:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497644.949921:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:1.0:1777497644.949933:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949938:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497644.949944:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.949951:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497644.949952:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497644.949954:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497644.949971:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564962560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950033:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497644.950077:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497644.950083:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564962432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950131:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497644.950172:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564962688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950241:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497644.950259:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497644.950265:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564962816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950286:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497644.950316:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962560 00000100:00100000:1.0:1777497644.950322:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962560 00000100:00100000:1.0:1777497644.950365:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962432 00000100:00100000:1.0:1777497644.950367:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962432 00000100:00100000:1.0:1777497644.950382:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962688 00000100:00100000:1.0:1777497644.950384:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962688 00000100:00100000:1.0:1777497644.950396:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962816 00000100:00100000:1.0:1777497644.950399:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962816 00000100:00100000:1.0:1777497644.950415:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1777497644.950423:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3660:x1863837564962560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497644.950437:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497644.950452:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dce00/0x3e357265691cf4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf46 expref: 25 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.950465:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497644.950501:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3660:x1863837564962560:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.950508:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1777497644.950527:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1777497644.950534:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564962432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497644.950542:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497644.950550:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b34000/0x3e357265691ce35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691ce2e expref: 23 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.950558:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497644.950584:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3660:x1863837564962432:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.950590:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1777497644.950603:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1777497644.950610:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3657:x1863837564962688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497644.950618:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497644.950627:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dc000/0x3e357265691cf00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cef9 expref: 21 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.950637:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497644.950664:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3657:x1863837564962688:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.950669:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:1.0:1777497644.950710:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1777497644.950717:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3657:x1863837564962816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497644.950723:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497644.950732:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691ce27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691ce12 expref: 19 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497644.950741:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497644.950762:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3657:x1863837564962816:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497644.950768:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1777497644.950807:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564962432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950816:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564962560:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950842:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564962816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497644.950861:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564962688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497644.951477:0:88250:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497644.951484:0:88250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b34800/0x3e357265691ce12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691ce27 expref: -99 pid: 87342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497644.951497:0:88250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1777497644.951500:0:88250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1777497644.951504:0:88250:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1777497644.951541:0:88250:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1777497644.951558:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:2.0:1777497644.951563:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:2.0:1777497644.951568:0:88250:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:3.0:1777497644.952690:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497644.952703:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497644.953368:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:2.0:1777497644.955986:0:88250:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:2.0:1777497644.956654:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:2.0:1777497644.956677:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f826ca800 d146155b-4321-4b14-9284-f644ed9631fb 192.168.202.4@tcp 6 (0 0 2) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497644.956686:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240849d5000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497644.956690:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f82ab5800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497644.956695:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f82ab6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497644.956700:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240b539c800 lustre-MDT0001-mdtlov_UUID 0@lo 5 (0 0 0) 0 0 0 0: 0000000000000000 111669149699 stale:0 00000020:00080000:2.0:1777497644.956705:0:88250:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff9240a695cd40) has exports, disconnecting them 00000020:00080000:2.0:1777497644.956710:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff923f826ca800), last request at 1777497644 00000020:00000080:2.0:1777497644.956718:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d367 00000020:00010000:2.0:1777497644.956726:0:88250:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f826ca800: total 0 00000100:00080000:2.0:1777497644.956731:0:88250:0:(import.c:65:import_set_state_nolock()) ffff923f826cd800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497644.956752:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff923f826ca800): rc 0 00000020:00080000:2.0:1777497644.956756:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240849d5000), last request at 1777497618 00000020:00000080:2.0:1777497644.956759:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d018 00000100:00080000:2.0:1777497644.956762:0:88250:0:(import.c:65:import_set_state_nolock()) ffff9240849d2000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497644.956768:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240849d5000): rc 0 00000020:00000080:2.0:1777497644.956770:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240849d5000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1777497644.956777:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f82ab5800), last request at 1777497644 00000020:00000080:2.0:1777497644.956780:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d011 00000100:00080000:2.0:1777497644.956783:0:88250:0:(import.c:65:import_set_state_nolock()) ffff923f88a89800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497644.956790:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f82ab5800): rc 0 00000020:00000080:2.0:1777497644.956792:0:88250:0:(genops.c:906:class_export_put()) final put ffff923f82ab5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1777497644.956795:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f82ab6000), last request at 1777497644 00000020:00000080:2.0:1777497644.956797:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d00a 00000100:00080000:2.0:1777497644.956806:0:88250:0:(import.c:65:import_set_state_nolock()) ffff923f82ab0000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497644.956836:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f82ab6000): rc 0 00000020:00000080:2.0:1777497644.956838:0:88250:0:(genops.c:906:class_export_put()) final put ffff923f82ab6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1777497644.956848:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240b539c800), last request at 1777497613 00000020:00000080:2.0:1777497644.956852:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce7b 00000100:00080000:2.0:1777497644.956860:0:88250:0:(import.c:65:import_set_state_nolock()) ffff923f86084000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497644.956869:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240b539c800): rc 0 00000020:00000080:2.0:1777497644.956871:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240b539c800/lustre-MDT0001-mdtlov_UUID 00000004:00000080:2.0:1777497644.956877:0:88250:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef01c77ae0 00000100:00080000:2.0:1777497644.956896:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1777497644.956899:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00010000:0.0:1777497644.957477:0:83956:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f826ca800: total 4 00010000:00010000:0.0:1777497644.957526:0:83956:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f826ca800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1777497644.957575:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d3a6 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c305 expref: 3 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.957619:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691d38a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 2 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497644.957634:0:83956:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f826ca800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1777497644.958331:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497644.958337:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497644.959297:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497644.959306:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777497644.959318:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d5000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497644.959380:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497644.959392:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497644.959403:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b539c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497644.959420:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240849d2000 for lustre-MDT0000 00000020:00000080:1.0:1777497644.959423:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a89800 for lustre-MDT0000 00000020:00000080:1.0:1777497644.959425:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82ab0000 for lustre-MDT0000 00000020:00000080:1.0:1777497644.959427:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f86084000 for lustre-MDT0000 00000100:00080000:2.0:1777497644.960017:0:88250:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1777497644.960047:0:88250:0:(import.c:65:import_set_state_nolock()) ffff924086e2d800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1777497644.960502:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564962944:0@lo:39:umount.0 00000100:00100000:3.0:1777497644.960587:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497644.960684:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564962944 00000100:00100000:1.0:1777497644.960692:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564962944 00000100:00100000:1.0:1777497644.960736:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3987 00000100:00100000:1.0:1777497644.960743:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564962944:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777497644.960766:0:23359:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ceba 00000100:00080000:1.0:1777497644.960772:0:23359:0:(import.c:65:import_set_state_nolock()) ffff923f839d1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497644.960787:0:23359:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378739 00000100:00100000:1.0:1777497644.960917:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837564962944:12345-0@lo:39:umount.0 Request processed in 173us (329us total) trans 81604378740 rc 0/0 00000100:00100000:1.0:1777497644.960925:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3987 00010000:00010000:3.0:1777497644.961050:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497644.961083:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e2d800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1777497644.961089:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564962944:0@lo:39:umount.0 00000100:00080000:2.0:1777497644.962332:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1777497644.962336:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 3 00000004:00080000:2.0:1777497644.962352:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:2.0:1777497644.962400:0:88250:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1777497644.962416:0:88250:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1777497644.962433:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1777497644.962435:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 3 00000004:00080000:2.0:1777497644.962440:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:2.0:1777497644.962484:0:88250:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1777497644.962488:0:88250:0:(import.c:65:import_set_state_nolock()) ffff92409c46f000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1777497644.962519:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a695cd40) has no exports 00000100:00100000:3.0:1777497644.962653:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564963072:0@lo:9:umount.0 00000100:00100000:3.0:1777497644.962696:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.962721:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564963200:0@lo:9:umount.0 00000100:00100000:3.0:1777497644.962733:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497644.962757:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963072 00000100:00100000:3.0:1777497644.962762:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963072 00000100:00100000:3.0:1777497644.962785:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963200 00000100:00100000:3.0:1777497644.962787:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963200 00000100:00100000:3.0:1777497644.962799:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1777497644.962804:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564963072:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777497644.962826:0:8398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ced6 00000100:00080000:3.0:1777497644.962834:0:8398:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777497644.962868:0:8398:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:3.0:1777497644.963000:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564963072:12345-0@lo:9:umount.0 Request processed in 194us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.963007:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5877 00000100:00100000:3.0:1777497644.963021:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5878 00000100:00100000:3.0:1777497644.963027:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837564963200:12345-0@lo:9:umount.0 00000020:00000080:3.0:1777497644.963039:0:8398:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cee4 00000100:00080000:3.0:1777497644.963045:0:8398:0:(import.c:65:import_set_state_nolock()) ffff923f88a8f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1777497644.963067:0:8398:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:3.0:1777497644.963293:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837564963200:12345-0@lo:9:umount.0 Request processed in 265us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497644.963300:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5878 00010000:00010000:3.0:1777497644.963323:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497644.963327:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497644.963349:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777497644.963353:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777497644.963354:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497644.963357:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564963072:0@lo:9:umount.0 00000100:00080000:3.0:1777497644.963362:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46f000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1777497644.963375:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:3.0:1777497644.963376:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:3.0:1777497644.963377:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564963200:0@lo:9:umount.0 00000020:00080000:2.0:1777497644.964884:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a695cd40) has no exports 00000020:00000080:0.0:1777497645.007698:0:83956:0:(genops.c:906:class_export_put()) final put ffff923f826ca800/d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:3.0:1777497645.008047:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f826ca800/d146155b-4321-4b14-9284-f644ed9631fb for lustre-MDT0000 00000020:00000080:3.0:1777497645.008121:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f826cd800 for lustre-MDT0000 00010000:00010000:1.0:1777497645.008219:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497645.008222:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497645.008225:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497645.032939:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce90 00000020:00000080:2.0:1777497645.032954:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240b543a000/lustre-QMT0000_UUID 00000020:01000000:2.0:1777497645.032968:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1777497645.033057:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b543a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1777497645.033085:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497645.033106:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1777497645.033111:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff923f84b08000) has no exports 00000020:00000080:3.0:1777497645.034562:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce89 00000020:00000080:3.0:1777497645.034584:0:88250:0:(genops.c:906:class_export_put()) final put ffff923f88a19800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497645.034616:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a19800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497645.034645:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497645.034653:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777497645.034656:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240a3af0000/lustre-QMT0000_UUID 00000020:00000080:3.0:1777497645.034657:0:88250:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1777497645.034661:0:88250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1777497645.034779:0:88250:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff924098abaea0 - data ffff9240b6019af8/ffff9240bc2df800 00000020:01000000:3.0:1777497645.034888:0:88250:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240bb7f6480 - data ffff9240b614bbd0/ffff924085d49400 00000100:00100000:1.0:1777497645.090462:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497645.090487:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564963328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497645.090582:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497645.090668:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963328 00000100:00100000:0.0:1777497645.090676:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963328 00000100:00100000:0.0:1777497645.090723:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3988 00000100:00100000:0.0:1777497645.090731:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1863837564963328:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1777497645.090739:0:8406:0:(tgt_handler.c:795:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497645.090784:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3660:x1863837564963328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (202us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497645.090790:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3988 00000100:02020000:0.0:1777497645.090827:0:3660:0:(client.c:1490:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1777497645.090831:0:3660:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777497645.090835:0:3660:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1777497645.090839:0:3660:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1777497645.090845:0:3660:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497645.090849:0:3660:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3748 00000100:00080000:0.0:1777497645.090855:0:3660:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497645.090874:0:3660:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b569b100 x1863837564963456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497645.090995:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564963456:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1777497645.091029:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497645.091129:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963456 00000100:00100000:1.0:1777497645.091134:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963456 00000100:00100000:1.0:1777497645.091160:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3989 00000100:00100000:1.0:1777497645.091165:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564963456:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1777497645.091182:0:23359:0:(ldlm_lib.c:1193:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1777497645.100225:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564963456:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 9049us (9186us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497645.100240:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3989 00000100:00080000:1.0:1777497645.100548:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497645.100554:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497645.100559:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564963456:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1777497645.105859:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497645.105870:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1777497645.105889:0:88250:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240a3adc000 x1863837564962944/t81604378740(81604378740) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497654 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497645.105925:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1777497645.107684:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777497645.107689:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 4 00000004:00080000:0.0:1777497645.107725:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497645.107728:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1777497645.107951:0:87361:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1777497645.107956:0:87361:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x68:0x0] index 1 count 1 00000040:00080000:1.0:1777497645.107978:0:87361:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 26 count 2 00000100:00080000:0.0:1777497645.108702:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777497645.108705:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 4 00000004:00080000:0.0:1777497645.108726:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497645.108728:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1777497645.109081:0:87363:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1777497645.109086:0:87363:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6a:0x0] index 1 count 1 00000040:00080000:3.0:1777497645.109161:0:87363:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 26 count 2 00000020:00000080:1.0:1777497645.118902:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce43 00000020:00000080:1.0:1777497645.118912:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240bb6f5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497645.119074:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb6f5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497645.119897:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce58 00000020:00000080:1.0:1777497645.119905:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240911d3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497645.119960:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1777497645.119975:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497645.119985:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777497645.119989:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9240a69599c0) has no exports 00000004:01000000:1.0:1777497645.120210:0:88250:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1777497645.120219:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cedd 00000020:00000080:1.0:1777497645.120223:0:88250:0:(genops.c:906:class_export_put()) final put ffff92409c468000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497645.123879:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1777497645.128506:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1777497645.128546:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497645.128561:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497645.128566:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9240bb698000) has no exports 00000020:00000080:1.0:1777497645.128593:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cecf 00000020:00000080:1.0:1777497645.128602:0:88250:0:(genops.c:906:class_export_put()) final put ffff92409c46b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497645.132998:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c468000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1777497645.133723:0:88250:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1777497645.133728:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1777497645.133732:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969451 gen 5 00000004:00080000:1.0:1777497645.133738:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497645.133741:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497645.138141:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1777497645.138393:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497645.138408:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497645.138417:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cec1 00000020:00000080:1.0:1777497645.138427:0:88250:0:(genops.c:906:class_export_put()) final put ffff92409c46e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497645.138434:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1777497645.138442:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497645.138446:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497645.138450:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9240bb6999c0) has no exports 00000020:00000080:1.0:1777497645.138458:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ceb3 00000020:00000080:1.0:1777497645.138462:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240911d7000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1777497645.138820:0:88250:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1777497645.138825:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1777497645.138829:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969456 gen 5 00000004:00080000:1.0:1777497645.138834:0:88250:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:1.0:1777497645.138837:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777497645.138867:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497645.138872:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1777497645.138886:0:88250:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1777497645.138892:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cea5 00000020:00000080:1.0:1777497645.138896:0:88250:0:(genops.c:906:class_export_put()) final put ffff923f88a1d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1777497645.138900:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1777497645.138903:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497645.138907:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1777497645.138909:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240aecd8000) has no exports 00000020:00000080:1.0:1777497645.138913:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce9e 00000020:00000080:1.0:1777497645.138928:0:88250:0:(genops.c:906:class_export_put()) final put ffff924086e2a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497645.139086:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c46f000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1777497645.139266:0:8:0:(genops.c:906:class_export_put()) final put ffff92409c468800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497645.139270:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c468800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1777497645.139275:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497645.139352:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777497645.139356:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497645.139368:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb6f7800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777497645.139371:0:8:0:(genops.c:906:class_export_put()) final put ffff923f88a1b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497645.139373:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1777497645.139376:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497645.139409:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777497645.139413:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e2a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1777497645.142164:0:88250:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1777497645.142174:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497645.142179:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1777497645.142197:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497645.142248:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497645.142259:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497645.142285:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497645.142288:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497645.142293:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240bb787800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497645.142297:0:88250:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb787800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1777497645.142310:0:88250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497645.142411:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce5f 00000020:00000080:0.0:1777497645.142418:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240911d5000/lustre-MDD0000_UUID 00000020:01000000:0.0:1777497645.142424:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1777497645.142428:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497645.142432:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497645.142436:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9240a695b380) has no exports 00000020:00000080:0.0:1777497645.142456:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497645.142459:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1777497645.142464:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce66 00000020:00000080:0.0:1777497645.142467:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240911d0000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497645.142474:0:88250:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924098a46000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1777497645.142476:0:88250:0:(obd_mount.c:701:lustre_put_lsi()) put ffff924098a46000 3 00000020:01000004:0.0:1777497645.142479:0:88250:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff924098a46000 from lustre-MDT0000 00000020:00000080:0.0:1777497645.142496:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497645.142499:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1777497645.142511:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240bb6f7000/lustre-MDT0000_UUID 00000020:00000080:0.0:1777497645.142514:0:88250:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb6f7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1777497645.142523:0:88250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1777497645.142557:0:88250:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1777497645.142561:0:88250:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1777497645.142564:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1777497645.142566:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497645.142569:0:88250:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1777497645.142576:0:88250:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff92409c46c000 34a4158d-137e-4629-9769-4a4bd53f7f61 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497645.142582:0:88250:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240bb784000 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497645.142586:0:88250:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff923f84b0cd40) has exports, disconnecting them 00000020:00080000:0.0:1777497645.142590:0:88250:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff92409c46c000), last request at 1777497639 00000020:00000080:0.0:1777497645.142602:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d344 00000020:00010000:0.0:1777497645.142605:0:88250:0:(genops.c:1942:obd_stale_export_put()) Put export ffff92409c46c000: total 2 00000100:00080000:0.0:1777497645.142609:0:88250:0:(import.c:65:import_set_state_nolock()) ffff92409c469800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497645.142624:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff92409c46c000): rc 0 00000020:00080000:0.0:1777497645.142627:0:88250:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9240bb784000), last request at 1777497613 00000020:00000080:0.0:1777497645.142634:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ce04 00000020:00010000:0.0:1777497645.142636:0:88250:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240bb784000: total 2 00000100:00080000:0.0:1777497645.142638:0:88250:0:(import.c:65:import_set_state_nolock()) ffff9240bb785000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1777497645.142646:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240bb784000): rc 0 00000020:00080000:0.0:1777497645.142649:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff923f84b0cd40) has no exports 00000020:00010000:3.0:1777497645.142770:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff92409c46c000: total 2 00010000:00010000:3.0:1777497645.142774:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497645.142823:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff92409c46c000, canceled 0 locks, left on hash table 4. 00010000:00010000:3.0:1777497645.142853:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39000/0x3e357265691d359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2c6 expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142871:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39c00/0x3e357265691d352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c295 expref: 4 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142882:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a600/0x3e357265691d34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c28e expref: 3 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142891:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89735000/0x3e357265691d360 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2cd expref: 2 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142900:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff92409c46c000, canceled 4 locks, left on hash table 0. 00000020:00000080:3.0:1777497645.142917:0:6503:0:(genops.c:906:class_export_put()) final put ffff92409c46c000/34a4158d-137e-4629-9769-4a4bd53f7f61 00000020:00010000:3.0:1777497645.142922:0:6503:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240bb784000: total 3 00010000:00010000:3.0:1777497645.142938:0:6503:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240bb784000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1777497645.142954:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff000/0x3e357265691cfa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf9a expref: 14 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142976:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691d003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cffc expref: 13 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.142996:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef400/0x3e357265691cf93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf8c expref: 12 pid: 87350 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143006:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b35600/0x3e357265691cfaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfa8 expref: 11 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143017:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefa00/0x3e357265691cfbd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfb6 expref: 10 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143026:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef800/0x3e357265691cfcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfc4 expref: 9 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143035:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240866dd800/0x3e357265691cf5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf54 expref: 8 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143044:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88b34a00/0x3e357265691cfd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfd2 expref: 7 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143052:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ffa00/0x3e357265691cf69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf62 expref: 6 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143065:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff400/0x3e357265691cf77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf70 expref: 5 pid: 87347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143077:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7fe600/0x3e357265691cff5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfee expref: 4 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143087:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff600/0x3e357265691cf85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cf7e expref: 3 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143129:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeea00/0x3e357265691cfe7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691cfe0 expref: 2 pid: 87349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497645.143138:0:6503:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240bb784000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1777497645.143151:0:6503:0:(genops.c:906:class_export_put()) final put ffff9240bb784000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00010000:00010000:3.0:1777497645.143311:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497645.143314:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497645.143315:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777497645.143327:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e2d800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777497645.143333:0:8:0:(genops.c:906:class_export_put()) final put ffff9240bb6f6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497645.143335:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb6f6800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1777497645.143340:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497645.143380:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1777497645.143384:0:8:0:(genops.c:906:class_export_put()) final put ffff9240911d5800/lustre-MDD0000_UUID 00000020:00000080:3.0:1777497645.143386:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1777497645.143389:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1777497645.143412:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497645.143417:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46c000/34a4158d-137e-4629-9769-4a4bd53f7f61 for MGS 00000020:00000080:3.0:1777497645.143448:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb784000/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:3.0:1777497645.143461:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c469800 for MGS 00000020:00000080:3.0:1777497645.143465:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb785000 for MGS 00000100:00100000:3.0:1777497645.147273:0:87347:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff924089992000:87347] 0 exiting: rc = 1 00000100:00100000:3.0:1777497645.147396:0:87350:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff9240a6b5de00:87350] 2 exiting: rc = 0 00010000:00010000:0.0:1777497645.148269:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497645.152222:0:87349:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff9240b5097c00:87349] 1 exiting: rc = 0 00000100:00100000:0.0:1777497645.152451:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152459:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152467:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152473:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152479:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152499:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152504:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152510:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152536:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152541:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152549:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152554:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152559:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152565:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152571:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152577:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152582:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152587:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152592:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152597:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152605:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152614:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152621:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152626:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152631:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152636:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152641:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152648:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152709:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152716:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152721:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152728:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152733:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152738:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152743:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152749:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152755:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152761:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152766:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152771:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152777:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152783:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152787:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152801:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152807:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152814:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152820:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152826:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152831:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152837:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152843:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152849:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152855:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152861:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152867:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152872:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152878:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152884:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152889:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152894:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152900:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152905:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152910:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1777497645.152915:0:88250:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1777497645.156650:0:88250:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f84c510c0 - data ffff9240b6089948/ffff9240a738e400 00000020:01000000:0.0:1777497645.156786:0:88250:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a63d59c0 - data ffff9240a33d2870/ffff9240b54e6800 00000020:00000080:0.0:1777497645.157368:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cdf6 00000020:00000080:0.0:1777497645.157375:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240bb686000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1777497645.157430:0:88250:0:(tgt_mount.c:187:server_put_mount()) put mount ffff924098a46000 from MGS, refs=2 00000020:01000004:0.0:1777497645.157434:0:88250:0:(obd_mount.c:701:lustre_put_lsi()) put ffff924098a46000 2 00000020:01000004:0.0:1777497645.157437:0:88250:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff924098a46000 from MGS 00000020:00000080:0.0:1777497645.157460:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497645.157470:0:88250:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1777497645.157472:0:88250:0:(genops.c:906:class_export_put()) final put ffff9240bb681800/MGS 00000020:00000080:0.0:1777497645.157475:0:88250:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb681800/MGS for MGS 00000020:01000000:0.0:1777497645.157481:0:88250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1777497645.157559:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1777497645.157575:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497645.157580:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1777497645.157587:0:88250:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff923f8274d800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497645.157593:0:88250:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff92408316b380) has exports, disconnecting them 00000020:00080000:0.0:1777497645.157598:0:88250:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff923f8274d800), last request at 1777497613 00000020:00000080:0.0:1777497645.157602:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cf1c 00000020:00080000:0.0:1777497645.157612:0:88250:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f8274d800): rc 0 00000020:00000080:0.0:1777497645.157615:0:88250:0:(genops.c:906:class_export_put()) final put ffff923f8274d800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1777497645.159817:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb686000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497645.160647:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8274d800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1777497645.197181:0:88250:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1777497645.197200:0:88250:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777497645.197204:0:88250:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1777497645.197213:0:88250:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1777497645.197361:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497645.197371:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1777497645.197379:0:88250:0:(obd_mount.c:701:lustre_put_lsi()) put ffff924098a46000 1 00000020:00000080:1.0:1777497645.197385:0:88250:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691cde8 00000020:00000080:1.0:1777497645.197393:0:88250:0:(genops.c:906:class_export_put()) final put ffff92408a0a1000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1777497645.197398:0:88250:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1777497645.197403:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1777497645.197407:0:88250:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1777497645.197410:0:88250:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff923f84b099c0) has no exports 00000020:00000080:3.0:1777497645.198084:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240aef6f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1777497645.198124:0:82203:0:(genops.c:906:class_export_put()) final put ffff923f8274a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1777497645.198127:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8274a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1777497645.198134:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1777497645.198224:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1777497645.218538:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1777497645.367333:0:88250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1777497645.367344:0:88250:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1777497645.367349:0:88250:0:(genops.c:906:class_export_put()) final put ffff92408a0a1800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497645.367354:0:88250:0:(genops.c:865:class_export_destroy()) destroying export ffff92408a0a1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1777497645.367366:0:88250:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1777497645.367495:0:88250:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff92408a0a4000 00000020:02000400:1.0:1777497645.367555:0:88250:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1777497646.247953:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497647.269518:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497648.162546:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564963584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497648.162618:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497648.162770:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963584 00000100:00100000:2.0:1777497648.162779:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963584 00000100:00100000:2.0:1777497648.162851:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1777497648.162861:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564963584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497648.162904:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497648.162946:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564963584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497648.162953:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00080000:1.0:1777497648.163010:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497648.163048:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564963584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497648.163663:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497648.163676:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564963712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497648.163709:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497648.163853:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963712 00000100:00100000:0.0:1777497648.163859:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963712 00000100:00100000:0.0:1777497648.163908:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:0.0:1777497648.163916:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564963712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497648.163935:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497648.163985:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564963712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497648.163994:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:1.0:1777497648.164044:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497648.164138:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3ade300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564963712:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497648.292276:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497649.314457:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1777497649.698704:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497649.698714:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497649.698721:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497649.698746:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3774 00000100:00080000:0.0:1777497649.698754:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497649.698765:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497649.698797:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b569b100 x1863837564964480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497649.698829:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564964096:0@lo:400:kworker.0 00000100:00100000:0.0:1777497649.698890:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564964480:0@lo:38:kworker.0 00000100:00100000:1.0:1777497649.698896:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.698965:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564964736:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.699007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.699022:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1777497649.699027:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564963968:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.699039:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.699049:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564964608:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.699060:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.699081:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964096 00000100:00100000:1.0:1777497649.699087:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964096 00000100:00100000:0.0:1777497649.699123:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.699186:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963968 00000100:00100000:1.0:1777497649.699190:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963968 00000100:00100000:0.0:1777497649.699192:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964480 00000100:00100000:0.0:1777497649.699198:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964480 00000100:00100000:3.0:1777497649.699222:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1777497649.699238:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3990 00000100:00100000:3.0:1777497649.699249:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564964096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497649.699250:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564964480:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497649.699285:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964736 00010000:00020000:0.0:1777497649.699288:0:8406:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497649.699291:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964736 00000100:00100000:2.0:1777497649.699335:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964608 00000100:00100000:2.0:1777497649.699340:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964608 00000100:00100000:3.0:1777497649.699370:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564964096:12345-0@lo:400:kworker.0 Request processed in 132us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497649.699377:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1777497649.699380:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564964480:12345-0@lo:38:kworker.0 Request processed in 125us (251us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497649.699396:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564964736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497649.699402:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3990 00000100:00080000:0.0:1777497649.699446:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497649.699451:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497649.699455:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564964480:0@lo:38:kworker.0 00000100:00100000:2.0:1777497649.699851:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564964736:12345-0@lo:400:kworker.0 Request processed in 459us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497649.699858:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:2.0:1777497649.699873:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1777497649.699879:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564964608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497649.699899:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564964608:12345-0@lo:400:kworker.0 Request processed in 22us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497649.699905:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:2.0:1777497649.699928:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564964224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497649.699968:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497649.699989:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564964864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497649.700005:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497649.700018:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1777497649.700022:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564963840:0@lo:400:kworker.0 00000400:00000100:2.0:1777497649.700044:0:3657:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564963840 offset 0 length 224: 4 00000100:00100000:2.0:1777497649.700059:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564964352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497649.700070:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497649.700083:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964224 00000100:00100000:2.0:1777497649.700085:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964224 00000100:00100000:1.0:1777497649.700515:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1777497649.700520:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3660:x1863837564963968:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497649.700526:0:63727:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497649.700549:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3660:x1863837564963968:12345-0@lo:400:kworker.0 Request processed in 29us (1509us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497649.700553:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:1.0:1777497649.700565:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964864 00000100:00100000:1.0:1777497649.700567:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964864 00000100:00100000:1.0:1777497649.700573:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964352 00000100:00100000:1.0:1777497649.700574:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964352 00000100:00100000:1.0:1777497649.700586:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1777497649.700589:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564964352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.700611:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564964352:12345-0@lo:400:kworker.0 Request processed in 22us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497649.700615:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:1.0:1777497649.700622:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:1.0:1777497649.700624:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1863837564964864:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497649.700627:0:63727:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497649.700647:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3ade680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3657:x1863837564964864:12345-0@lo:400:kworker.0 Request processed in 22us (641us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497649.700651:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00080000:1.0:1777497649.700687:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497649.700722:0:3660:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497649.700725:0:3660:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497649.700728:0:3660:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497649.700733:0:3660:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497649.700735:0:3660:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3748 00000100:00080000:1.0:1777497649.700739:0:3660:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497649.700758:0:3660:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5bbea00 x1863837564964992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497649.700775:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837564963968:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.700785:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564964608:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.700792:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564964736:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.700800:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564964096:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.700826:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564964992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1777497649.700842:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.700857:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564964992 00000100:00100000:1.0:1777497649.700859:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564964992 00000100:00100000:1.0:1777497649.700869:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1777497649.700872:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564964992:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1777497649.700883:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497649.700910:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564964992:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35us (66us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497649.700915:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00080000:1.0:1777497649.700940:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497649.700956:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497649.700959:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564964992:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1777497649.700991:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564964352:0@lo:400:kworker.0 00000100:00080000:1.0:1777497649.701001:0:3657:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497649.701002:0:3657:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497649.701005:0:3657:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497649.701007:0:3657:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497649.701009:0:3657:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3748 00000100:00080000:1.0:1777497649.701011:0:3657:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497649.701020:0:3657:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5bbea00 x1863837564965120/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497649.701030:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837564964864:0@lo:400:kworker.0 00000100:00100000:1.0:1777497649.701041:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564965120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1777497649.701055:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497649.701068:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564965120 00000100:00100000:1.0:1777497649.701070:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564965120 00000100:00100000:1.0:1777497649.701080:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:1.0:1777497649.701082:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564965120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:1.0:1777497649.701089:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497649.701154:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837564965120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 60us (88us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497649.701160:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00080000:1.0:1777497649.701184:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497649.701188:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497649.701191:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564965120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1777497649.702906:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1777497649.703422:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:0.0:1777497649.703435:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1863837564964224:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1777497649.703445:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497649.703611:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3ade300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3657:x1863837564964224:12345-0@lo:400:kworker.0 Request processed in 168us (3633us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497649.703620:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00080000:2.0:1777497649.703640:0:3657:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1777497649.703644:0:3657:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1777497649.703647:0:3657:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1777497649.703651:0:3657:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497649.703654:0:3657:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3748 00000100:00080000:2.0:1777497649.703753:0:3657:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497649.703776:0:3657:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a3adc000 x1863837564965248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497649.703793:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837564964224:0@lo:400:kworker.0 00000100:00100000:0.0:1777497649.703993:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564965248:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1777497649.704029:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497649.704067:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564965248 00000100:00100000:2.0:1777497649.704073:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564965248 00000100:00100000:2.0:1777497649.704233:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1777497649.704237:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564965248:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1777497649.704375:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497649.704458:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564965248:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 219us (429us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497649.704464:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00080000:0.0:1777497649.704570:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497649.704574:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497649.704576:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564965248:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1777497649.704741:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497649.704749:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378740 is committed 00000020:00000080:0.0:1777497649.704763:0:72699:0:(genops.c:906:class_export_put()) final put ffff923f839d1800/lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1777497649.704802:0:72699:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411386 batchid updated 00000020:00080000:1.0:1777497649.704852:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:1.0:1777497649.704913:0:72719:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff9240bb94d540 with version 10 00000020:00080000:1.0:1777497649.704927:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411386 cancel update log [0x2000088d1:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1777497649.705012:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411386 cancel update log [0x2400090a0:0x2:0x0].2: rc = 0 00000020:00080000:1.0:1777497649.705018:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000004:00080000:2.0:1777497649.705054:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 10 rpc_version 10 00000020:00100000:2.0:1777497649.705072:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777497649.705082:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9240a3adca80 x1863837564965504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497649.705110:0:72705:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9240a3adca80 x1863837564965504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497649.705119:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000020:00000080:3.0:1777497649.705732:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1777497649.705857:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d1000 for lustre-MDT0001 00000400:00000100:3.0:1777497650.002369:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546329728 offset 0 length 224: 4 00000100:00100000:3.0:1777497650.002414:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497650.002452:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497650.002479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497650.002812:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329856 00000100:00100000:0.0:1777497650.002821:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329856 00000100:00100000:0.0:1777497650.002866:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546329984 00000100:00100000:0.0:1777497650.002868:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546329984 00000100:00100000:0.0:1777497650.002906:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1296 00000100:00100000:0.0:1777497650.002915:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546329984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497650.002988:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546329984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497650.002994:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1296 00000100:00100000:0.0:1777497650.003011:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1330 00000100:00100000:0.0:1777497650.003015:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2414:x1863837546329856:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:0.0:1777497650.003020:0:63728:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:0.0:1777497650.003042:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2414:x1863837546329856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (628us total) trans 0 rc -107/-107 00000100:00100000:0.0:1777497650.003047:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1330 00000100:00080000:1.0:1777497650.003259:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497650.003313:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497650.003398:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330112 00000100:00100000:2.0:1777497650.003404:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330112 00000100:00100000:2.0:1777497650.003451:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330240 00000100:00100000:2.0:1777497650.003454:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330240 00000100:00100000:2.0:1777497650.003474:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2589 00000100:00100000:2.0:1777497650.003481:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546330112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:1.0:1777497650.003673:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497650.003676:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497650.003915:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546330112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497650.003922:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2589 00000100:00100000:2.0:1777497650.003937:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2590 00000100:00100000:2.0:1777497650.003943:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546330240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497650.003984:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546330240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 41us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497650.003989:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2590 00000100:00100000:3.0:1777497650.008418:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497650.008647:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330368 00000100:00100000:1.0:1777497650.008744:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330368 00000100:00100000:1.0:1777497650.008800:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1331 00000100:00100000:1.0:1777497650.008808:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546330368:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1777497650.008831:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497650.008898:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546330368:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 Request processed in 89us (489us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497650.008905:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1331 00010000:00010000:3.0:1777497650.338468:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497650.722377:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000001:00100000:2.0:1777497650.726209:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497650.726218:0:9460:0:(genops.c:906:class_export_put()) final put ffff923f88a8a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497650.726357:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a8a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1777497650.726409:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a8f000 for lustre-OST0001 00000001:00100000:0.0:1777497650.726883:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497650.726888:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f839d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497650.726958:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1777497650.727002:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc6e800 for lustre-OST0000 00010000:00010000:3.0:1777497651.362406:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497651.756842:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:1.0:1777497652.391186:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497652.772378:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:1.0:1777497653.285925:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564965632:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497653.286026:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497653.286202:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564965760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497653.286637:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564965632 00000100:00100000:2.0:1777497653.286660:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564965632 00000100:00100000:2.0:1777497653.286757:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:2.0:1777497653.286766:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564965632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497653.286811:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497653.286877:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564965632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497653.287032:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564965632:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497653.287148:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497653.292187:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:3.0:1777497653.295216:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497653.298276:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564965760 00000100:00100000:0.0:1777497653.298291:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564965760 00000100:00100000:0.0:1777497653.298470:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:0.0:1777497653.298483:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564965760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497653.298519:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497653.298622:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564965760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 144us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497653.298642:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1777497653.300214:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564965760:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497653.305430:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497653.411291:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497653.794238:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:0.0:1777497654.434674:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497654.818473:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00080000:0.0:1777497654.818803:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497654.818810:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497654.818813:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497654.818821:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3779 00000100:00080000:0.0:1777497654.818835:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497654.818841:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497654.818866:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b569b800 x1863837564966016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497654.818913:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497654.818916:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497654.818918:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497654.818920:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3779 00000100:00080000:0.0:1777497654.818922:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497654.818925:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497654.818935:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5698e00 x1863837564966272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497654.818989:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497654.818991:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497654.818992:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497654.818995:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3779 00000100:00080000:0.0:1777497654.818996:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1777497654.819005:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497654.819028:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5699880 x1863837564966528/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497654.819042:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497654.819044:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497654.819046:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497654.819048:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3779 00000100:00080000:0.0:1777497654.819050:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1777497654.819052:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497654.819070:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a6300 x1863837564966912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497654.819122:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564966400:0@lo:400:kworker.0 00000100:00100000:0.0:1777497654.819178:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497654.819226:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497654.819230:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564966144:0@lo:400:kworker.0 00000100:00100000:0.0:1777497654.819244:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497654.819268:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966400 00000100:00100000:0.0:1777497654.819274:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966400 00000100:00100000:0.0:1777497654.819310:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966144 00000100:00100000:0.0:1777497654.819312:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966144 00000100:00100000:0.0:1777497654.819326:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:0.0:1777497654.819331:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819426:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564966656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819461:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497654.819484:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1777497654.819490:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564965888:0@lo:400:kworker.0 00000400:00000100:3.0:1777497654.819509:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564965888 offset 0 length 224: 4 00000100:00100000:3.0:1777497654.819530:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564966784:0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819551:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497654.819594:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966656 00000100:00100000:3.0:1777497654.819598:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966656 00000100:00100000:3.0:1777497654.819628:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966784 00000100:00100000:3.0:1777497654.819631:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966784 00000100:00100000:3.0:1777497654.819648:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1777497654.819654:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564966656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819703:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564966656:12345-0@lo:400:kworker.0 Request processed in 48us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497654.819708:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1777497654.819723:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1777497654.819729:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564966784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819764:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564966784:12345-0@lo:400:kworker.0 Request processed in 36us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497654.819770:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1777497654.819807:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564966784:0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819817:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564966656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819854:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:3.0:1777497654.819861:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564966144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819894:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564966144:12345-0@lo:400:kworker.0 Request processed in 34us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497654.819900:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1777497654.819942:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564966400:12345-0@lo:400:kworker.0 Request processed in 610us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497654.819947:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00100000:3.0:1777497654.819955:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564966144:0@lo:400:kworker.0 00000100:00100000:3.0:1777497654.819968:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564966400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497654.821732:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564966016:0@lo:38:kworker.0 00000100:00100000:1.0:1777497654.821787:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497654.821844:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564966272:0@lo:38:kworker.0 00000100:00100000:1.0:1777497654.821866:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497654.821889:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564966528:0@lo:38:kworker.0 00000100:00100000:1.0:1777497654.821912:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497654.821968:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564966912:0@lo:38:kworker.0 00000100:00100000:1.0:1777497654.821984:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497654.822014:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497654.822027:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966016 00000100:00100000:1.0:1777497654.822031:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966016 00000100:00100000:1.0:1777497654.822050:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966272 00000100:00100000:1.0:1777497654.822051:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966272 00000100:00100000:1.0:1777497654.822056:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966912 00000100:00100000:1.0:1777497654.822058:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966912 00000100:00100000:1.0:1777497654.822508:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1777497654.822516:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966016:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497654.822536:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497654.822580:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966016:12345-0@lo:38:kworker.0 Request processed in 63us (792us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497654.822586:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1777497654.822604:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1777497654.822608:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966272:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497654.822618:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497654.822639:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966272:12345-0@lo:38:kworker.0 Request processed in 30us (772us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497654.822655:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1777497654.822664:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1777497654.822667:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966912:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497654.822673:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497654.822689:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837564966912:12345-0@lo:38:kworker.0 Request processed in 21us (704us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497654.822692:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:1.0:1777497654.822723:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497654.822727:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497654.822729:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564966016:0@lo:38:kworker.0 00000100:00080000:1.0:1777497654.822734:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497654.822736:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497654.822738:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564966272:0@lo:38:kworker.0 00000100:00080000:1.0:1777497654.822742:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497654.822744:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497654.822746:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564966912:0@lo:38:kworker.0 00000100:00100000:0.0:1777497654.825049:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564966528 00000100:00100000:0.0:1777497654.825072:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564966528 00000100:00100000:0.0:1777497654.825193:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3991 00000100:00100000:0.0:1777497654.825201:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564966528:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1777497654.825223:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497654.825293:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564966528:12345-0@lo:38:kworker.0 Request processed in 91us (3379us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497654.825297:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3991 00000100:00080000:1.0:1777497654.827272:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497654.827287:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497654.827292:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564966528:0@lo:38:kworker.0 00000100:00100000:1.0:1777497655.112315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:1.0:1777497655.112367:0:3652:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546330496 offset 0 length 224: 4 00000100:00100000:1.0:1777497655.112401:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497655.112432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497655.112481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497655.112514:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330880 00000100:00100000:1.0:1777497655.112523:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330880 00000100:00100000:3.0:1777497655.112525:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546331008 00000100:00100000:3.0:1777497655.112531:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546331008 00000100:00100000:3.0:1777497655.112589:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2593 00000100:00100000:3.0:1777497655.112602:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546331008:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497655.112617:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330624 00000100:00100000:0.0:1777497655.112623:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330624 00000100:00100000:0.0:1777497655.112650:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546330752 00000100:00100000:0.0:1777497655.112654:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546330752 00000100:00100000:3.0:1777497655.112678:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546331008:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497655.112687:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1299 00000100:00100000:3.0:1777497655.112688:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2593 00000100:00100000:0.0:1777497655.112700:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546330752:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497655.112760:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1335 00000100:00100000:2.0:1777497655.112767:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546330624:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497655.112787:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497655.112906:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546330752:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 208us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497655.112913:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1299 00000100:00080000:0.0:1777497655.112945:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497655.112950:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497655.112951:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497655.113304:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546330624:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 534us (997us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497655.113312:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1335 00000100:00100000:1.0:1777497655.118949:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2594 00000100:00100000:1.0:1777497655.118976:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546330880:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497655.119073:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546330880:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 111us (6670us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497655.119080:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2594 00010000:00010000:3.0:1777497655.459374:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497655.842855:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:3.0:1777497656.482585:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497656.866320:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:2.0:1777497657.513481:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497657.890208:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:1.0:1777497658.402537:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564967040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497658.402606:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497658.402704:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967040 00000100:00100000:2.0:1777497658.402712:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967040 00000100:00100000:2.0:1777497658.402776:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1777497658.402786:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564967040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497658.402817:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497658.402861:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564967040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497658.402868:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1777497658.402919:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564967040:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497658.402977:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497658.403221:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497658.403229:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564967168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497658.403258:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497658.403299:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967168 00000100:00100000:2.0:1777497658.403303:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967168 00000100:00100000:2.0:1777497658.403333:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1777497658.403339:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564967168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497658.403355:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497658.403383:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564967168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497658.403388:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00080000:2.0:1777497658.403400:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497658.403417:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564967168:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777497658.530895:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497658.687175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:0.0:1777497658.687211:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546331136 offset 0 length 224: 4 00000100:00100000:0.0:1777497658.687241:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497658.692809:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546331520 00000100:00100000:3.0:1777497658.692829:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546331520 00000100:00100000:3.0:1777497658.692923:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546331648 00000100:00100000:3.0:1777497658.692928:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546331648 00000100:00100000:3.0:1777497658.692975:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2595 00000100:00100000:3.0:1777497658.692990:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546331520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497658.693235:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497658.693277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497658.693305:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546331264 00000100:00100000:0.0:1777497658.693313:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546331264 00000100:00100000:0.0:1777497658.693349:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546331392 00000100:00100000:0.0:1777497658.693352:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546331392 00000100:00100000:0.0:1777497658.693402:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1300 00000100:00100000:0.0:1777497658.693426:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546331392:12345-192.168.202.4@tcp:38:kworker.0 00010000:02000400:0.0:1777497658.693456:0:73210:0:(ldlm_lib.c:952:target_handle_reconnect()) lustre-MDT0001: Client d146155b-4321-4b14-9284-f644ed9631fb (at 192.168.202.4@tcp) reconnecting 00000100:00100000:3.0:1777497658.694910:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546331520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1914us (7734us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497658.694924:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2595 00000100:00100000:3.0:1777497658.694964:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2596 00000100:00100000:3.0:1777497658.694975:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546331648:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497658.695003:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546331648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (7763us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497658.695008:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2596 00000100:00080000:3.0:1777497658.695078:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497658.695086:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497658.695089:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497658.703133:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1336 00000100:00100000:3.0:1777497658.703148:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546331264:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497658.703175:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497658.703249:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546331264:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 102us (10023us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497658.703258:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1336 00010000:00080000:0.0:1777497658.708846:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp ffff923f818b2800 cur 3788 last 1777497658 00000004:00100000:0.0:1777497658.708883:0:73210:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0001: cli 192.168.202.4@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1777497658.708911:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1777497658.708921:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f818b3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497658.709003:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546331392:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 15578us (15724us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497658.711298:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1300 00000100:00100000:0.0:1777497658.716747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497658.716825:0:63736:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546328960 00000100:00100000:1.0:1777497658.716835:0:63736:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546328960 00000100:00100000:1.0:1777497658.716896:0:63736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:1.0:1777497658.716908:0:63736:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546328960:12345-192.168.202.4@tcp:700:cp.0 00000100:00080000:1.0:1777497658.716985:0:63736:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff924086dbed80 x1863837564967296/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497658.716996:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1777497658.915594:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:0.0:1777497659.554241:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497659.748338:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1777497659.938279:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00080000:1.0:1777497659.938638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497659.938643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497659.938647:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497659.938654:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1777497659.938667:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497659.938720:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497659.938754:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086dbe680 x1863837564967552/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497659.938781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497659.938784:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497659.938787:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497659.938790:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1777497659.938794:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497659.938797:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497659.938809:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089384380 x1863837564967808/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497659.938844:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497659.938847:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497659.938849:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497659.938852:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1777497659.938855:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1777497659.938859:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497659.938871:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089386680 x1863837564968064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497659.938892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497659.938896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497659.938897:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497659.938900:0:8:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3784 00000100:00080000:1.0:1777497659.938908:0:8:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1777497659.938912:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497659.938922:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d42d80 x1863837564968448/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497659.938948:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564967552:0@lo:38:kworker.0 00000100:00100000:1.0:1777497659.939013:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939044:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564967808:0@lo:38:kworker.0 00000100:00100000:1.0:1777497659.939077:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939132:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564968064:0@lo:38:kworker.0 00000100:00100000:1.0:1777497659.939175:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939192:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564968448:0@lo:38:kworker.0 00000100:00100000:1.0:1777497659.939210:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939240:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564968192:0@lo:400:kworker.0 00000100:00100000:1.0:1777497659.939265:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939281:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497659.939286:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564967936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497659.939304:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497659.939335:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967552 00000100:00100000:1.0:1777497659.939342:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967552 00000100:00100000:1.0:1777497659.939373:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967808 00000100:00100000:1.0:1777497659.939621:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967808 00000100:00100000:1.0:1777497659.939642:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968448 00000100:00100000:1.0:1777497659.939645:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968448 00000100:00100000:1.0:1777497659.939653:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967936 00000100:00100000:1.0:1777497659.939654:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967936 00000100:00100000:1.0:1777497659.939696:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1777497659.939707:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564967936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497659.940566:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837564967936:12345-0@lo:400:kworker.0 Request processed in 858us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497659.940575:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:1.0:1777497659.940600:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1777497659.940605:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564967552:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497659.940628:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497659.940664:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564967552:12345-0@lo:38:kworker.0 Request processed in 59us (1651us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497659.940671:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1777497659.940686:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1777497659.940691:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564967808:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497659.940699:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497659.940722:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564967808:12345-0@lo:38:kworker.0 Request processed in 30us (1644us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497659.940727:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1777497659.940738:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:1.0:1777497659.940749:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564968448:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497659.940758:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497659.940782:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837564968448:12345-0@lo:38:kworker.0 Request processed in 32us (1571us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497659.940788:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:2.0:1777497659.940951:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968192 00000100:00100000:2.0:1777497659.940958:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968192 00000100:00100000:2.0:1777497659.940997:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1777497659.941004:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564968192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941042:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564968192:12345-0@lo:400:kworker.0 Request processed in 39us (1776us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497659.941057:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2597 00000100:00100000:2.0:1777497659.941084:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564967680:0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941132:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497659.941159:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777497659.941165:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564967424:0@lo:400:kworker.0 00000400:00000100:2.0:1777497659.941185:0:3660:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837564967424 offset 0 length 224: 4 00000100:00100000:2.0:1777497659.941207:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564968320:0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941227:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497659.941251:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968320 00000100:00100000:2.0:1777497659.941255:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968320 00000100:00100000:2.0:1777497659.941293:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1777497659.941298:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564968320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941333:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564968320:12345-0@lo:400:kworker.0 Request processed in 35us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497659.941338:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00100000:2.0:1777497659.941373:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564968320:0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941447:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967680 00000100:00100000:2.0:1777497659.941451:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967680 00000100:00100000:2.0:1777497659.941477:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1777497659.941483:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564967680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497659.941515:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3addc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837564967680:12345-0@lo:400:kworker.0 Request processed in 33us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497659.941521:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1777497659.941547:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837564967680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497659.941735:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968064 00000100:00100000:1.0:1777497659.941740:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968064 00000100:00100000:1.0:1777497659.941764:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3992 00000100:00100000:1.0:1777497659.941769:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564968064:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497659.941790:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497659.941818:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564968064:12345-0@lo:38:kworker.0 Request processed in 48us (2643us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497659.942037:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3992 00000100:00080000:1.0:1777497659.942081:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497659.942136:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837564967936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497659.942149:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564968192:0@lo:400:kworker.0 00000100:00080000:1.0:1777497659.942180:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497659.942185:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497659.942188:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564967552:0@lo:38:kworker.0 00000100:00080000:1.0:1777497659.942196:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497659.942199:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497659.942201:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564967808:0@lo:38:kworker.0 00000100:00080000:1.0:1777497659.942209:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497659.942212:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497659.942214:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564968064:0@lo:38:kworker.0 00000100:00080000:1.0:1777497659.942222:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497659.942225:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497659.942227:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564968448:0@lo:38:kworker.0 00010000:00010000:3.0:1777497660.584368:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497660.770319:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:1.0:1777497660.962221:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:3.0:1777497661.602496:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497661.794723:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:3.0:1777497661.992043:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:2.0:1777497662.628724:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497662.823317:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497663.012408:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:2.0:1777497663.523427:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564968576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497663.523500:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497663.523564:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968576 00000100:00100000:2.0:1777497663.523571:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968576 00000100:00100000:2.0:1777497663.523677:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1777497663.523691:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564968576:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497663.523724:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497663.523769:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564968576:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497663.523777:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:2.0:1777497663.523852:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564968576:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497663.530307:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497663.530338:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564968704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497663.530430:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497663.530484:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968704 00000100:00100000:2.0:1777497663.530491:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968704 00000100:00100000:2.0:1777497663.530541:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1777497663.530551:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564968704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497663.530588:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497663.530678:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564968704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497663.530685:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1777497663.530735:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564968704:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497663.531233:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497663.531238:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1777497663.651256:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497663.809264:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497663.809319:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497663.809344:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:2.0:1777497663.809361:0:3652:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546331904 offset 0 length 224: 4 00000100:00100000:2.0:1777497663.809384:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497663.809414:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332288 00000100:00100000:2.0:1777497663.809423:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332288 00000100:00100000:2.0:1777497663.809523:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332416 00000100:00100000:2.0:1777497663.809526:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332416 00000100:00100000:2.0:1777497663.809565:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5879 00000100:00100000:2.0:1777497663.809576:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546332288:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1777497663.809606:0:25497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d375 00000100:00080000:2.0:1777497663.809614:0:25497:0:(import.c:65:import_set_state_nolock()) ffff92409c763800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497663.809657:0:25497:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969456 00000100:00100000:2.0:1777497663.809823:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+2:2411:x1863837546332288:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 248us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497663.809830:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5879 00000100:00100000:2.0:1777497663.809846:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5880 00000100:00100000:2.0:1777497663.809853:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546332416:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1777497663.809865:0:25497:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d37c 00000100:00080000:2.0:1777497663.809870:0:25497:0:(import.c:65:import_set_state_nolock()) ffff9240bb783800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497663.809895:0:25497:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969451 00000100:00100000:2.0:1777497663.809964:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+2:2411:x1863837546332416:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 111us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497663.809970:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5880 00000100:00100000:2.0:1777497663.810000:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332032 00000100:00100000:2.0:1777497663.810004:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332032 00000100:00100000:2.0:1777497663.810035:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332160 00000100:00100000:2.0:1777497663.810038:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332160 00000100:00100000:2.0:1777497663.810066:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1303 00000100:00100000:2.0:1777497663.810073:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+8:2413:x1863837546332160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497663.810131:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+8:2413:x1863837546332160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 59us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497663.810138:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1303 00000100:00100000:2.0:1777497663.810150:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1340 00000100:00100000:2.0:1777497663.810154:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546332032:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497663.810173:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497663.810195:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546332032:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 40us (942us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497663.810210:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1340 00000100:00080000:2.0:1777497663.810227:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497663.810230:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497663.810232:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497663.810247:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497663.810349:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497663.842727:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497664.034203:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000020:01000004:2.0:1777497664.657216:0:88673:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1777497664.657221:0:88673:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1777497664.657223:0:88673:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1777497664.657337:0:88673:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9240a3af2000 00000020:01000004:2.0:1777497664.657353:0:88673:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1777497664.657367:0:88673:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1777497664.657675:0:88673:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9240a62e99c0) 00000020:00000080:3.0:1777497664.657696:0:88673:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00010000:00010000:3.0:1777497664.677373:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1777497664.785669:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1777497664.786521:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1777497664.795866:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.802454:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.802736:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.804272:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.804646:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.804855:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.806256:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.806887:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1777497664.807320:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.808206:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.808702:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.809504:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.810559:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.814549:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.815253:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.815607:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.815980:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.816554:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.817167:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.817465:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.817650:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.817831:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.818694:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.819056:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.819524:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.819751:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.819930:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.820314:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.820772:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.821223:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.821526:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.821815:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.837461:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.838120:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.838502:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.838785:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.839138:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.839404:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.839665:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.839919:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.841154:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.841558:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.841807:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.842119:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1777497664.844282:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1777497664.846925:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.847605:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1777497664.848245:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1777497664.848919:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1777497664.849639:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1777497664.849951:0:88673:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1777497664.851315:0:88673:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1777497664.851540:0:88673:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1777497664.851548:0:88673:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:2.0:1777497664.851559:0:88673:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d408 00000020:01000004:2.0:1777497664.851566:0:88673:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1777497664.851578:0:88673:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1777497664.851583:0:88673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a3af2000 from MGS 00000020:01000004:2.0:1777497664.851586:0:88673:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1777497664.851595:0:88673:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff924083168000) 00000020:00000080:2.0:1777497664.851608:0:88673:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:2.0:1777497664.851665:0:88673:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a3af2000 from MGS, refs=2 00080000:01000000:2.0:1777497664.851679:0:88673:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:2.0:1777497664.851684:0:88673:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d416 00010000:00010000:2.0:1777497664.851792:0:88673:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:2.0:1777497664.863228:0:88673:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00000100:00100000:2.0:1777497664.869224:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 10000000:01000000:2.0:1777497664.870782:0:88677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1777497664.871994:0:88673:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1777497664.872066:0:88673:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1777497664.872824:0:88673:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1777497664.873148:0:88673:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1777497664.873295:0:88673:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1777497664.873302:0:88673:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1777497664.880315:0:88673:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1777497664.880335:0:88673:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1777497664.880843:0:88673:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1777497664.880849:0:88673:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1777497664.898815:0:88673:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1777497664.898846:0:88673:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1777497664.898848:0:88673:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1777497664.898852:0:88673:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i0:r0:or0:FULL 00000100:00080000:2.0:1777497664.898859:0:88673:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1777497664.898866:0:88673:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1777497664.898869:0:88673:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1777497664.898871:0:88673:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1777497664.898879:0:88673:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240b5699c00 x1863837564963840/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497665 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497664.898904:0:88673:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240b5698380 x1863837564965888/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497670 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497664.898923:0:88673:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff924086dbe300 x1863837564967424/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497675 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1777497664.898941:0:88673:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1777497664.898944:0:88673:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1777497664.898945:0:88673:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1777497664.898948:0:88673:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1777497664.899128:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564967424:0@lo:400:kworker.0 00000100:00100000:0.0:1777497664.899225:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564965888:0@lo:400:kworker.0 00000100:00100000:1.0:1777497664.899512:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564963840:0@lo:400:kworker.0 10000000:01000000:2.0:1777497664.899616:0:88673:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1777497664.899631:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899642:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899648:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1777497664.899678:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899687:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dd600/0x3e357265691cfee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cff5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899703:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899710:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899716:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899719:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899757:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fec00/0x3e357265691cf54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cf5b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899765:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899771:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899776:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899779:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899782:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe000/0x3e357265691cf70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cf77 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899789:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899795:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899812:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899815:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899818:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35200/0x3e357265691cf9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfa1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899825:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899831:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899836:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899840:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899843:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b34400/0x3e357265691cfa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfaf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899850:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899855:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899859:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899862:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899865:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691cfc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899873:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899888:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899893:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899896:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899899:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dda00/0x3e357265691cfd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899907:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899912:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899916:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899919:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899922:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691cffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d003 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899933:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899939:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899945:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899948:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.899950:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe400/0x3e357265691cf62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cf69 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.899983:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.899989:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.899994:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497664.899998:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.900009:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691cf7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cf85 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.900021:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.900027:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.900032:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497664.900035:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.900038:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eefe00/0x3e357265691cf8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cf93 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.900045:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.900051:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.900056:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497664.900064:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.900069:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240866dc800/0x3e357265691cfb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.900077:0:88673:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497664.900082:0:88673:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497664.900086:0:88673:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497664.900090:0:88673:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497664.900121:0:88673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88b35c00/0x3e357265691cfe0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691cfe7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497664.900136:0:88673:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 70, was 0): DISCONN 00000100:00080000:2.0:1777497664.900142:0:88673:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497664.900147:0:88673:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3742 00000100:00080000:2.0:1777497664.900153:0:88673:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497664.900181:0:88673:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5691f80 x1863837564968832/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497664.900250:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564968832:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1777497664.900315:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497664.900408:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968832 00000100:00100000:0.0:1777497664.900415:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968832 00000100:00100000:0.0:1777497664.900445:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1777497664.900452:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3656:x1863837564968832:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1777497664.900474:0:88679:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:0.0:1777497664.900498:0:88679:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691d41d 00000100:00080000:0.0:1777497664.900602:0:88679:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1777497664.900811:0:88673:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:0.0:1777497664.904074:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837564968832:12345-0@lo:250:mount.lustre.0 Request processed in 3612us (3748us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497664.904128:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1777497664.907560:0:3656:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 27 00000100:00080000:3.0:1777497664.907575:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:3.0:1777497664.907583:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1777497664.907589:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1777497664.907593:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1777497664.907597:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1777497664.907679:0:3656:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1777497664.907697:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837564968832:0@lo:250:mount.lustre.0 00000100:00080000:0.0:1777497664.907788:0:88673:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:0.0:1777497664.907801:0:88673:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1777497664.907842:0:88673:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1777497664.907847:0:88673:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1777497664.907950:0:88673:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:0.0:1777497664.907996:0:88673:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1777497664.907999:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1777497664.908010:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497664.908011:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497664.908012:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497664.908013:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497664.908027:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497664.908028:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497664.908030:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497664.908032:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497664.908033:0:88673:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1777497664.908036:0:88673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1777497664.908038:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777497664.908039:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497664.908040:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497664.908041:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497664.908042:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497664.908042:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497664.908043:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497664.908044:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497664.908046:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497664.908047:0:88673:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1777497664.908071:0:88673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1777497664.908087:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564968960:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777497664.908193:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497664.908224:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a300 going to sleep for 11 seconds 00000020:01000000:2.0:1777497664.908358:0:38121:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:2.0:1777497664.908369:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:2.0:1777497664.908371:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497664.908373:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497664.908374:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497664.908375:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497664.908376:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497664.908377:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497664.908379:0:38121:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497664.908380:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497664.908386:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497664.908424:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1777497664.908432:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:2.0:1777497664.908434:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497664.908435:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1777497664.908436:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497664.908437:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497664.908438:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497664.908439:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497664.908440:0:38121:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497664.908441:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497664.908442:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497664.908463:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:2.0:1777497664.908468:0:38121:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:2.0:1777497664.908470:0:38121:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:2.0:1777497664.908471:0:38121:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777497664.908472:0:38121:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497664.908473:0:38121:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497664.908474:0:38121:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497664.908475:0:38121:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497664.908476:0:38121:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497664.908478:0:38121:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497664.908479:0:38121:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:2.0:1777497664.908491:0:38121:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:2.0:1777497664.908512:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564969216:0@lo:253:kworker.0 00000100:00100000:2.0:1777497664.908545:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497664.908561:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497664.908566:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564969344:0@lo:253:kworker.0 00000100:00100000:2.0:1777497664.908588:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497664.908620:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564968960 00000100:00100000:2.0:1777497664.908627:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564968960 00000100:00100000:2.0:1777497664.908654:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969216 00000100:00100000:2.0:1777497664.908657:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969216 00000100:00100000:2.0:1777497664.908665:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969344 00000100:00100000:2.0:1777497664.908668:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969344 00000100:00100000:2.0:1777497664.908679:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1777497664.908693:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:88673:x1863837564968960:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1777497664.908735:0:88680:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497664.908738:0:88680:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1777497664.908740:0:88680:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1777497664.908891:0:88682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1777497664.909629:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564969088:0@lo:253:kworker.0 00000100:00100000:0.0:1777497664.909685:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497664.909740:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969088 00000100:00100000:0.0:1777497664.909746:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969088 00000100:00100000:0.0:1777497664.909769:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1777497664.909775:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564969216:12345-0@lo:253:kworker.0 20000000:01000000:0.0:1777497664.909797:0:88679:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1777497664.910125:0:88680:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 116 20000000:01000000:3.0:1777497664.913249:0:88683:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1777497664.913256:0:88683:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1777497664.913259:0:88683:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1777497664.913262:0:88683:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1777497664.913532:0:88683:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1777497664.913735:0:88680:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497664.913756:0:88680:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1777497664.913920:0:88679:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1777497664.916029:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88673:x1863837564968960:12345-0@lo:253:mount.lustre.0 Request processed in 7310us (7809us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497664.916042:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1777497664.916141:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1777497664.916153:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837564969344:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1777497664.916186:0:88680:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1777497664.916355:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564968960:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1777497664.916368:0:88673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1777497664.916372:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1777497664.916373:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1777497664.916374:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497664.916375:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497664.916376:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497664.916377:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497664.916378:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1777497664.916380:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1777497664.916381:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497664.916383:0:88673:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1777497664.916403:0:88673:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9240a3af2000 from lustre-MDT0000 10000000:01000000:1.0:1777497664.916433:0:88673:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1777497664.916436:0:88673:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777497664.916444:0:88673:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9240a3af2000 10000000:01000000:1.0:1777497664.916448:0:88673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1777497664.916453:0:88673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9240a3af2000 10000000:01000000:1.0:1777497664.916456:0:88673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1777497664.916459:0:88673:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240a3af2000 from 1 10000000:01000000:1.0:1777497664.916462:0:88673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1777497664.916491:0:88673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.916502:0:88673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.916511:0:88673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497664.916539:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969472:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497664.916573:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497664.916599:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004d80 going to sleep for 11 seconds 20000000:01000000:0.0:1777497664.916691:0:88679:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497664.916703:0:88679:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1777497664.916832:0:88681:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:3.0:1777497664.916840:0:88681:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 20000000:01000000:1.0:1777497664.917206:0:88682:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1777497664.917211:0:88682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1777497664.917227:0:88682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917241:0:88682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497664.917250:0:88682:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000039456s 00010000:00010000:1.0:1777497664.917254:0:88682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917259:0:88682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917265:0:88682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917271:0:88682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917276:0:88682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497664.917280:0:88682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917286:0:88682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917310:0:88682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917317:0:88682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.917323:0:88682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734400/0x3e357265691d42b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497664.917550:0:88680:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1777497664.917745:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969472 00000100:00100000:0.0:1777497664.917753:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969472 00000100:00100000:3.0:1777497664.917877:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1777497664.917886:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564969088:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497664.917914:0:88684:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 00000100:00100000:2.0:1777497664.918057:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837564969216:12345-0@lo:253:kworker.0 Request processed in 8280us (9511us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497664.918064:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1777497664.918139:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1777497664.918146:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:88673:x1863837564969472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497664.918155:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497664.918169:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902ae00/0x3e357265691d432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d424 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.918187:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902ae00/0x3e357265691d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d424 expref: 7 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.918195:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902ae00/0x3e357265691d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d424 expref: 7 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.918214:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ae00, rc 0) 00000100:00100000:2.0:1777497664.918241:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88673:x1863837564969472:12345-0@lo:101:mount.lustre.0 Request processed in 95us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497664.918246:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1777497664.918390:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969472:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497664.918408:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.918416:0:88673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497664.918432:0:88673:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1777497664.918448:0:88673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.918455:0:88673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497664.918462:0:88673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777497664.918466:0:88673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777497664.918471:0:88673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9240a3af2000 10000000:01000000:1.0:1777497664.918473:0:88673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777497664.918476:0:88673:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777497664.918484:0:88673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497664.918507:0:88673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.918514:0:88673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.918520:0:88673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497664.918536:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497664.918567:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497664.918593:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497664.922162:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969600 00000100:00100000:3.0:1777497664.922176:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969600 00000100:00100000:3.0:1777497664.922232:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1777497664.922242:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88673:x1863837564969600:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497664.922259:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497664.922284:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d439 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497664.922326:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d439 expref: 8 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497664.922336:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d439 expref: 8 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497664.922345:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39000, rc 0) 00000100:00100000:3.0:1777497664.922419:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564969600:12345-0@lo:101:mount.lustre.0 Request processed in 178us (3851us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497664.922425:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000020:01000004:0.0:1777497664.924178:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777497664.924183:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1777497664.924185:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497664.924186:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497664.924187:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497664.924190:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497664.924191:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1777497664.924193:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497664.924195:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777497664.924200:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564969216:0@lo:253:kworker.0 00000100:00100000:1.0:1777497664.924578:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497664.924599:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497664.924612:0:88673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497664.924699:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497664.924753:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497664.924783:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497664.924923:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969728 00000100:00100000:0.0:1777497664.924930:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969728 00000100:00100000:0.0:1777497664.924987:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1777497664.924996:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564969728:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1777497664.925191:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564969728:12345-0@lo:501:mount.lustre.0 Request processed in 196us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497664.925198:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1777497664.925653:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969728:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497664.925691:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497664.925744:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497664.925769:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497664.926089:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969856 00000100:00100000:0.0:1777497664.926119:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969856 00000100:00100000:0.0:1777497664.926144:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1777497664.926150:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564969856:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497664.927861:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564969856:12345-0@lo:503:mount.lustre.0 Request processed in 1703us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497664.927872:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1777497664.927992:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564969856:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497664.930162:0:88685:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88685:1863837564969984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497664.930252:0:88685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497664.930291:0:88685:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f860049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497664.930467:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564969984 00000100:00100000:2.0:1777497664.930476:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564969984 00000100:00100000:2.0:1777497664.930522:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1777497664.930531:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88685:x1863837564969984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497664.931903:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88685:x1863837564969984:12345-0@lo:502:llog_process_th.0 Request processed in 1366us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497664.931914:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1777497664.932051:0:88685:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86068380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88685:1863837564969984:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497664.932084:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497664.932122:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497664.932124:0:88685:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777497664.932130:0:88685:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1777497664.932134:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497664.932149:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9240a6bf19c0) 00000020:00000080:1.0:1777497664.932172:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1777497664.932176:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1777497664.932255:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:1.0:1777497664.932261:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d44e 00000020:00000080:1.0:1777497664.932469:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1777497664.932474:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497664.932478:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497664.932479:0:88685:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777497664.932482:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497664.932485:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497664.932486:0:88685:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1777497664.932490:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497664.932496:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9240a6bf3380) 00000020:00000080:1.0:1777497664.932507:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1777497664.932510:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1777497664.932512:0:88685:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1777497664.932515:0:88685:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1777497664.932520:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1777497664.932560:0:88685:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a3af2000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1777497664.932572:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9240a6bf0000) 00000020:00000080:1.0:1777497664.932593:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1777497664.932647:0:88685:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:1.0:1777497664.932656:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d463 00000020:00000080:1.0:1777497664.932755:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1777497664.932761:0:88685:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1777497664.932766:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691d46a 00080000:01000000:1.0:1777497664.932770:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:1.0:1777497664.932773:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d471 20000000:01000000:0.0:1777497664.935634:0:88680:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497664.935649:0:88680:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1777497664.935755:0:88682:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497664.935761:0:88682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497664.935783:0:88682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935802:0:88682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497664.935812:0:88682:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000051766s 00010000:00010000:2.0:1777497664.935817:0:88682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935823:0:88682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935830:0:88682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935848:0:88682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935854:0:88682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497664.935858:0:88682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935866:0:88682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935880:0:88682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935889:0:88682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.935895:0:88682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902ac00/0x3e357265691d478 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497664.936288:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:3659:x1863837564969344:12345-0@lo:253:kworker.0 Request processed in 20135us (27694us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497664.936299:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1777497664.936431:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:2.0:1777497664.936434:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1777497664.936435:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497664.936436:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497664.936437:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497664.936439:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497664.936440:0:3659:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497664.936442:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497664.936443:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1777497664.936446:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564969344:0@lo:253:kworker.0 20000000:01000000:1.0:1777497664.937946:0:88684:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1777497664.947905:0:88684:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497664.947924:0:88684:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1777497664.948330:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3658:x1863837564969088:12345-0@lo:253:kworker.0 Request processed in 30441us (38640us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497664.948346:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:3.0:1777497664.948441:0:3658:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497664.948445:0:3658:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497664.948446:0:3658:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497664.948447:0:3658:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497664.948448:0:3658:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497664.948450:0:3658:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497664.948451:0:3658:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497664.948453:0:3658:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497664.948454:0:3658:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497664.948457:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564969088:0@lo:253:kworker.0 20000000:01000000:2.0:1777497664.948520:0:88682:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497664.948525:0:88682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1777497664.948546:0:88682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948571:0:88682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1777497664.948580:0:88682:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000056339s 00010000:00010000:2.0:1777497664.948585:0:88682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948591:0:88682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948599:0:88682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948606:0:88682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948612:0:88682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497664.948616:0:88682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948623:0:88682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948635:0:88682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948643:0:88682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497664.948649:0:88682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902ac00/0x3e357265691d47f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.030708:0:88685:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:3.0:1777497665.031285:0:88685:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 0 srv lr: 111669149699 lx: 0 gen 21 00000001:00080000:3.0:1777497665.031326:0:88685:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: d146155b-4321-4b14-9284-f644ed9631fb idx: 2 lr: 0 srv lr: 111669149699 lx: 0 gen 23 00000001:00000004:3.0:1777497665.031344:0:88685:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 111669149699 00000001:00080000:3.0:1777497665.031632:0:88685:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:3.0:1777497665.031690:0:88685:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff92408a013e40: xid 1863837564957440, transno 111669149699, client gen 21, slot idx 1 00000020:00000080:3.0:1777497665.032273:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9240a62e8000) 00000020:00000080:3.0:1777497665.032292:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:3.0:1777497665.032373:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:3.0:1777497665.032380:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d49b 00000020:00000080:0.0:1777497665.033336:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1777497665.041257:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691d4a2 00000020:00000080:1.0:1777497665.041992:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1777497665.042012:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497665.042423:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.042427:0:88685:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1777497665.042432:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497665.042435:0:88685:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1777497665.042436:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497665.042438:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497665.042439:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497665.042442:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.042443:0:88685:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497665.042446:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497665.042451:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.042452:0:88685:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1777497665.042457:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1777497665.042509:0:88685:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1777497665.042532:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497665.042535:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.042537:0:88685:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1777497665.042547:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497665.042550:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.042552:0:88685:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1777497665.042554:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497665.042560:0:88685:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:1.0:1777497665.042584:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497665.042602:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240911fcd40) 00000020:00000080:1.0:1777497665.042623:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1777497665.042627:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497665.042685:0:88685:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1777497665.042690:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:1.0:1777497665.042697:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d4b0 00010000:00080000:1.0:1777497665.042729:0:88685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f81b71800@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497665.044949:0:88685:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:0.0:1777497665.046832:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497665.046845:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1777497665.046882:0:88685:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1777497665.046902:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4b7 00000100:00080000:0.0:1777497665.046912:0:88685:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497665.046918:0:88685:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff923f81b71800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.046951:0:88685:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a5180 x1863837564970112/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.048862:0:88685:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1777497665.048895:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497665.048900:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497665.048903:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497665.048910:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1777497665.048914:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777497665.048920:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.048950:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a6d80 x1863837564970240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.049165:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497665.049168:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497665.049170:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497665.049174:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1777497665.049177:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777497665.049180:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.049192:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a5880 x1863837564970496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.049206:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497665.049209:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497665.049210:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497665.049213:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1777497665.049215:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497665.049218:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.049228:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a4700 x1863837564970752/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.049264:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497665.049268:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497665.049269:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497665.049273:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3789 00000100:00080000:0.0:1777497665.049275:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1777497665.049278:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.049288:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f841a7b80 x1863837564971136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497665.049329:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564970368:0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049391:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.049423:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497665.049428:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564970624:0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049449:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.049486:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564971008:0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049512:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.049531:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497665.049536:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564970880:0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049554:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.049580:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970368 00000100:00100000:0.0:1777497665.049587:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970368 00000100:00100000:0.0:1777497665.049632:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970624 00000100:00100000:0.0:1777497665.049635:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970624 00000100:00100000:0.0:1777497665.049658:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1777497665.049666:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564970368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049716:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564970368:12345-0@lo:400:kworker.0 Request processed in 51us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.049723:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1777497665.049739:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1777497665.049745:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564970624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049772:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564970624:12345-0@lo:400:kworker.0 Request processed in 28us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.049778:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1777497665.049800:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971008 00000100:00100000:0.0:1777497665.049809:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971008 00000100:00100000:0.0:1777497665.049836:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970880 00000100:00100000:0.0:1777497665.049839:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970880 00000100:00100000:0.0:1777497665.049855:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1777497665.049861:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564971008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049892:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564971008:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.049898:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00100000:0.0:1777497665.049908:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2600 00000100:00100000:0.0:1777497665.049913:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564970880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497665.049938:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564970880:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.049944:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2600 00000100:00080000:0.0:1777497665.049976:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497665.049981:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497665.049983:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497665.050639:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564970112:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777497665.052628:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564970880:0@lo:400:kworker.0 00000100:00100000:1.0:1777497665.053027:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.053078:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564970240:0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053146:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.053167:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564970496:0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053188:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.053207:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564970752:0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053227:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.053245:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564971136:0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053265:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.053312:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970240 00000100:00100000:1.0:1777497665.053318:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970240 00000100:00100000:1.0:1777497665.053344:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970496 00000100:00100000:1.0:1777497665.053346:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970496 00000100:00100000:1.0:1777497665.053375:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971136 00000100:00100000:1.0:1777497665.053378:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971136 00000100:00100000:1.0:1777497665.053395:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1777497665.053403:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564970240:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053460:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564970240:12345-0@lo:38:kworker.0 Request processed in 58us (313us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497665.053467:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1777497665.053483:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1777497665.053487:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564970496:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053514:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564970496:12345-0@lo:38:kworker.0 Request processed in 25us (324us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497665.053519:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1777497665.053527:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1777497665.053531:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564971136:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053555:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564971136:12345-0@lo:38:kworker.0 Request processed in 23us (290us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497665.053559:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:1.0:1777497665.053578:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970112 00000100:00100000:1.0:1777497665.053582:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970112 00000100:00100000:1.0:1777497665.053595:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564970752 00000100:00100000:1.0:1777497665.053598:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564970752 00000100:00100000:1.0:1777497665.053611:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1777497665.053615:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564970112:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1777497665.053634:0:8406:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:1.0:1777497665.053669:0:8406:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4be 00000004:00100000:1.0:1777497665.053683:0:8406:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497665.053782:0:8406:0:(import.c:65:import_set_state_nolock()) ffff923f839d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497665.053820:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564970112:12345-0@lo:38:llog_process_th.0 Request processed in 203us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.053834:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3993 00000100:00100000:1.0:1777497665.053846:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1777497665.053850:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564970752:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.053878:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564970752:12345-0@lo:38:kworker.0 Request processed in 27us (649us total) trans 0 rc -11/-11 00000100:00100000:1.0:1777497665.053883:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3994 00000100:00100000:1.0:1777497665.053918:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497665.053926:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:1.0:1777497665.053933:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1777497665.053938:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1777497665.053941:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81b71800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497665.053948:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564970112:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1777497665.053959:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497665.053963:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497665.053966:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564970240:0@lo:38:kworker.0 00000100:00080000:1.0:1777497665.053973:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497665.053975:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497665.053977:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564970496:0@lo:38:kworker.0 00000100:00080000:1.0:1777497665.053986:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497665.053988:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497665.053990:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564970752:0@lo:38:kworker.0 00000100:00080000:1.0:1777497665.054015:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497665.054019:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497665.054028:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564971136:0@lo:38:kworker.0 00000100:00100000:1.0:1777497665.054173:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497665.054183:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564971264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497665.054213:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.054236:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971264 00000100:00100000:1.0:1777497665.054240:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971264 00000100:00100000:1.0:1777497665.054264:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1777497665.054270:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564971264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497665.054296:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:1.0:1777497665.054329:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564971264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.054335:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3995 00000100:00100000:1.0:1777497665.054364:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8606b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564971264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497665.054805:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564971008:0@lo:400:kworker.0 00000020:01000000:0.0:1777497665.055260:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497665.055267:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.055269:0:88685:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1777497665.055271:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777497665.055274:0:88685:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1777497665.055276:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497665.055277:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497665.055278:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777497665.055280:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.055281:0:88685:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1777497665.055283:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1777497665.055298:0:88685:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1777497665.055302:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.055303:0:88685:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1777497665.055306:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1777497665.055310:0:88685:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:0.0:1777497665.055332:0:88685:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1777497665.055335:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497665.055350:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9240aecdb380) 00000020:00000080:0.0:1777497665.055371:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1777497665.055376:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1777497665.055452:0:88685:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1777497665.055459:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:0.0:1777497665.055466:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d4cc 00010000:00080000:0.0:1777497665.055503:0:88685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240bb6f7000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497665.055711:0:88685:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1777497665.056360:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564970624:0@lo:400:kworker.0 00000100:00100000:2.0:1777497665.056378:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564970368:0@lo:400:kworker.0 00000100:00100000:2.0:1777497665.058329:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:3.0:1777497665.060646:0:63737:0:(service.c:3443:ptlrpc_start_thread()) mdt_seqm[-1] started 2 min 2 max 256 00000100:00100000:3.0:1777497665.060667:0:63737:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'mdt_seqm_0002' 00000040:01000000:1.0:1777497665.062410:0:88685:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777497665.062651:0:88685:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1777497665.069647:0:88685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497665.072154:0:88685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].27, 64 off9920 00000040:00080000:0.0:1777497665.081828:0:88685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6c:0x0].1, 64 off8256 00000040:00080000:2.0:1777497665.084491:0:88692:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1777497665.084498:0:88692:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1777497665.086632:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497665.086647:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1777497665.086690:0:88685:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1777497665.086710:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4d3 00000100:00080000:0.0:1777497665.086721:0:88685:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497665.086727:0:88685:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240bb6f7000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.086762:0:88685:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d96d80 x1863837564971392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.086793:0:88685:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1777497665.086916:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497665.086921:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.086923:0:88685:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1777497665.086931:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1777497665.086934:0:88685:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1777497665.086936:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497665.086937:0:88685:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1777497665.086938:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1777497665.086941:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.086942:0:88685:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1777497665.086945:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1777497665.086949:0:88685:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1777497665.086952:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497665.086953:0:88685:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1777497665.086956:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1777497665.086960:0:88685:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:0.0:1777497665.086984:0:88685:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1777497665.086987:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1777497665.087008:0:88685:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9240aecd99c0) 00000020:00000080:0.0:1777497665.087034:0:88685:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:0.0:1777497665.087039:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1777497665.087126:0:88685:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1777497665.087132:0:88685:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:0.0:1777497665.087140:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691d4e1 00010000:00080000:0.0:1777497665.087171:0:88685:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f86084000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497665.087369:0:88685:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:0.0:1777497665.087441:0:88685:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1777497665.087456:0:88685:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1777497665.087662:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564971392:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1777497665.087728:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.088491:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971392 00000100:00100000:0.0:1777497665.088500:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971392 00000100:00100000:0.0:1777497665.088542:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1777497665.088549:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:3656:x1863837564971392:12345-0@lo:8:llog_process_th.0 00010000:00080000:0.0:1777497665.088579:0:25487:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:0.0:1777497665.088603:0:25487:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4e8 00002000:00100000:0.0:1777497665.088625:0:25487:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff923f82ab1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1777497665.088629:0:25487:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1777497665.088632:0:25487:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1777497665.088690:0:25487:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1777497665.088712:0:25487:0:(import.c:65:import_set_state_nolock()) ffff923f82ab6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497665.088772:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564971392:12345-0@lo:8:llog_process_th.0 Request processed in 223us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.088780:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5881 00000100:00100000:0.0:1777497665.088822:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777497665.088830:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777497665.088836:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777497665.088841:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1777497665.088843:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777497665.088856:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777497665.088861:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564971392:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1777497665.088884:0:88692:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777497665.088930:0:88692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3794429834934ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777497665.088936:0:88692:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1777497665.096862:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564971520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497665.096968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.098499:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971520 00000100:00100000:0.0:1777497665.098511:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971520 00000100:00100000:0.0:1777497665.098583:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1777497665.098592:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564971520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497665.098623:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497665.098690:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564971520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.098697:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:0.0:1777497665.098746:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564971520:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1777497665.098884:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1777497665.101236:0:88674:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000040:00080000:1.0:1777497665.101374:0:88685:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497665.104369:0:88685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].27, 64 off9920 00000040:00080000:1.0:1777497665.104569:0:88685:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6e:0x0].1, 64 off8256 00000040:00080000:2.0:1777497665.107306:0:88694:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 27 synced_idx: 27 lgh_last_idx: 27 00000040:00080000:2.0:1777497665.107313:0:88694:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1777497665.110751:0:88685:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497665.110766:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777497665.110809:0:88685:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1777497665.110827:0:88685:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4ef 00000100:00080000:1.0:1777497665.110837:0:88685:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497665.110843:0:88685:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff923f86084000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497665.110877:0:88685:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f86069c00 x1863837564971648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497665.110912:0:88685:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1777497665.110986:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497665.110991:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.110993:0:88685:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1777497665.110995:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497665.111010:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.111011:0:88685:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1777497665.111015:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1777497665.111017:0:88685:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1777497665.111019:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497665.111021:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.111022:0:88685:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1777497665.111024:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497665.111027:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.111028:0:88685:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1777497665.111032:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1777497665.111065:0:88685:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88685:1863837564971776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497665.111181:0:88685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.111216:0:88685:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240885a2540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497665.111393:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971776 00000100:00100000:0.0:1777497665.111400:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971776 00000100:00100000:0.0:1777497665.111439:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777497665.111449:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88685:x1863837564971776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497665.111579:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88685:x1863837564971776:12345-0@lo:502:llog_process_th.0 Request processed in 131us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.111586:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1777497665.111630:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564971648:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1777497665.111663:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.111812:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971648 00000100:00100000:3.0:1777497665.111817:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971648 00000100:00100000:3.0:1777497665.111846:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5882 00000100:00100000:3.0:1777497665.111851:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3656:x1863837564971648:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1777497665.111875:0:25486:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3794 last 0 00000020:00000080:3.0:1777497665.111902:0:25486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691d4f6 00002000:00100000:3.0:1777497665.111915:0:25486:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff923f88a8a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1777497665.111919:0:25486:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1777497665.111922:0:25486:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1777497665.111988:0:25486:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1777497665.112019:0:25486:0:(import.c:65:import_set_state_nolock()) ffff923f88a8f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497665.112064:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837564971648:12345-0@lo:8:llog_process_th.0 Request processed in 212us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.112071:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5882 00000100:00100000:0.0:1777497665.112443:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1777497665.112451:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1777497665.112459:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1777497665.112464:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1777497665.112466:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f86084000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1777497665.112485:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:0.0:1777497665.112491:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837564971648:0@lo:8:llog_process_th.0 00000004:00080000:2.0:1777497665.112550:0:88694:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1777497665.112602:0:88694:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3794453506281ns, next at 0ns, rc = 0 00080000:00080000:2.0:1777497665.112607:0:88694:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1777497665.113557:0:88685:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88685:1863837564971776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497665.113594:0:88685:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497665.113600:0:88685:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497665.113603:0:88685:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1777497665.113607:0:88685:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1777497665.113890:0:88673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1777497665.113913:0:88673:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1777497665.113936:0:88673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.113947:0:88673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497665.113963:0:88673:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a3af2000 from 1 10000000:01000000:2.0:1777497665.113966:0:88673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777497665.113994:0:88673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.114011:0:88673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.114035:0:88673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497665.114053:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497665.114151:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497665.114182:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff924089f89300 going to sleep for 11 seconds 00000100:00100000:0.0:1777497665.114397:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564971904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497665.114428:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.114463:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972032 00000100:00100000:0.0:1777497665.114469:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972032 00000100:00100000:0.0:1777497665.114503:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1777497665.114511:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:88673:x1863837564972032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497665.114524:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497665.114538:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d4fd expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497665.114572:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d4fd expref: 8 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497665.114582:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d4fd expref: 8 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497665.114591:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8800, rc 0) 00000100:00100000:0.0:1777497665.114632:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564972032:12345-0@lo:101:mount.lustre.0 Request processed in 113us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.114639:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1777497665.114880:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564971904 00000100:00100000:2.0:1777497665.114884:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564971904 00000100:00100000:2.0:1777497665.114931:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1777497665.114938:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564971904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497665.114968:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497665.115020:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564971904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497665.115026:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:2.0:1777497665.115082:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564971904:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497665.115265:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497665.115280:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.115289:0:88673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497665.115811:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972160:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1777497665.115854:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497665.115869:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff924089f89300 going to sleep for 11 seconds 00000100:00080000:0.0:1777497665.116411:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497665.116426:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972160 00000100:00100000:0.0:1777497665.116432:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972160 00000100:00100000:0.0:1777497665.116472:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1777497665.116480:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564972160:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1777497665.116499:0:88681:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1777497665.116516:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1777497665.116519:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1777497665.116522:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1777497665.116744:0:88681:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 119 00000100:00100000:0.0:1777497665.116846:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564972160:12345-0@lo:256:mount.lustre.0 Request processed in 366us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.116853:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1777497665.117213:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972160:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1777497665.118491:0:88673:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777497665.118520:0:88673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.118532:0:88673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497665.118579:0:88673:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240a3af2000 from 1 10000000:01000000:2.0:1777497665.118582:0:88673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497665.118618:0:88673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.118627:0:88673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.118636:0:88673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497665.118658:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497665.118712:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497665.118784:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff924089f89300 going to sleep for 11 seconds 00000004:00080000:2.0:1777497665.119937:0:88674:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:1.0:1777497665.129634:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972288 00000100:00100000:1.0:1777497665.129651:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972288 00000100:00100000:1.0:1777497665.129717:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1777497665.129728:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:88673:x1863837564972288:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497665.129747:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497665.129782:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89734400/0x3e357265691d512 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d50b expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.129810:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734400/0x3e357265691d512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d50b expref: 9 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.129821:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89734400/0x3e357265691d512 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d50b expref: 9 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.129845:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734400, rc 0) 00000100:00100000:1.0:1777497665.129926:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972288:12345-0@lo:101:mount.lustre.0 Request processed in 200us (11213us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.129932:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1777497665.130149:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497665.130168:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.130178:0:88673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497665.130272:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497665.130304:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.130336:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497665.130656:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972416 00000100:00100000:1.0:1777497665.130662:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972416 00000100:00100000:1.0:1777497665.130687:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1777497665.130694:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972416:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497665.130817:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972416:12345-0@lo:501:mount.lustre.0 Request processed in 123us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.130824:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1777497665.130903:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972416:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497665.130933:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497665.130982:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.131024:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013300 going to sleep for 11 seconds 00000100:00100000:0.0:1777497665.131203:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972544 00000100:00100000:0.0:1777497665.131207:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972544 00000100:00100000:0.0:1777497665.131245:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1777497665.131253:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972544:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497665.131337:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972544:12345-0@lo:503:mount.lustre.0 Request processed in 85us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.131343:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1777497665.131506:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972544:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497665.131872:0:88696:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88696:1863837564972672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497665.131910:0:88696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.131939:0:88696:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86004d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497665.132118:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972672 00000100:00100000:0.0:1777497665.132123:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972672 00000100:00100000:0.0:1777497665.132149:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1777497665.132156:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88696:x1863837564972672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497665.132589:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88696:x1863837564972672:12345-0@lo:502:llog_process_th.0 Request processed in 432us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.132597:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1777497665.132693:0:88696:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88696:1863837564972672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497665.132720:0:88696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497665.132730:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497665.132732:0:88696:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1777497665.132739:0:88696:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a3af2000 00000020:00000080:3.0:1777497665.132742:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1777497665.132751:0:88696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497665.132753:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497665.132755:0:88696:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1777497665.132757:0:88696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497665.132759:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497665.132760:0:88696:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1777497665.132763:0:88696:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9240a3af2000 00000020:00000080:3.0:1777497665.132765:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1777497665.132840:0:88696:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88696:1863837564972800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497665.132874:0:88696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.132898:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972800 00000100:00100000:3.0:1777497665.132907:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972800 00000100:00100000:3.0:1777497665.132931:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1777497665.132937:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88696:x1863837564972800:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497665.133182:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88696:x1863837564972800:12345-0@lo:502:llog_process_th.0 Request processed in 244us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.133189:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1777497665.133225:0:88696:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497665.133238:0:88696:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88696:1863837564972800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497665.133258:0:88696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497665.133263:0:88696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497665.133264:0:88696:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1777497665.133268:0:88696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1777497665.133335:0:88673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1777497665.133355:0:88673:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777497665.133368:0:88673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133379:0:88673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497665.133422:0:88673:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1777497665.133425:0:88673:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9240a3af2000 10000000:01000000:3.0:1777497665.133428:0:88673:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9240a3af2000 10000000:01000000:3.0:1777497665.133433:0:88673:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1777497665.133439:0:88673:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240a3af2000 from 1 10000000:01000000:3.0:1777497665.133441:0:88673:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497665.133465:0:88673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133473:0:88673:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133488:0:88673:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497665.133500:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1777497665.133525:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.133537:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497665.133550:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564972928 00000100:00100000:3.0:1777497665.133553:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564972928 00000100:00100000:3.0:1777497665.133570:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497665.133575:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:88673:x1863837564972928:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497665.133584:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497665.133594:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d519 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133614:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d519 expref: 10 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133624:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d519 expref: 10 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133631:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39800, rc 0) 00000100:00100000:3.0:1777497665.133657:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564972928:12345-0@lo:101:mount.lustre.0 Request processed in 82us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.133664:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1777497665.133691:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564972928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497665.133703:0:88673:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.133720:0:88673:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497665.133762:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497665.133784:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.133795:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497665.133806:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973056 00000100:00100000:3.0:1777497665.133810:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973056 00000100:00100000:3.0:1777497665.133824:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1777497665.133829:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973056:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497665.133917:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973056:12345-0@lo:501:mount.lustre.0 Request processed in 86us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.133923:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1777497665.138112:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497665.138201:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497665.138284:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.138324:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408a013240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497665.138355:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973184 00000100:00100000:3.0:1777497665.138362:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973184 00000100:00100000:3.0:1777497665.138413:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1777497665.138422:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973184:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497665.138534:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973184:12345-0@lo:503:mount.lustre.0 Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.138541:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1777497665.138603:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497665.151850:0:88698:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497665.151932:0:88698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.152067:0:88698:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497665.152178:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973312 00000100:00100000:1.0:1777497665.152186:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973312 00000100:00100000:1.0:1777497665.152227:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497665.152237:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973312:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497665.152376:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973312:12345-0@lo:502:llog_process_th.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.152390:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497665.152448:0:88698:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973312:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1777497665.152506:0:88698:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1777497665.152521:0:88698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9240911f8000) 00000020:00000080:1.0:1777497665.152545:0:88698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1777497665.152704:0:88698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a3af2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497665.152709:0:88698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a3af2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497665.152711:0:88698:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a3af2000 4 00010000:00080000:1.0:1777497665.152739:0:88698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240bb6f6800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:0.0:1777497665.164591:0:88698:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:0.0:1777497665.164701:0:88698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1777497665.164748:0:88698:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1777497665.164761:0:88698:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691d52e 00000100:00080000:0.0:1777497665.164771:0:88698:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1777497665.164777:0:88698:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240bb6f6800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497665.164813:0:88698:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d95c00 x1863837564973440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497665.164845:0:88698:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1777497665.165327:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564973440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497665.165401:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.169652:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973440 00000100:00100000:0.0:1777497665.169666:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973440 00000100:00100000:0.0:1777497665.169732:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1777497665.169740:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564973440:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1777497665.169837:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837564973440:12345-0@lo:38:llog_process_th.0 Request processed in 95us (4434us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777497665.169845:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:1.0:1777497665.170349:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1777497665.170359:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497665.170365:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1777497665.170369:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564973440:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1777497665.171772:0:88698:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973568:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497665.171846:0:88698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497665.171892:0:88698:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240885a2600 going to sleep for 11 seconds 00000100:00100000:3.0:1777497665.171946:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973568 00000100:00100000:3.0:1777497665.171963:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973568 00000100:00100000:3.0:1777497665.172273:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1777497665.172285:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973568:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497665.172437:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973568:12345-0@lo:502:llog_process_th.0 Request processed in 154us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497665.172445:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1777497665.172525:0:88698:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497665.172568:0:88698:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497665.172613:0:88698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.172811:0:88698:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497665.172912:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973696 00000100:00100000:2.0:1777497665.172917:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973696 00000100:00100000:2.0:1777497665.172964:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1777497665.172978:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497665.173232:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88698:x1863837564973696:12345-0@lo:502:llog_process_th.0 Request processed in 255us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497665.173240:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1777497665.174214:0:88698:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88698:1863837564973696:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497665.174249:0:88698:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1777497665.174560:0:88673:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1777497665.174601:0:88673:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497665.174625:0:88673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497665.174636:0:88673:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1777497665.174684:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1777497665.174687:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497665.174688:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497665.174689:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497665.174691:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497665.174692:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497665.174693:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497665.174695:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497665.174697:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497665.174698:0:88673:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497665.174702:0:88673:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1777497665.174704:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1777497665.174705:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1777497665.174706:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497665.174707:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497665.174708:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497665.174709:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497665.174710:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497665.174711:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1777497665.174712:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497665.174713:0:88673:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1777497665.174735:0:88673:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1777497665.174751:0:88673:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973824:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1777497665.174803:0:88673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497665.174837:0:88673:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e629c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497665.178277:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973824 00000100:00100000:2.0:1777497665.178291:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973824 00000100:00100000:2.0:1777497665.178383:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1777497665.178395:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1777497665.178430:0:88684:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1777497665.178445:0:88684:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1777497665.180460:0:88684:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1777497665.180479:0:88684:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1777497665.180572:0:88682:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1777497665.180578:0:88682:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1777497665.180600:0:88682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.180618:0:88682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.180627:0:88682:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.180749:0:88682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497665.180764:0:88682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497665.180778:0:88682:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88682:1863837564973952:0@lo:104: 00000100:00100000:3.0:1777497665.180857:0:88682:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.180904:0:88682:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497665.181258:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:88673:x1863837564973824:12345-0@lo:253:mount.lustre.0 Request processed in 2864us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497665.181268:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1777497665.181372:0:88673:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:88673:1863837564973824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1777497665.181383:0:88673:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1777497665.181386:0:88673:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1777497665.181388:0:88673:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1777497665.181389:0:88673:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497665.181390:0:88673:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497665.181391:0:88673:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497665.181393:0:88673:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497665.181394:0:88673:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497665.181395:0:88673:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1777497665.181397:0:88673:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497665.181398:0:88673:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1777497665.181410:0:88673:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1777497665.182120:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564973952 00000100:00100000:0.0:1777497665.182129:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564973952 00000100:00100000:0.0:1777497665.182175:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1777497665.182194:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:88682:x1863837564973952:12345-0@lo:104: 00010000:00010000:0.0:1777497665.182220:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497665.182292:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497665.182299:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:88682:x1863837564973952:12345-0@lo:104: Request processed in 106us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497665.182306:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1777497665.182344:0:88682:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:88682:1863837564973952:0@lo:104: 00010000:00010000:1.0:1777497665.182363:0:88682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.182428:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497665.182435:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.182444:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497665.182448:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.182456:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497665.182463:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497665.182480:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497665.185541:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.185553:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497665.185586:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.185593:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902ac00/0x3e357265691d4fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d504 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497665.185611:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497665.185613:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497665.185615:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497665.185624:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497665.185814:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564974080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497665.185878:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497665.186127:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974080 00000100:00100000:1.0:1777497665.186136:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974080 00010000:00010000:1.0:1777497665.186165:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497665.186200:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1777497665.186209:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3659:x1863837564974080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497665.186221:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497665.186226:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186237:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186250:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8800/0x3e357265691d504 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d4fd expref: 10 pid: 88680 timeout: 3894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186263:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186272:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497665.186286:0:6501:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005709542s 00010000:00010000:1.0:1777497665.186290:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186296:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186318:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186324:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186330:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497665.186334:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186341:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186356:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186367:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497665.186404:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:3659:x1863837564974080:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.186411:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00010000:00010000:1.0:1777497665.186436:0:88682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186444:0:88682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497665.186450:0:88682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38600/0x3e357265691d535 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497665.190648:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564974080:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1777497665.206227:0:88673:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:0.0:1777497665.208914:0:88673:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1777497665.209236:0:88704:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:3.0:1777497665.209240:0:88704:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:3.0:1777497665.210262:0:88705:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1777497665.211046:0:88673:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1777497665.213777:0:88706:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974208:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497665.213855:0:88706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.213906:0:88706:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9d80 going to sleep for 11 seconds 00000040:00080000:2.0:1777497665.214039:0:88705:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1777497665.215311:0:88673:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1777497665.215353:0:88673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1777497665.217195:0:88673:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1777497665.217213:0:88673:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1777497665.217290:0:88673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1777497665.217777:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974208 00000100:00100000:1.0:1777497665.217799:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974208 00000100:00100000:1.0:1777497665.217850:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3996 00000100:00100000:1.0:1777497665.217859:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974208:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497665.218181:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974208:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 321us (4324us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.218189:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3996 00000100:00100000:3.0:1777497665.218373:0:88706:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974208:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1777497665.218415:0:88706:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1777497665.218456:0:88706:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497665.218494:0:88706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.218522:0:88706:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497665.219088:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974336 00000100:00100000:1.0:1777497665.219109:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974336 00000100:00100000:1.0:1777497665.219147:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3997 00000100:00100000:1.0:1777497665.219155:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497665.219263:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.219270:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3997 00000100:00100000:3.0:1777497665.219434:0:88706:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497665.219508:0:88706:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974464:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1777497665.219543:0:88706:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497665.219564:0:88706:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497665.220078:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974464 00000100:00100000:1.0:1777497665.220084:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974464 00000100:00100000:1.0:1777497665.220125:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3998 00000100:00100000:1.0:1777497665.220132:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974464:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1777497665.220192:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:88706:x1863837564974464:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497665.220198:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3998 00000040:00080000:2.0:1777497665.221519:0:88705:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1777497665.221600:0:88705:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1777497665.221881:0:88706:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:88706:1863837564974464:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1777497665.221943:0:88706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497665.223981:0:88706:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1777497665.224076:0:88706:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1777497665.224082:0:88706:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1777497665.224537:0:88673:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1777497665.225089:0:88673:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1777497665.225153:0:88673:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1777497665.225265:0:88673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1777497665.225741:0:88673:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/32) registered 00010000:00080000:0.0:1777497665.232567:0:88673:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 111669149699 00010000:00080000:3.0:1777497665.234090:0:88707:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 88707 00010000:02000000:3.0:1777497665.234252:0:88707:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:3.0:1777497665.234256:0:88707:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1777497665.234260:0:88707:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:0.0:1777497665.234335:0:88673:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1777497665.234353:0:88673:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1777497665.234370:0:88673:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:0.0:1777497665.234387:0:88673:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1777497665.235443:0:88673:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1777497665.235680:0:88673:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497665.698309:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497665.891593:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497666.083829:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 10000000:01000000:0.0:1777497666.274176:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497666.274184:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240a3af2000 from 120 10000000:01000000:0.0:1777497666.274190:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497666.274257:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.274269:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.274281:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.274306:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.274382:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.274423:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.274504:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974592 00000100:00100000:1.0:1777497666.274511:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974592 00000100:00100000:1.0:1777497666.274558:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1777497666.274567:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837564974592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.274581:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497666.274595:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735600/0x3e357265691d543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d53c expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.274629:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735600/0x3e357265691d543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d53c expref: 10 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.274641:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735600/0x3e357265691d543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d53c expref: 10 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.274650:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735600, rc 0) 00000100:00100000:1.0:1777497666.274688:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564974592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.274695:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1777497666.274788:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.274801:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.274810:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.274855:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.274886:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.274907:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.275052:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974720 00000100:00100000:1.0:1777497666.275056:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974720 00000100:00100000:1.0:1777497666.275108:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1777497666.275116:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564974720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497666.275128:0:88680:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777497666.275144:0:88680:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497666.275146:0:88680:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 120 00000100:00100000:1.0:1777497666.275211:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564974720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.275217:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1777497666.275243:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497666.275303:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497666.275309:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275317:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497666.275330:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497666.275331:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:1.0:1777497666.275334:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497666.275358:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275365:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275372:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.275384:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.275405:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.275416:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.275426:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974848 00000100:00100000:1.0:1777497666.275429:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974848 00000100:00100000:1.0:1777497666.275445:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777497666.275450:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837564974848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.275456:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497666.275462:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d54a expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275475:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d54a expref: 11 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275483:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d54a expref: 11 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275501:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735e00, rc 0) 00000100:00100000:1.0:1777497666.275523:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564974848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.275529:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777497666.275555:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.275564:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.275571:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.275621:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.275641:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.275652:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.275662:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564974976 00000100:00100000:1.0:1777497666.275665:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564974976 00000100:00100000:1.0:1777497666.275683:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777497666.275689:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564974976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.275795:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564974976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.275801:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777497666.275829:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.275852:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.275889:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.275908:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.275919:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975104 00000100:00100000:1.0:1777497666.275922:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975104 00000100:00100000:1.0:1777497666.275940:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777497666.275945:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564975104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.276032:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564975104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.276038:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1777497666.276079:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497666.286120:0:88756:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:0.0:1777497666.286192:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:0.0:1777497666.286215:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497666.286226:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286238:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497666.286262:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497666.286264:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 117 10000000:01000000:0.0:1777497666.286267:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497666.286305:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286312:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286323:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.286361:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.286430:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.286471:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e626c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.286567:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975232 00000100:00100000:0.0:1777497666.286574:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975232 00000100:00100000:0.0:1777497666.286616:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777497666.286624:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837564975232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.286639:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497666.286652:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8000/0x3e357265691d55f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d558 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286675:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8000/0x3e357265691d55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d558 expref: 12 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286686:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8000/0x3e357265691d55f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d558 expref: 12 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286706:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8000, rc 0) 00000100:00100000:0.0:1777497666.286744:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564975232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.286750:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777497666.286795:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.286808:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.286816:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.286864:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.286894:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.286910:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.286923:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975360 00000100:00100000:0.0:1777497666.286926:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975360 00000100:00100000:0.0:1777497666.286946:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777497666.286952:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564975360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777497666.286964:0:88684:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1777497666.286981:0:88684:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777497666.286984:0:88684:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777497666.286997:0:88684:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777497666.287000:0:88684:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777497666.287003:0:88684:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:0.0:1777497666.287075:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564975360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.287088:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777497666.287142:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1777497666.287214:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1777497666.287219:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287226:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497666.287232:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1777497666.287234:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1777497666.287236:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497666.287250:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287256:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287262:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.287273:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.287295:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.287308:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.287318:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975488 00000100:00100000:0.0:1777497666.287321:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975488 00000100:00100000:0.0:1777497666.287340:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1777497666.287346:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837564975488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.287358:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497666.287366:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d566 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287378:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d566 expref: 13 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287385:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d566 expref: 13 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287391:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9a00, rc 0) 00000100:00100000:0.0:1777497666.287415:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.287420:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1777497666.287447:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.287455:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.287461:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.287508:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.287531:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.287543:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.287552:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975616 00000100:00100000:0.0:1777497666.287555:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975616 00000100:00100000:0.0:1777497666.287573:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1777497666.287578:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.287709:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.287715:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1777497666.287741:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.287764:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.287800:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.287812:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085215f00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.287822:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975744 00000100:00100000:0.0:1777497666.287825:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975744 00000100:00100000:0.0:1777497666.287843:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1777497666.287849:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.300683:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 12825us (12874us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.300696:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1777497666.301829:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497666.303803:0:88758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 46 00000020:01000000:1.0:1777497666.304481:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-45 (rc=0) 10000000:01000000:1.0:1777497666.304508:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1777497666.304519:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.304531:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497666.304541:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:1.0:1777497666.304543:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:1.0:1777497666.304546:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1777497666.304585:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.304593:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.304603:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.304628:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.304709:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.304752:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.304824:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564975872 00000100:00100000:0.0:1777497666.304833:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564975872 00000100:00100000:0.0:1777497666.304886:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1777497666.304896:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837564975872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.304912:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497666.304926:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9000/0x3e357265691d57b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d574 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.304961:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9000/0x3e357265691d57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d574 expref: 14 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.304972:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9000/0x3e357265691d57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d574 expref: 14 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.304999:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9000, rc 0) 00000100:00100000:0.0:1777497666.305143:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564975872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.305149:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1777497666.313162:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564975872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.313189:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.313218:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.313239:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1777497666.313244:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.313251:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.313259:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497666.313261:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:2.0:1777497666.313263:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497666.313291:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.313297:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.313306:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.313325:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.313502:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.313540:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86215600 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.313606:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976000 00000100:00100000:3.0:1777497666.313613:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976000 00000100:00100000:3.0:1777497666.313663:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1777497666.313674:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564976000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497666.313688:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497666.313701:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38a00/0x3e357265691d589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d582 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.313720:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38a00/0x3e357265691d589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d582 expref: 15 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.313730:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38a00/0x3e357265691d589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d582 expref: 15 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.313739:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38a00, rc 0) 00000100:00100000:3.0:1777497666.313792:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.313799:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1777497666.313870:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.313882:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.313889:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.313957:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.313980:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.314014:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.314490:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976128 00000100:00100000:3.0:1777497666.314495:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976128 00000100:00100000:3.0:1777497666.314533:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777497666.314540:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.314654:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.314660:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1777497666.314693:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.314721:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.314756:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.314774:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9600 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.314784:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976256 00000100:00100000:3.0:1777497666.314787:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976256 00000100:00100000:3.0:1777497666.314803:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777497666.314808:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.314876:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.314881:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1777497666.314918:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497666.318761:0:88759:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1777497666.319248:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1777497666.319274:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1777497666.319284:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.319322:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.319332:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497666.319335:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:2.0:1777497666.319356:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497666.319403:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.319412:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.319422:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.319448:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.319516:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.319564:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86215f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.319826:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976384 00000100:00100000:3.0:1777497666.319835:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976384 00000100:00100000:3.0:1777497666.319891:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1777497666.319908:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564976384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497666.319923:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497666.319936:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d590 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.319973:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d590 expref: 16 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.319985:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d590 expref: 16 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.320002:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39400, rc 0) 00000100:00100000:3.0:1777497666.320044:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.320051:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1777497666.321169:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.321194:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.321204:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.321298:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.321786:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.321850:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86215f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.322001:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976512 00000100:00100000:3.0:1777497666.322009:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976512 00000100:00100000:3.0:1777497666.322056:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777497666.322065:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.322214:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.322221:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777497666.322262:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.322295:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.322332:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.322370:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.322382:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976640 00000100:00100000:3.0:1777497666.322391:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976640 00000100:00100000:3.0:1777497666.322413:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777497666.322419:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.322495:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.322501:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777497666.322538:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497666.323202:0:88761:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:3.0:1777497666.323253:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:3.0:1777497666.323278:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497666.323288:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323298:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497666.323307:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1777497666.323310:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1777497666.323312:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1777497666.323339:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323347:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323355:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497666.323370:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.323409:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.323434:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.323448:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976768 00000100:00100000:3.0:1777497666.323452:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976768 00000100:00100000:3.0:1777497666.323476:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777497666.323483:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564976768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497666.323495:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497666.323506:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d59e expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323527:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d59e expref: 17 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323537:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d59e expref: 17 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323545:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38200, rc 0) 00000100:00100000:3.0:1777497666.323574:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564976768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.323579:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777497666.323612:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497666.323623:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.323632:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497666.323673:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.323702:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.323712:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.323722:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564976896 00000100:00100000:3.0:1777497666.323725:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564976896 00000100:00100000:3.0:1777497666.323740:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1777497666.323744:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564976896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.323831:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564976896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 85us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.323837:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1777497666.323861:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.323880:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.323911:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.323921:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497666.323930:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977024 00000100:00100000:3.0:1777497666.323932:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977024 00000100:00100000:3.0:1777497666.323948:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777497666.323953:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564977024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.334049:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564977024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 10084us (10126us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.334064:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777497666.335214:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497666.337811:0:88762:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1777497666.337971:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1777497666.338009:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1777497666.338021:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.338033:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.338043:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497666.338046:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:2.0:1777497666.338049:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497666.338091:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.338118:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.338127:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.338151:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.338207:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.338238:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86215480 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.338574:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977152 00000100:00100000:0.0:1777497666.338582:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977152 00000100:00100000:0.0:1777497666.338709:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1777497666.338719:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564977152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.338734:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497666.338747:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8e00/0x3e357265691d5b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5ac expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.338768:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8e00/0x3e357265691d5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5ac expref: 18 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.338779:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8e00/0x3e357265691d5b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5ac expref: 18 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.338786:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8e00, rc 0) 00000100:00100000:0.0:1777497666.338829:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497666.338835:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1777497666.338884:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497666.338896:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497666.338905:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497666.339003:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.339030:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.339043:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.340795:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977280 00000100:00100000:2.0:1777497666.340806:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977280 00000100:00100000:2.0:1777497666.340865:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1777497666.340875:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.341075:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.341082:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1777497666.344401:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.344467:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497666.344539:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497666.344583:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.344769:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977408 00000100:00100000:2.0:1777497666.344777:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977408 00000100:00100000:2.0:1777497666.344828:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1777497666.344837:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.344963:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.344970:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497666.347236:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497666.356286:0:88763:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1777497666.357248:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1777497666.357278:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777497666.357289:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.357302:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497666.357325:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497666.357327:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:3.0:1777497666.357330:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497666.357392:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.357400:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.357409:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497666.357433:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.357497:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.357543:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.357869:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977536 00000100:00100000:1.0:1777497666.357876:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977536 00000100:00100000:1.0:1777497666.357930:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1777497666.357939:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564977536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.358050:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497666.358063:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5ba expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.358089:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5ba expref: 19 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.358125:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5ba expref: 19 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.358134:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734200, rc 0) 00000100:00100000:1.0:1777497666.358187:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.358194:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1777497666.358243:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.358258:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.358267:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.358332:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.360851:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.360885:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240817a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.360920:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977664 00000100:00100000:1.0:1777497666.360927:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977664 00000100:00100000:1.0:1777497666.360969:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1777497666.360977:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.361136:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.361143:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1777497666.361199:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.361255:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.361305:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.361320:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.361332:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977792 00000100:00100000:1.0:1777497666.361335:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977792 00000100:00100000:1.0:1777497666.361363:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1777497666.361369:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.361435:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.361441:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1777497666.361478:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497666.373376:0:88765:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 51 00000020:01000000:1.0:1777497666.373683:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-51 (rc=0) 10000000:01000000:1.0:1777497666.373710:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497666.373720:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.373733:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497666.373743:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1777497666.373746:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1777497666.373748:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497666.373782:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.373790:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.373800:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.373823:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.373878:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.373935:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97240 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.375510:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564977920 00000100:00100000:2.0:1777497666.375527:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564977920 00000100:00100000:2.0:1777497666.375598:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1777497666.375606:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564977920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.375633:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497666.375654:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5c8 expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.375681:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5c8 expref: 20 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.375693:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5c8 expref: 20 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.375703:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b600, rc 0) 00000100:00100000:2.0:1777497666.375774:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564977920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.375793:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1777497666.376117:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564977920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497666.376134:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497666.376143:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497666.376214:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.376244:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.376267:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.376280:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978048 00000100:00100000:1.0:1777497666.376284:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978048 00000100:00100000:1.0:1777497666.376306:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1777497666.376311:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564978048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.376449:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564978048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497666.376455:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1777497666.376480:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.376504:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497666.376538:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497666.376551:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497666.376561:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978176 00000100:00100000:1.0:1777497666.376564:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978176 00000100:00100000:1.0:1777497666.376581:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1777497666.376586:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564978176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.382085:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497666.382150:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497666.382180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497666.382223:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332672 00000100:00100000:2.0:1777497666.382233:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332672 00000100:00100000:2.0:1777497666.382276:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332800 00000100:00100000:2.0:1777497666.382279:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332800 00000100:00100000:2.0:1777497666.382321:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1306 00000100:00100000:2.0:1777497666.382332:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2415:x1863837546332800:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497666.382420:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2415:x1863837546332800:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.382428:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1306 00000100:00100000:2.0:1777497666.382462:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1345 00000100:00100000:2.0:1777497666.382467:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546332672:12345-192.168.202.4@tcp:38:kworker.0 00010000:00080000:2.0:1777497666.382492:0:64885:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'd146155b-4321-4b14-9284-f644ed9631fb' at ffff923f8dd19800, cookie 0x3e357265691d48d 00010000:00080000:2.0:1777497666.382497:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp recovering/t0 exp ffff923f8dd19800 cur 3795 last 1777497665 00010000:02000400:2.0:1777497666.382505:0:64885:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1777497666.382511:0:64885:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1777497666.382532:0:64885:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1777497666.382824:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f81a02000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497666.382858:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546332672:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 389us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.382864:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1345 00000100:00080000:2.0:1777497666.382966:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497666.383485:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332544 00000100:00100000:3.0:1777497666.383494:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332544 00000100:00100000:3.0:1777497666.383532:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:3.0:1777497666.383537:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:0+-99:2411:x1863837546332544:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:3.0:1777497666.383558:0:88684:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp t0 exp 0000000000000000 cur 3795 last 0 00000020:00000080:3.0:1777497666.383591:0:88684:0:(genops.c:1406:class_connect()) connect: client 34a4158d-137e-4629-9769-4a4bd53f7f61, cookie 0x3e357265691d5d6 00000100:00080000:3.0:1777497666.383709:0:88684:0:(import.c:65:import_set_state_nolock()) ffff923f82c78000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497666.383748:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+4:2411:x1863837546332544:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 209us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.383755:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 54 00000100:00100000:3.0:1777497666.385944:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564978176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 9348us (9396us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497666.385979:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1777497666.386655:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497666.390127:0:88767:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000100:00100000:2.0:1777497666.390814:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000020:01000000:3.0:1777497666.391507:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1777497666.391550:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1777497666.391561:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.391573:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497666.391584:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1777497666.391586:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:3.0:1777497666.391589:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1777497666.391641:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.391650:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.391660:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497666.391684:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497666.391736:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497666.391770:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9e40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497666.393455:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546332928 00000100:00100000:0.0:1777497666.393470:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546332928 00000100:00100000:0.0:1777497666.393538:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1346 00000100:00100000:0.0:1777497666.393550:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546332928:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777497666.393573:0:63728:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5690380 x1863837546332928/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:422/0 lens 328/0 e 0 to 0 dl 1777497677 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497666.393591:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546332928:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 45us (2784us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497666.393598:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1346 00000100:00100000:2.0:1777497666.397695:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978304 00000100:00100000:2.0:1777497666.397711:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978304 00000100:00100000:2.0:1777497666.397778:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1777497666.397788:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564978304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.397809:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497666.397832:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a800/0x3e357265691d5e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5dd expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.397862:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a800/0x3e357265691d5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5dd expref: 21 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.397872:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a800/0x3e357265691d5e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5dd expref: 21 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.397880:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a800, rc 0) 00000100:00100000:2.0:1777497666.397950:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (6213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.397957:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1777497666.398048:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.398065:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.398074:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.398163:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.398190:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.398229:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.398241:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978432 00000100:00100000:2.0:1777497666.398244:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978432 00000100:00100000:2.0:1777497666.398265:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497666.398270:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.398369:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.398375:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1777497666.398403:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.398424:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.398456:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.398467:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.398477:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978560 00000100:00100000:2.0:1777497666.398480:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978560 00000100:00100000:2.0:1777497666.398496:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777497666.398501:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.398562:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.398568:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777497666.398604:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978560:0@lo:503:ll_cfg_requeue.0 00010000:00080000:3.0:1777497666.399035:0:88707:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000040:00080000:0.0:1777497666.404281:0:88768:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1777497666.412923:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1777497666.412958:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1777497666.412968:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497666.413006:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.413091:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1777497666.413128:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497666.413132:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1777497666.413178:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413185:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413203:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.413230:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.413298:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.413353:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978688 00000100:00100000:2.0:1777497666.413360:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978688 00000100:00100000:2.0:1777497666.413407:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777497666.413414:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564978688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.413428:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497666.413440:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a000/0x3e357265691d5f2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5eb expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413461:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a000/0x3e357265691d5f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5eb expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413472:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a000/0x3e357265691d5f2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5eb expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413479:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a000, rc 0) 00000100:00100000:2.0:1777497666.413510:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564978688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.413516:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777497666.413573:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.413596:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.413611:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413775:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.413795:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1777497666.413798:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413805:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497666.413811:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1777497666.413812:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497666.413815:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1777497666.413830:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413837:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413845:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.413859:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.413886:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.413907:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978816 00000100:00100000:2.0:1777497666.413911:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978816 00000100:00100000:2.0:1777497666.413932:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1777497666.413937:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564978816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.413954:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497666.413961:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d5f9 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413975:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d5f9 expref: 23 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413983:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5f9 expref: 23 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.413999:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a400, rc 0) 00000100:00100000:2.0:1777497666.414022:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564978816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497666.414027:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1777497666.414054:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.414065:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497666.414074:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.414081:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497666.414149:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.414171:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497666.414189:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564978944 00000100:00100000:2.0:1777497666.414192:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564978944 00000100:00100000:2.0:1777497666.414209:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777497666.414214:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564978944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497666.414282:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564978944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (109us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777497666.414288:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777497666.414313:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497666.414324:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564978944:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1777497666.414344:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1777497666.415970:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.415981:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497666.722823:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497666.914239:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1777497667.114611:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00010000:00010000:1.0:1777497667.746312:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497667.938277:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497668.130210:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:3.0:1777497668.228316:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497668.228646:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333056 00000100:00100000:1.0:1777497668.228657:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333056 00000100:00100000:0.0:1777497668.229285:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:0.0:1777497668.229301:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+4:70262:x1863837546333056:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497668.229335:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497668.229352:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9400/0x3e357265691d607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c328 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.229383:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9400/0x3e357265691d607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c328 expref: 5 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.229395:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9400/0x3e357265691d607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c328 expref: 5 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.229404:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9400, rc 0) 00000100:00100000:0.0:1777497668.229469:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546333056:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 174us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.229477:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 61 00000100:00100000:3.0:1777497668.237005:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.237069:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333184 00000100:00100000:0.0:1777497668.237081:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333184 00000100:00100000:0.0:1777497668.237155:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1777497668.237165:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546333184:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777497668.237193:0:88681:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:0.0:1777497668.237211:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777497668.237216:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:0.0:1777497668.237219:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:0.0:1777497668.237222:0:88681:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:0.0:1777497668.237225:0:88681:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 120 00000100:00100000:0.0:1777497668.238737:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546333184:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 1566us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.238748:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 62 00000100:00100000:0.0:1777497668.241776:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497668.241890:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333312 00000100:00100000:3.0:1777497668.241900:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333312 00000100:00100000:3.0:1777497668.241954:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:3.0:1777497668.241965:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546333312:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497668.241993:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497668.242010:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c32f expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497668.242038:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 6 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497668.242050:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 6 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497668.242059:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38400, rc 0) 00000100:00100000:3.0:1777497668.242385:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70262:x1863837546333312:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 421us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497668.242393:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 63 00000100:00100000:3.0:1777497668.245714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.245751:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333440 00000100:00100000:0.0:1777497668.245761:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333440 00000100:00100000:0.0:1777497668.245907:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:0.0:1777497668.245917:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70262:x1863837546333440:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497668.246082:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546333440:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 166us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.246090:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 64 00000100:00100000:3.0:1777497668.248905:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.250032:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333568 00000100:00100000:0.0:1777497668.250043:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333568 00000100:00100000:0.0:1777497668.250121:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:0.0:1777497668.250133:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546333568:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497668.250275:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546333568:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 144us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.250284:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 65 00000100:00100000:3.0:1777497668.256402:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.256561:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333696 00000100:00100000:0.0:1777497668.256572:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333696 00000100:00100000:0.0:1777497668.256635:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:0.0:1777497668.256647:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546333696:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497668.256664:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497668.256683:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8400/0x3e357265691d615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c336 expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.256711:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8400/0x3e357265691d615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c336 expref: 8 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.256723:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8400/0x3e357265691d615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c336 expref: 8 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.256745:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8400, rc 0) 00000100:00100000:0.0:1777497668.256808:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546333696:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 163us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.256815:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 66 00000100:00100000:3.0:1777497668.260229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.260309:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333824 00000100:00100000:0.0:1777497668.260318:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333824 00000100:00100000:0.0:1777497668.260376:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:0.0:1777497668.260386:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546333824:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497668.260516:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546333824:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 131us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.260523:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 67 00000100:00100000:3.0:1777497668.262794:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497668.262860:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546333952 00000100:00100000:1.0:1777497668.262869:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546333952 00000100:00100000:1.0:1777497668.262923:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:1.0:1777497668.262933:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546333952:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497668.263064:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546333952:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497668.263073:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 68 00000100:00100000:3.0:1777497668.274894:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.275162:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334080 00000100:00100000:0.0:1777497668.275172:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334080 00000100:00100000:0.0:1777497668.275221:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:0.0:1777497668.275231:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546334080:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497668.275249:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497668.275266:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c33d expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.275295:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 9 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.275305:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 9 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497668.275313:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9e00, rc 0) 00000100:00100000:0.0:1777497668.275392:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546334080:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 162us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497668.275399:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 69 00000100:00100000:3.0:1777497668.280505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497668.282320:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334208 00000100:00100000:0.0:1777497668.282402:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334208 00000100:00100000:0.0:1777497668.282505:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:0.0:1777497668.282519:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546334208:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497668.282644:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546334208:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 129us (2150us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497668.282652:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 70 00000100:00100000:3.0:1777497668.642415:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564979072:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497668.642481:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497668.642542:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979072 00000100:00100000:3.0:1777497668.642550:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979072 00000100:00100000:3.0:1777497668.642602:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2122 00000100:00100000:3.0:1777497668.642612:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564979072:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497668.642644:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497668.642685:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564979072:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497668.642691:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2122 00000100:00080000:3.0:1777497668.642711:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497668.642749:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564979072:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497668.642923:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497668.642932:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564979200:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497668.642958:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497668.642995:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979200 00000100:00100000:1.0:1777497668.642999:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979200 00000100:00100000:1.0:1777497668.643028:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1777497668.643034:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564979200:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497668.643051:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211904 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497668.643081:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564979200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497668.643086:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00080000:1.0:1777497668.643129:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497668.643150:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564979200:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497668.777266:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497668.973614:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:2.0:1777497669.155135:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:3.0:1777497669.379575:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497669.379627:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497669.379676:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334464 00000100:00100000:3.0:1777497669.379690:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334464 00000100:00100000:3.0:1777497669.379778:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1307 00000100:00100000:3.0:1777497669.379791:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2413:x1863837546334464:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497669.379812:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334336 00000100:00100000:0.0:1777497669.379827:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334336 00000100:00100000:3.0:1777497669.379899:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2413:x1863837546334464:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 109us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497669.379909:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 71 00000100:00100000:0.0:1777497669.379924:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546334336:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497669.379928:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1307 00000100:00080000:3.0:1777497669.379992:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497669.380023:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546334336:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 100us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497669.380031:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 71 00000001:00100000:0.0:1777497669.680217:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1777497669.680231:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:0.0:1777497669.680235:0:8391:0:(genops.c:906:class_export_put()) final put ffff92409c46d800/d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:1.0:1777497669.680303:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c46d800/d146155b-4321-4b14-9284-f644ed9631fb for lustre-OST0000 00000020:00000080:1.0:1777497669.680378:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c763800 for lustre-OST0000 00000001:00100000:1.0:1777497669.680729:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1777497669.680751:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:1.0:1777497669.680754:0:9460:0:(genops.c:906:class_export_put()) final put ffff924090d1c000/d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:0.0:1777497669.690488:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924090d1c000/d146155b-4321-4b14-9284-f644ed9631fb for lustre-OST0001 00000020:00000080:1.0:1777497669.698227:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb783800 for lustre-OST0001 00010000:00010000:3.0:1777497669.794256:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497669.996518:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 0 seconds 00000100:00100000:0.0:1777497670.179754:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564979328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497670.179834:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497670.181885:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979328 00000100:00100000:1.0:1777497670.181900:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979328 00000100:00100000:1.0:1777497670.181975:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3999 00000100:00100000:1.0:1777497670.181987:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564979328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497670.182028:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:1.0:1777497670.182153:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564979328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 169us (2319us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.182160:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3999 00000100:00100000:0.0:1777497670.182267:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564979328:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1777497670.188859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497670.188867:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497670.188872:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497670.188885:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497670.188907:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5690000 x1863837564979584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497670.188941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497670.188945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497670.188946:0:8:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497670.188962:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497670.188989:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5693480 x1863837564979840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497670.189006:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497670.189009:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497670.189011:0:8:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497670.189015:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497670.189025:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5693100 x1863837564980096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497670.189042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497670.189045:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497670.189047:0:8:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497670.189051:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497670.189059:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5691f80 x1863837564980480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497670.189940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1777497670.189945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497670.189947:0:8:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497670.189968:0:8:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240bb6f6800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497670.189981:0:8:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f86224a80 x1863837564980864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497670.190249:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 0 seconds 00000100:00100000:2.0:1777497670.190275:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564979456:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190347:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190390:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564980352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190434:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190465:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497670.190471:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564980224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190493:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190524:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564979584:0@lo:38:kworker.0 00000100:00100000:2.0:1777497670.190551:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190569:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564979840:0@lo:38:kworker.0 00000100:00100000:2.0:1777497670.190588:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190604:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564980096:0@lo:38:kworker.0 00000100:00100000:2.0:1777497670.190628:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190646:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564980480:0@lo:38:kworker.0 00000100:00100000:2.0:1777497670.190665:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190699:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564980864:0@lo:38:kworker.0 00000100:00100000:2.0:1777497670.190724:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190751:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564979712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190774:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190793:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564980608:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190814:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190832:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1777497670.190838:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564979968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190858:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190875:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564980736:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.190894:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.190924:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979456 00000100:00100000:2.0:1777497670.190937:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979456 00000100:00100000:2.0:1777497670.190999:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1777497670.191009:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564979456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.191059:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837564979456:12345-0@lo:400:kworker.0 Request processed in 52us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.191065:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1777497670.194708:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980352 00000100:00100000:2.0:1777497670.194724:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980352 00000100:00100000:2.0:1777497670.194791:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980224 00000100:00100000:2.0:1777497670.194795:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980224 00000100:00100000:2.0:1777497670.194816:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980608 00000100:00100000:2.0:1777497670.194819:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980608 00000100:00100000:2.0:1777497670.194834:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980736 00000100:00100000:2.0:1777497670.194837:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980736 00000100:00100000:2.0:1777497670.194858:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1777497670.194866:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564980352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.194962:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564980352:12345-0@lo:400:kworker.0 Request processed in 84us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.194970:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2601 00000100:00100000:2.0:1777497670.194988:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1777497670.194994:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564980224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.195027:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564980224:12345-0@lo:400:kworker.0 Request processed in 34us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195032:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2602 00000100:00100000:2.0:1777497670.195045:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1777497670.195050:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564980608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.195113:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564980608:12345-0@lo:400:kworker.0 Request processed in 42us (4276us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195127:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2603 00000100:00100000:2.0:1777497670.195143:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1777497670.195149:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.195180:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564980736:12345-0@lo:400:kworker.0 Request processed in 31us (4285us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195185:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2604 00000100:00100000:2.0:1777497670.195214:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979584 00000100:00100000:2.0:1777497670.195219:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979584 00000100:00100000:2.0:1777497670.195231:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979840 00000100:00100000:2.0:1777497670.195234:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979840 00000100:00100000:2.0:1777497670.195240:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980480 00000100:00100000:2.0:1777497670.195242:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980480 00000100:00100000:2.0:1777497670.195248:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980864 00000100:00100000:2.0:1777497670.195250:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980864 00000100:00100000:2.0:1777497670.195256:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979712 00000100:00100000:2.0:1777497670.195258:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979712 00000100:00100000:2.0:1777497670.195273:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564979968 00000100:00100000:2.0:1777497670.195276:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564979968 00000100:00100000:2.0:1777497670.195289:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1777497670.195295:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564979712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.195326:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837564979712:12345-0@lo:400:kworker.0 Request processed in 30us (4550us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195332:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:2.0:1777497670.195346:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1777497670.195351:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564979968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.195377:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564979968:12345-0@lo:400:kworker.0 Request processed in 26us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195382:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1777497670.195406:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1777497670.195411:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564979584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.195435:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3799 last 0 00000020:00000080:2.0:1777497670.195476:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691d623 00000004:00100000:2.0:1777497670.195491:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497670.195623:0:73210:0:(import.c:65:import_set_state_nolock()) ffff92408a0a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497670.195664:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837564979584:12345-0@lo:38:kworker.0 Request processed in 251us (5112us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195670:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:2.0:1777497670.195687:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1777497670.195691:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564979840:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.195703:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3799 last 0 00000020:00000080:2.0:1777497670.195728:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691d62a 00000004:00100000:2.0:1777497670.195734:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497670.195750:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f81a04000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497670.195774:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837564979840:12345-0@lo:38:kworker.0 Request processed in 81us (5184us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195780:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1777497670.195795:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1777497670.195798:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564980480:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.195810:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3799 last 0 00000020:00000080:2.0:1777497670.195829:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691d631 00000004:00100000:2.0:1777497670.195835:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497670.195847:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497670.195871:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837564980480:12345-0@lo:38:kworker.0 Request processed in 71us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.195883:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1777497670.195899:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1777497670.195903:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837564980864:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.195915:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3799 last 0 00000020:00000080:2.0:1777497670.195935:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691d638 00000004:00100000:2.0:1777497670.195941:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1777497670.196251:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497670.196258:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497670.196261:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497670.199140:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497670.199252:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837564980864:12345-0@lo:38:kworker.0 Request processed in 3343us (8522us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.199262:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1777497670.199334:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980096 00000100:00100000:2.0:1777497670.199341:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980096 00000100:00100000:2.0:1777497670.199394:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4000 00000100:00100000:2.0:1777497670.199400:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837564980096:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.199425:0:80394:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff923f8dd1c800, cookie 0x3e357265691d486 00010000:00080000:2.0:1777497670.199430:0:80394:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t77309411356 exp ffff923f8dd1c800 cur 3799 last 1777497665 00000004:00100000:2.0:1777497670.199448:0:80394:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497670.199487:0:80394:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497670.199535:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564980096:12345-0@lo:38:kworker.0 Request processed in 133us (8905us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.199542:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4000 00000100:00100000:2.0:1777497670.199618:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564980224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.199630:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564979456:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.199640:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564980352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.200931:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564979968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.200948:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564980736:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.200971:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837564979712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497670.200983:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564980608:0@lo:400:kworker.0 00010000:00080000:2.0:1777497670.201025:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b5690000 x1863837564979584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497670.201040:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 27 00000100:00080000:2.0:1777497670.203827:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff9240b5690000 x1863837564979584/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497670.203840:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1777497670.203846:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497670.203851:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777497670.203857:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837564979584:0@lo:38:kworker.0 00010000:00080000:2.0:1777497670.203891:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b5693480 x1863837564979840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497670.203903:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 27 00010000:00080000:3.0:1777497670.204160:0:88707:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:3.0:1777497670.204167:0:88707:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 111669149700 00000020:00080000:3.0:1777497670.204172:0:88707:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497670.204176:0:88707:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149700 00000020:00080000:3.0:1777497670.204179:0:88707:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:3.0:1777497670.204182:0:88707:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 111669149700 00000100:00080000:2.0:1777497670.208376:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff9240b5693480 x1863837564979840/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497670.208389:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:2.0:1777497670.208395:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497670.208399:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:2.0:1777497670.208405:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837564979840:0@lo:38:kworker.0 00000100:00080000:2.0:1777497670.208455:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 27 00000100:00080000:2.0:1777497670.208465:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1777497670.208468:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:2.0:1777497670.208471:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 111669149699 gen 3 00000100:00080000:2.0:1777497670.208474:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 111669149699 last 0 00000100:00080000:2.0:1777497670.208477:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000100:00100000:1.0:1777497670.209349:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564980096:0@lo:38:kworker.0 00010000:00080000:1.0:1777497670.209377:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240b5691f80 x1863837564980480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497670.209389:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 27 00000100:00080000:1.0:1777497670.210222:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff9240b5691f80 x1863837564980480/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497695 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497670.210232:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:1.0:1777497670.210236:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:1.0:1777497670.210240:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:1.0:1777497670.210246:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000b0ef51f0): req@ffff924086dbed80 x1863837564967296/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497670.210269:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5691f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837564980480:0@lo:38:kworker.0 00010000:00080000:1.0:1777497670.210307:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff923f86224a80 x1863837564980864/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497680 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497670.210318:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 27 00000100:00080000:1.0:1777497670.210325:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1777497670.210329:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1777497670.210331:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1777497670.210336:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837564980864:0@lo:38:kworker.0 00000100:00100000:1.0:1777497670.210462:0:63736:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497670.210490:0:63736:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085496cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497670.210527:0:63734:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564967296 00000100:00100000:1.0:1777497670.210534:0:63734:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564967296 00010000:00080000:2.0:1777497670.211368:0:88933:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:2.0:1777497670.211374:0:88933:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:2.0:1777497670.211380:0:88933:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:2.0:1777497670.211795:0:88933:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:2.0:1777497670.211923:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564980992:0@lo:400:ldlm_lock_repla.0 00000100:00100000:2.0:1777497670.211988:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.212050:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564980992 00000100:00100000:2.0:1777497670.212056:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564980992 00000100:00100000:2.0:1777497670.212146:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4001 00000100:00100000:2.0:1777497670.212156:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564980992:12345-0@lo:400:ldlm_lock_repla.0 00010000:00080000:2.0:1777497670.212177:0:8407:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240bcd34700 x1863837564980992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:426/0 lens 224/0 e 0 to 0 dl 1777497681 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497670.212198:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837564980992:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 44us (211us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497670.212204:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4001 00000020:00080000:2.0:1777497670.212225:0:88707:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:2.0:1777497670.212228:0:88707:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 111669149700 00000100:00100000:1.0:1777497670.212231:0:63734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1777497670.212232:0:88707:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:2.0:1777497670.212236:0:88707:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00000100:00100000:1.0:1777497670.212241:0:63734:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63736:x1863837564967296:12345-0@lo:700:mdt_seqm_0000.0 00010000:00080000:1.0:1777497670.212252:0:63734:0:(ldlm_lib.c:3194:target_queue_recovery_request()) @@@ not queueing req@ffff923f841a6d80 x1863837564967296/t0(0) o700->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:426/0 lens 264/0 e 0 to 0 dl 1777497681 ref 1 fl Interpret:/200/ffffffff rc 0/-1 job:'mdt_seqm_0000.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1777497670.212258:0:88707:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497670.212260:0:88707:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497670.212268:0:88707:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5690380 x1863837546332928/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:422/0 lens 328/0 e 0 to 0 dl 1777497677 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777497670.212281:0:88707:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497670.212313:0:88707:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c2fe expref: -99 pid: 88707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.212335:0:88707:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.212353:0:88707:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.212361:0:88707:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b200, rc 0) 00010000:00080000:2.0:1777497670.212429:0:88707:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00010000:00080000:2.0:1777497670.212440:0:88707:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:3.0:1777497670.216360:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497670.216413:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334592 00000100:00100000:3.0:1777497670.216427:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334592 00000100:00100000:3.0:1777497670.216641:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1310 00000100:00100000:3.0:1777497670.216654:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546334592:12345-192.168.202.4@tcp:400:ptlrpcd_rcv.0 00010000:00080000:3.0:1777497670.216686:0:73210:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240b5699f80 x1863837546334592/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:426/0 lens 224/0 e 0 to 0 dl 1777497681 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497670.216706:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546334592:12345-192.168.202.4@tcp:400:ptlrpcd_rcv.0 Request processed in 56us (610us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497670.216715:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1310 00010000:00080000:3.0:1777497670.216735:0:88707:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:3.0:1777497670.216865:0:88707:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 27, last_transno is 115964116992 40000000:02000000:1.0:1777497670.224212:0:63734:0:(fid_handler.c:117:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000300000400-0x0000000340000400]:1:mdt 00000001:00100000:0.0:1777497670.230501:0:88674:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00100000:0.0:1777497670.230531:0:88674:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00080000:0.0:1777497670.230577:0:88707:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:0.0:1777497670.230622:0:88707:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:0.0:1777497670.230639:0:88707:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff9240bcd34700 x1863837564980992/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:426/0 lens 224/0 e 0 to 0 dl 1777497681 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1777497670.232292:0:88707:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff9240b5699f80 x1863837546334592/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:426/0 lens 224/0 e 0 to 0 dl 1777497681 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:0.0:1777497670.232382:0:88707:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00100000:1.0:1777497670.238675:0:63734:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:63736:x1863837564967296:12345-0@lo:700:mdt_seqm_0000.0 Request processed in 26426us (28202us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.238690:0:63734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1777497670.238856:0:63736:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-lwp-MDT0001_UUID:63736:1863837564967296:0@lo:700:mdt_seqm_0000.0 40000000:02000000:1.0:1777497670.238870:0:63736:0:(fid_request.c:121:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000300000400-0x0000000340000400]:1:mdt] 00000100:00080000:3.0:1777497670.244821:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:3.0:1777497670.244839:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff9240bcd37b80 x1863837564980992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497686 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497670.244852:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff9240bcd37b80 x1863837564980992/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497686 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497670.244859:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497670.244906:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:3.0:1777497670.244912:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000f9c3c5ab): req@ffff9240a3adca80 x1863837564965504/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497670.244940:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000a7f0c433): req@ffff9240b5699500 x1863837564963328/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497661 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497670.244962:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837564980992:0@lo:400:ldlm_lock_repla.0 00000100:00100000:3.0:1777497670.246455:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497670.246754:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093880b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497670.247442:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.247497:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564965504 00000100:00100000:2.0:1777497670.247505:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564965504 00000100:00100000:2.0:1777497670.247548:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564963328 00000100:00100000:2.0:1777497670.247552:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564963328 00000100:00100000:2.0:1777497670.247573:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1777497670.247581:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72705:x1863837564965504:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777497670.247674:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4003 00000100:00100000:3.0:1777497670.247686:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564963328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497670.247713:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:3.0:1777497670.247766:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564963328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497670.247773:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4003 00000100:00100000:2.0:1777497670.247837:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564963328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497670.249787:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72705:x1863837564965504:12345-0@lo:1000:osp_up0-1.0 Request processed in 2200us (3332us total) trans 115964116993 rc 0/0 00000100:00100000:2.0:1777497670.249799:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4002 00000100:00100000:2.0:1777497670.249892:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564965504:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497670.265894:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497670.265927:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564981120:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497670.266005:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.266050:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981120 00000100:00100000:2.0:1777497670.266059:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981120 00000100:00100000:2.0:1777497670.266125:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1777497670.266134:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564981120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497670.266165:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445232640 avail 1298993152 00000100:00100000:2.0:1777497670.266226:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564981120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.266233:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4004 00000100:00100000:2.0:1777497670.266296:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564981120:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497670.270733:0:63736:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546328960:12345-192.168.202.4@tcp:700:cp.0 Request processed in 11553817us (11553984us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.270748:0:63736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000001:00100000:3.0:1777497670.271689:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1777497670.282720:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497670.282762:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334848 00000100:00100000:3.0:1777497670.282773:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334848 00000100:00100000:3.0:1777497670.282829:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1351 00000100:00100000:3.0:1777497670.282839:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546334848:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1777497670.282861:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497670.282884:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38800/0x3e357265691d646 lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c344 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284038:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284064:0:63728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284075:0:63728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.284115:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63728:1863837564981248:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1777497670.284432:0:63728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497670.284463:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497670.284637:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981248 00000100:00100000:3.0:1777497670.284643:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981248 00000100:00100000:3.0:1777497670.284685:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1777497670.284694:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:63728:x1863837564981248:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1777497670.284709:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497670.284725:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d654 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d64d expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284752:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d64d expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284769:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d654 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d64d expref: 8 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.284779:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:3.0:1777497670.284782:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497670.284786:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38c00, rc 0) 00000100:00100000:3.0:1777497670.284829:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63728:x1863837564981248:12345-0@lo:101:mdt00_001.0 Request processed in 135us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497670.284847:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4005 00000100:00100000:3.0:1777497670.284896:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63728:1863837564981248:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1777497670.285022:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d654 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285036:0:63728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d654 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497670.285061:0:63728:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:3.0:1777497670.285069:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d654 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285077:0:63728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d654 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285659:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285674:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285684:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285700:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285707:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.285728:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.285863:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63728:1863837564981376:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777497670.286141:0:63728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497670.286351:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497670.290332:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981376 00000100:00100000:2.0:1777497670.290346:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981376 00000100:00100000:2.0:1777497670.290407:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4006 00000100:00100000:2.0:1777497670.290417:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63728:x1863837564981376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1777497670.290566:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63728:x1863837564981376:12345-0@lo:1000:mdt00_001.0 Request processed in 151us (4425us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.290573:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4006 00000100:00100000:3.0:1777497670.291576:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:63728:1863837564981376:0@lo:1000:mdt00_001.0 00000004:00000080:1.0:1777497670.299341:0:88707:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef07f03e10 00100000:10000000:1.0:1777497670.299354:0:88707:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:0.0:1777497670.300782:0:88693:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000004:00080000:3.0:1777497670.300821:0:88695:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:0.0:1777497670.300832:0:88693:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88693:1863837564981504:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1777497670.300849:0:88695:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88695:1863837564981632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497670.301912:0:63728:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x492:0x0], count =400 00000004:00080000:2.0:1777497670.301923:0:63728:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000400:0x492:0x0]+400 in llog 00000004:00080000:2.0:1777497670.301944:0:63728:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0001: Wrote last used FID: [0x280000400:0x622:0x0], index 0: 0 00000100:00100000:3.0:1777497670.303455:0:88695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497670.303565:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902bc00/0x3e357265691d669 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303583:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92409902bc00/0x3e357265691d669 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303606:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902bc00/0x3e357265691d669 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.303623:0:88695:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2e40 going to sleep for 11 seconds 00010000:00010000:2.0:1777497670.303666:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303726:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303731:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303737:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303742:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497670.303746:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303753:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303764:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:2.0:1777497670.303767:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497670.303772:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 3/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303778:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39600/0x3e357265691d65b lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497670.303793:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e332b38b reply state 000000002dd3dbbf transno 81604378741 ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303811:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303817:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff923f847c8b00) 00010000:00010000:2.0:1777497670.303819:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497670.303821:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497670.303864:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d38800/0x3e357265691d646 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c344 expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303877:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902bc00/0x3e357265691d669 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c344 expref: 9 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.303884:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff924090680600) 00010000:00010000:2.0:1777497670.303886:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497670.303888:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902bc00, rc 0) 00000100:00100000:2.0:1777497670.303966:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:70349:x1863837546334848:12345-192.168.202.4@tcp:101:cp.0 Request processed in 21128us (21255us total) trans 81604378741 rc 0/0 00000100:00100000:2.0:1777497670.303975:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1351 00000100:00100000:1.0:1777497670.306978:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981632 00000100:00100000:1.0:1777497670.306995:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981632 00000100:00100000:1.0:1777497670.307067:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5883 00000100:00100000:1.0:1777497670.307090:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88695:x1863837564981632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1777497670.307143:0:25494:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -62 00002000:02000040:1.0:1777497670.307147:0:25494:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:833) 00000100:00100000:3.0:1777497670.316901:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497670.316965:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546334976 00000100:00100000:3.0:1777497670.316975:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546334976 00000100:00100000:3.0:1777497670.317021:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5884 00000100:00100000:3.0:1777497670.317029:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2411:x1863837546334976:12345-192.168.202.4@tcp:8:cp.0 00010000:00080000:3.0:1777497670.317064:0:25496:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3799 last 0 00000020:00000080:3.0:1777497670.317122:0:25496:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691d677 00002000:00100000:3.0:1777497670.317136:0:25496:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff923f82ab0800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1777497670.317243:0:25496:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1777497670.317321:0:25496:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1777497670.317356:0:25496:0:(import.c:65:import_set_state_nolock()) ffff923f82ab5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497670.317422:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546334976:12345-192.168.202.4@tcp:8:cp.0 Request processed in 392us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497670.317443:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5884 00000100:00100000:0.0:1777497670.320913:0:88693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497670.321002:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981504 00000100:00100000:0.0:1777497670.321013:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981504 00000100:00100000:0.0:1777497670.321067:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5885 00000100:00100000:0.0:1777497670.321089:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:88693:x1863837564981504:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1777497670.321143:0:8396:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 833 -> diff = -63 00002000:02000040:0.0:1777497670.321148:0:8396:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:833) 00000100:00100000:3.0:1777497670.327888:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497670.330050:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335104 00000100:00100000:1.0:1777497670.330070:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335104 00000100:00100000:1.0:1777497670.330198:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5886 00000100:00100000:1.0:1777497670.330209:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+6:0:x1863837546335104:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:1.0:1777497670.330232:0:25492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497670.330257:0:25492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c34b expref: -99 pid: 25492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.330282:0:25492:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x622:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.330305:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330307:0:25492:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330316:0:25492:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 7 pid: 25492 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330334:0:25492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 7 pid: 25492 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330347:0:25492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734c00, rc 0) 00000100:00100000:1.0:1777497670.330414:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+7:0:x1863837546335104:12345-192.168.202.4@tcp:101:cp.0 Request processed in 207us (2537us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.330438:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5886 00002000:00010000:1.0:1777497670.330673:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.330680:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330690:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330691:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330695:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330707:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330717:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330725:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330743:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497670.330846:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.330852:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330859:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330861:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.330864:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330880:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330888:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330894:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330910:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497670.330919:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497670.330925:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330932:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.330937:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330946:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330973:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.330980:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000792539a5/0x3e357265691d685 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331006:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.331009:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331016:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.331019:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331027:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331037:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331044:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e099238/0x3e357265691d68c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497670.331054:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1777497670.331056:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.331060:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.331062:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.331132:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.331137:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331145:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331152:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331155:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331164:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331171:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331178:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331193:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.331204:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.331208:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331215:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.331218:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331226:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331236:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331255:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2e3cf93/0x3e357265691d693 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331267:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.331269:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.331270:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.331309:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.331315:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331323:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331325:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331328:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331337:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331345:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331353:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331366:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497670.331399:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.331409:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331418:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331419:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.331422:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331431:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331439:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331447:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.331458:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497670.332350:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497670.332361:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332372:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497670.332377:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332386:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332404:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332413:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087864bac/0x3e357265691d69a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332432:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497670.332436:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332443:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497670.332446:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332465:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.332474:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.332482:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497670.332639:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.332649:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497670.332652:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497670.332654:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497670.336637:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497670.336682:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335232 00000100:00100000:3.0:1777497670.336692:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335232 00000100:00100000:3.0:1777497670.336741:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5887 00000100:00100000:3.0:1777497670.336752:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+7:70349:x1863837546335232:12345-192.168.202.4@tcp:101:cp.0 00010000:00010000:3.0:1777497670.336771:0:25493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497670.336790:0:25493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c352 expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.336824:0:25493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.336834:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497670.336836:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497670.336841:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 8 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.336891:0:25493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.336906:0:25493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 3899 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.336921:0:25493:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25493:1863837564981760:192.168.202.4@tcp:104: 00000100:00100000:3.0:1777497670.337012:0:25493:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00010000:00010000:1.0:1777497670.339546:0:25494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e3a79a8/0x3e357265691d6a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.339697:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.339704:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339718:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.339721:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.339726:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339748:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339758:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339767:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339789:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.339804:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.339809:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339818:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.339822:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339832:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339847:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339855:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000878a4426/0x3e357265691d6af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339877:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.339879:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.339882:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.339922:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.339928:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339936:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.339937:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.339940:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339963:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339972:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339979:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.339993:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.340001:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.340006:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340024:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340028:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340035:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340046:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340054:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f985019/0x3e357265691d6b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340069:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340071:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340073:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.340140:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.340146:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340153:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340155:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340158:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340166:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340179:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340187:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340211:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497670.340252:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.340257:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340266:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340268:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340271:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340281:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340289:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340297:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340311:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497670.340356:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.340362:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340370:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340372:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340376:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340386:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340394:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340401:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340418:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777497670.340427:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497670.340432:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340439:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340443:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340452:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340485:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340494:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2472938/0x3e357265691d6bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340511:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497670.340515:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340523:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340526:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340534:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340545:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340552:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fffccf2/0x3e357265691d6c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340570:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.340573:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340585:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340589:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340597:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340608:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340615:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d635a955/0x3e357265691d6cb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340628:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340631:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340633:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.340679:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.340685:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340693:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340694:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340698:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340706:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340721:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340728:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340741:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.340748:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.340752:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340759:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340762:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340770:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340781:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340789:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5b4c72d/0x3e357265691d6d2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340809:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340817:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.340820:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.340866:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.340872:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340879:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340881:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.340883:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340892:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340899:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340905:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340918:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.340924:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.340927:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340934:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.340938:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340971:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340981:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.340987:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082364375/0x3e357265691d6d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341001:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341003:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341004:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341046:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341051:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341059:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341061:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341063:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341071:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341081:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341119:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341132:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341139:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341141:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341147:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341150:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341156:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341165:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341172:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003847dcc6/0x3e357265691d6e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341185:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341186:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341187:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341227:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341239:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341247:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341249:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341251:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341260:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341269:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341276:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341288:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341296:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341300:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341306:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341308:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341315:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341335:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341342:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000863d78de/0x3e357265691d6e7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341357:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341360:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341362:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341415:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341420:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341427:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341429:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341432:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341441:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341448:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341455:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341479:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341487:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341490:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341496:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341499:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341506:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341515:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341521:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c22015/0x3e357265691d6ee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341533:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341534:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341536:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341578:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341582:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341589:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341597:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341600:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341608:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341615:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341622:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341634:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341641:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341645:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341652:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341654:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341662:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341672:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341689:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c80a73b/0x3e357265691d6f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341702:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341704:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341706:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341744:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341749:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341756:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341758:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341760:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341769:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341777:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341784:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341796:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341801:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341810:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341817:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341819:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341827:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341838:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341845:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003edab67b/0x3e357265691d6fc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341859:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341861:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.341862:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.341902:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.341907:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341914:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341916:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.341918:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341937:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341945:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341965:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341976:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.341983:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.341986:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.341993:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164fa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.341996:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342003:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342013:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342020:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c408c561/0x3e357265691d703 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342041:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342042:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342044:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342083:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342088:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342116:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342118:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342120:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342128:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342135:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342141:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342152:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.342158:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.342161:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342178:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.342181:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342188:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342197:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342202:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc88adbc/0x3e357265691d70a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342215:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342217:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342218:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342270:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342275:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342284:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342285:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342288:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342297:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342311:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342317:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342330:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.342337:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.342340:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342346:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.342349:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342356:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342365:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342372:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000919b16aa/0x3e357265691d711 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342384:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342390:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342392:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342433:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342438:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342446:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342447:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342449:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342458:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342465:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342472:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342485:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.342491:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.342494:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342499:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.342502:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342520:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342530:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342536:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000399be8b1/0x3e357265691d718 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342549:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342551:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342552:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342590:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342594:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342601:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342603:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342605:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342613:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342620:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342637:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342649:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.342656:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.342659:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342666:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.342669:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342677:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342687:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342695:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e48ccaa/0x3e357265691d71f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342707:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342708:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342710:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342746:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342757:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342765:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342767:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342770:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342778:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342785:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342791:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342803:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497670.342809:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497670.342813:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342819:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.342822:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342829:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342849:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342856:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3d5a9d7/0x3e357265691d726 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342868:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342870:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.342872:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497670.342909:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.342914:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342922:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342924:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.342926:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342935:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.342943:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.343743:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.343751:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.345165:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345281:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497670.345728:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.345736:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345746:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cae00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.345758:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345770:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345790:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345796:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbe0d456/0x3e357265691d72d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.345811:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.345817:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345819:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.345821:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.345823:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.345829:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.345831:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.345836:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345847:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345856:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345862:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345883:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497670.345898:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.345903:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345910:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.345913:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345921:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.345926:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497670.345930:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345931:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345938:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.345940:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497670.345944:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6696004/0x3e357265691d734 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345947:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345968:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.345971:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.345973:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.345975:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.345976:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.345983:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346002:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497670.346045:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.346050:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346057:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346058:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346061:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346070:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346087:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.346092:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346117:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.346120:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346127:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346138:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346144:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a74b7865/0x3e357265691d73b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346158:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.346159:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.346161:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.346265:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346284:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346304:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497670.346349:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.346354:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346513:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346516:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346520:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346659:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346669:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346677:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346692:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497670.346741:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.346745:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346763:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346765:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346768:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346777:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346783:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346790:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346802:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1777497670.346843:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.346848:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346855:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346857:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497670.346858:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497670.346859:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346865:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346868:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346872:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.346876:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346884:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346892:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346897:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346898:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346905:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1e50582/0x3e357265691d742 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346911:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1777497670.346920:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497670.346923:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346929:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.346932:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346940:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.346948:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497670.346964:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346971:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497670.346972:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346973:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.346975:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346979:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000428eb47/0x3e357265691d749 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346984:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346991:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497670.346992:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.346994:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.346999:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347001:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cba00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.347004:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347010:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347011:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1777497670.347018:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347025:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5e6b82c/0x3e357265691d750 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347036:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497670.347039:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497670.347047:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497670.347050:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896caa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497670.347051:0:25494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347053:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347058:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497670.347059:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497670.347060:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347062:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347071:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347071:0:25494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347077:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c8aea0b/0x3e357265691d757 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347089:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.347092:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347118:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.347121:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347127:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347136:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347149:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce69c04a/0x3e357265691d75e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347162:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347163:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347165:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347172:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347176:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347179:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347182:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497670.347275:0:25494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347282:0:25494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497670.347302:0:25494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497670.347463:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.347469:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347476:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.347479:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347487:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347498:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347505:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aa81fc6/0x3e357265691d765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.347529:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347530:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.347532:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1777497670.347763:0:25494:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00000100:00100000:1.0:1777497670.347861:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:88695:x1863837564981632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 40782us (44408us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.347870:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5883 00000100:00100000:2.0:1777497670.348027:0:88695:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88695:1863837564981632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497670.348042:0:88695:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x341:0x0] from OST, last_created [0x2c0000401:0x341:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:2.0:1777497670.348135:0:88695:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88695:1863837564982016:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1777497670.348171:0:88695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.348193:0:88695:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048480 going to sleep for 11 seconds 00000100:00100000:2.0:1777497670.348208:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564981888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497670.348233:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497670.348269:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982016 00000100:00100000:2.0:1777497670.348276:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982016 00000100:00100000:2.0:1777497670.348312:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1777497670.348320:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:88695:x1863837564982016:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1777497670.348360:0:8398:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 834 00000100:00100000:2.0:1777497670.349736:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:88695:x1863837564982016:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1412us (1560us total) trans 4294969452 rc 0/0 00000100:00100000:2.0:1777497670.349746:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5888 00000100:00100000:2.0:1777497670.349788:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564981888 00000100:00100000:2.0:1777497670.349794:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564981888 00000100:00100000:2.0:1777497670.349830:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1777497670.349837:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564981888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497670.349855:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497670.349890:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564981888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1656us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497670.349905:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:2.0:1777497670.349967:0:88695:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:88695:1863837564982016:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1777497670.349979:0:88695:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x341:0x0]-[0x2c0000401:0x361:0x0] 00000100:00100000:2.0:1777497670.350016:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564981888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497670.351402:0:25493:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_013:lustre-OST0000_UUID:25493:1863837564981760:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497670.351440:0:25493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 8 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497670.351463:0:25493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ba00, rc 0) 00000100:00100000:2.0:1777497670.352182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:0.0:1777497670.352778:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x341:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.352788:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.352804:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.352806:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.352812:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.352841:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.352851:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.352859:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.352884:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497670.353008:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x340:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.353014:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353020:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497670.353023:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353025:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497670.353028:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353029:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353053:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.353053:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353061:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353065:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353079:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353080:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.353127:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+8:70349:x1863837546335232:12345-192.168.202.4@tcp:101:cp.0 Request processed in 16372us (16491us total) trans 0 rc 0/0 00010000:00010000:2.0:1777497670.353138:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497670.353140:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5887 00010000:00010000:0.0:1777497670.353142:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497670.353152:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000915d36e6/0x3e357265691d76c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x341:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353178:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.353182:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497670.353192:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.353201:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353206:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.353212:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353214:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353216:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353221:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353226:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353236:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353242:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353244:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353263:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d58a540/0x3e357265691d773 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x340:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353264:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353293:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497670.353295:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497670.353297:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.353305:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.353308:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497670.353334:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.353339:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353346:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353348:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353357:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353365:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353373:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353380:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353393:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1777497670.353427:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.353432:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353439:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353440:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.353443:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353452:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.353460:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354256:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354275:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1777497670.354335:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.354341:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354351:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354353:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354357:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354367:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354376:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354384:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354393:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1777497670.354427:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.354432:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354450:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354452:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354455:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354705:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354717:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354724:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354733:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1777497670.354777:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x33a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.354783:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354791:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354793:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354796:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354806:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354825:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354833:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354842:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1777497670.354883:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x339:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.354888:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354895:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354897:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.354901:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354910:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354918:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354925:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.354933:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:0.0:1777497670.354990:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x338:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.354995:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355002:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355004:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355007:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355016:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355022:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355029:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355036:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:0.0:1777497670.355068:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x337:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355073:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355081:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355083:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355086:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355131:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355146:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355152:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355172:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00002000:00010000:0.0:1777497670.355206:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x336:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355210:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355218:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355219:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355222:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355230:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355237:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355243:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355251:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to regular blp list, 9 blwis in pool 00002000:00010000:0.0:1777497670.355288:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x335:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355292:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355300:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355301:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355303:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355311:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355318:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355325:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355333:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/10 locks to regular blp list, 10 blwis in pool 00002000:00010000:0.0:1777497670.355366:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x334:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355371:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355380:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355381:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355384:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355393:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355409:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355416:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355425:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/11 locks to regular blp list, 11 blwis in pool 00002000:00010000:0.0:1777497670.355462:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x333:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355558:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 3/0,1 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355566:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355568:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355570:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355579:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355586:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355592:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355601:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/12 locks to regular blp list, 12 blwis in pool 00002000:00010000:0.0:1777497670.355642:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x332:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355647:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355654:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355656:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355658:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355666:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355674:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355680:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355690:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/13 locks to regular blp list, 13 blwis in pool 00002000:00010000:0.0:1777497670.355719:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x331:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355723:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355730:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355731:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355733:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355741:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355754:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355761:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355768:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/14 locks to regular blp list, 14 blwis in pool 00002000:00010000:0.0:1777497670.355799:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x330:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355803:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355810:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355811:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355813:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355822:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355829:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355836:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355843:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/15 locks to regular blp list, 15 blwis in pool 00002000:00010000:0.0:1777497670.355878:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355884:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355891:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355893:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355896:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355904:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355912:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355919:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355927:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/16 locks to regular blp list, 16 blwis in pool 00002000:00010000:0.0:1777497670.355968:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.355973:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355980:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355981:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.355983:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.355991:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356004:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356011:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356019:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/17 locks to regular blp list, 17 blwis in pool 00002000:00010000:0.0:1777497670.356056:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356061:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356068:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356070:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356073:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356081:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356088:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356122:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356131:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/18 locks to regular blp list, 18 blwis in pool 00002000:00010000:0.0:1777497670.356170:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356175:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356183:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356184:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356187:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356195:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356203:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356211:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356220:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/19 locks to regular blp list, 19 blwis in pool 00002000:00010000:0.0:1777497670.356250:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356255:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356263:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356264:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356267:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356276:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356289:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356297:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356305:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/20 locks to regular blp list, 20 blwis in pool 00002000:00010000:0.0:1777497670.356336:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x32a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356341:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356349:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356350:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356353:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356362:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356370:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356377:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356385:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/21 locks to regular blp list, 21 blwis in pool 00002000:00010000:0.0:1777497670.356420:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x329:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356425:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356433:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356434:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356437:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356446:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356454:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356462:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356924:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/22 locks to regular blp list, 22 blwis in pool 00002000:00010000:0.0:1777497670.356979:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x328:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.356985:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.356994:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356996:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.356999:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357009:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357023:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357031:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357040:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/23 locks to regular blp list, 23 blwis in pool 00002000:00010000:0.0:1777497670.357077:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x327:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357082:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357090:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357091:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357118:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357128:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357136:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357144:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357153:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/24 locks to regular blp list, 24 blwis in pool 00002000:00010000:0.0:1777497670.357261:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x326:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357265:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357272:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357274:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357276:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357284:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357291:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357297:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357305:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/25 locks to regular blp list, 25 blwis in pool 00002000:00010000:0.0:1777497670.357340:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x325:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357346:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357353:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357354:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357356:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357363:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357377:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357383:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357391:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/26 locks to regular blp list, 26 blwis in pool 00002000:00010000:0.0:1777497670.357430:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x324:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357435:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357442:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357443:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357446:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357455:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357462:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357758:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357769:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/27 locks to regular blp list, 27 blwis in pool 00002000:00010000:0.0:1777497670.357816:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x323:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357821:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357829:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357830:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357833:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357841:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357848:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357854:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357862:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/28 locks to regular blp list, 28 blwis in pool 00002000:00010000:0.0:1777497670.357900:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x322:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1777497670.357905:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357911:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357913:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.357916:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357924:0:8396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357937:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357945:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.357978:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/29 locks to regular blp list, 29 blwis in pool 00010000:00010000:2.0:1777497670.357981:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358001:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358015:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d9da759/0x3e357265691d77a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358043:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 28 total in blp. (28 blwis in pool) 00010000:00010000:2.0:1777497670.358048:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358057:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358062:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358071:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358084:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358091:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000672cfba6/0x3e357265691d781 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358584:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 27 total in blp. (27 blwis in pool) 00010000:00010000:2.0:1777497670.358590:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358598:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358608:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358616:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358628:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358636:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce1a2684/0x3e357265691d788 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1777497670.358647:0:8396:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00010000:00010000:2.0:1777497670.358657:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 26 total in blp. (26 blwis in pool) 00010000:00010000:2.0:1777497670.358662:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358669:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358673:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358680:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358690:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358697:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e6e45d49/0x3e357265691d78f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358722:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 25 total in blp. (25 blwis in pool) 00010000:00010000:2.0:1777497670.358726:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358734:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:88693:x1863837564981504:12345-0@lo:5:osp-pre-0-0.0 Request processed in 37654us (37824us total) trans 0 rc 0/0 00010000:00010000:2.0:1777497670.358736:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358742:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358748:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5885 00010000:00010000:2.0:1777497670.358756:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358769:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358776:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062ebc07b/0x3e357265691d796 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358789:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 24 total in blp. (24 blwis in pool) 00010000:00010000:2.0:1777497670.358793:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358800:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358803:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358818:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335360 00010000:00010000:2.0:1777497670.358822:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358827:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335360 00010000:00010000:2.0:1777497670.358837:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358844:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000052ea58ea/0x3e357265691d79d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358858:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 23 total in blp. (23 blwis in pool) 00010000:00010000:0.0:1777497670.358862:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 3899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358863:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358884:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.358888:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358896:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358907:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2545 00010000:00010000:2.0:1777497670.358908:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358917:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d9eef0e/0x3e357265691d7a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x339:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.358921:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2415:x1863837546335360:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497670.358940:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497670.358967:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 3899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.358976:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 22 total in blp. (22 blwis in pool) 00010000:00010000:2.0:1777497670.358982:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.358983:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 3899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359002:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.359006:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359030:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359040:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691d67e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c34b expref: 8 pid: 25492 timeout: 3899 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359043:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359059:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97f56c2/0x3e357265691d7ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x338:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359061:0:10268:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.359064:0:10268:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497670.359072:0:10268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 7 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359079:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 21 total in blp. (21 blwis in pool) 00010000:00010000:2.0:1777497670.359084:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359084:0:10268:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 7 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359119:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.359124:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359147:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.359159:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359174:0:10268:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 7 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497670.359191:0:10268:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10268:1863837564982144:192.168.202.4@tcp:105: 00000100:00100000:0.0:1777497670.359263:0:10268:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a480 going to sleep for 11 seconds 00010000:00010000:0.0:1777497670.359290:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 20 total in blp. (20 blwis in pool) 00010000:00010000:0.0:1777497670.359295:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359301:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.359304:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359311:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359327:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359334:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d7b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x336:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359353:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 19 total in blp. (19 blwis in pool) 00010000:00010000:0.0:1777497670.359357:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359362:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.359366:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359373:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359382:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359389:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c459660/0x3e357265691d7c0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x335:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359403:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 18 total in blp. (18 blwis in pool) 00010000:00010000:0.0:1777497670.359406:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359418:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.359421:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359428:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359438:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359446:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6c86023/0x3e357265691d7c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x334:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.359460:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 17 total in blp. (17 blwis in pool) 00010000:00010000:0.0:1777497670.359463:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360010:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360014:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360023:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360035:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 1/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360049:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ffea69/0x3e357265691d7ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x333:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360064:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 16 total in blp. (16 blwis in pool) 00010000:00010000:0.0:1777497670.360068:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360075:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360078:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360086:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360118:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360126:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a6e3747/0x3e357265691d7d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x332:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360140:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 15 total in blp. (15 blwis in pool) 00010000:00010000:0.0:1777497670.360143:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360150:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360457:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360545:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360558:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360565:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092d018b0/0x3e357265691d7dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x331:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360571:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691d7b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x337:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360579:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 14 total in blp. (14 blwis in pool) 00010000:00010000:0.0:1777497670.360584:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360591:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360595:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360598:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 13 total in blp. (13 blwis in pool) 00010000:00010000:2.0:1777497670.360605:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360606:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360625:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360629:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360630:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360650:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f69a51fe/0x3e357265691d7e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x330:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360652:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.360668:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360675:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 12 total in blp. (12 blwis in pool) 00010000:00010000:0.0:1777497670.360679:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360684:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360688:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360695:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360705:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360711:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0194b7f/0x3e357265691d7f1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360721:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 11 total in blp. (11 blwis in pool) 00010000:00010000:0.0:1777497670.360725:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360730:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360733:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360750:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360759:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360766:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005489fbf3/0x3e357265691d7f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360776:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 10 total in blp. (10 blwis in pool) 00010000:00010000:0.0:1777497670.360779:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360784:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497670.360787:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360794:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360802:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497670.360808:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bdd71c9/0x3e357265691d7ff lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361271:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9b043d6/0x3e357265691d7ea lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361300:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 9 total in blp. (9 blwis in pool) 00010000:00010000:2.0:1777497670.361304:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361394:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361398:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361407:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361419:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361427:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000feb39963/0x3e357265691d806 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361442:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1777497670.361446:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361452:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361455:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361582:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361594:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361601:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42dd9c5/0x3e357265691d80d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361615:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1777497670.361619:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361625:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361628:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361635:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361644:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361652:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000424d7a52/0x3e357265691d814 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x329:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361674:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1777497670.361677:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361684:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361687:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361694:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361703:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361710:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000660863ff/0x3e357265691d81b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x328:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361721:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1777497670.361725:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361731:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361734:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361751:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361761:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361768:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041434b45/0x3e357265691d822 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x327:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361782:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777497670.361786:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361793:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361796:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361802:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361811:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361817:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b83c28ab/0x3e357265691d829 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x326:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361839:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1777497670.361843:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361849:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361852:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361859:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361869:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361876:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000770ef400/0x3e357265691d830 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x325:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361886:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497670.361889:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361895:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361897:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361915:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361924:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361931:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b44505dc/0x3e357265691d837 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x324:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361943:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497670.361947:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361966:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.361968:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361976:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361984:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.361991:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007af19434/0x3e357265691d83e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x323:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362014:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497670.362017:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362024:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497670.362026:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362034:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362042:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362049:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c829b178/0x3e357265691d845 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x322:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497670.362060:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.362062:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497670.362064:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363137:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363139:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363141:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363291:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363298:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497670.363303:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497670.363317:0:88693:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94de40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497670.363354:0:88693:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88693:1863837564981504:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1777497670.363369:0:88693:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x341:0x0] from OST, last_created [0x280000401:0x341:0x0]last_used is [0x280000401:0x302:0x0] 00000100:00100000:2.0:1777497670.363446:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564982272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497670.363461:0:88693:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88693:1863837564982400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1777497670.363682:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497670.363838:0:88693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497670.363870:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982400 00000100:00100000:0.0:1777497670.363876:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982400 00000100:00100000:0.0:1777497670.363933:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5889 00000100:00100000:0.0:1777497670.363943:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:88693:x1863837564982400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1777497670.363998:0:25491:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 834 00000100:00100000:1.0:1777497670.365417:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982272 00000100:00100000:1.0:1777497670.365427:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982272 00000100:00100000:1.0:1777497670.365479:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1777497670.365490:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564982272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497670.365525:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8649664 pending 896 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497670.365660:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+7:88693:x1863837564982400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1717us (1820us total) trans 4294969457 rc 0/0 00000100:00100000:0.0:1777497670.365667:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5889 00000100:00100000:0.0:1777497670.365699:0:88693:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497670.365726:0:88693:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:88693:1863837564982400:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1777497670.365739:0:88693:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x341:0x0]-[0x280000401:0x361:0x0] 00000100:00100000:1.0:1777497670.365866:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564982272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 379us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.365873:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:1.0:1777497670.365916:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564982272:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1777497670.370019:0:88943:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1777497670.370288:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497670.370351:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335616 00000100:00100000:0.0:1777497670.370367:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335616 00000100:00100000:0.0:1777497670.370414:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 235 00000100:00100000:0.0:1777497670.370425:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:70349:x1863837546335616:12345-192.168.202.4@tcp:35:cp.0 00000001:00080000:0.0:1777497670.370660:0:63731:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 81604378742 00000100:00100000:0.0:1777497670.370759:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+12:70349:x1863837546335616:12345-192.168.202.4@tcp:35:cp.0 Request processed in 335us (475us total) trans 81604378743 rc 0/0 00000100:00100000:0.0:1777497670.370767:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 235 00000020:00080000:0.0:1777497670.370772:0:63731:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777497670.371685:0:10268:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:10268:1863837564982144:192.168.202.4@tcp:105: 00010000:00010000:1.0:1777497670.371710:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497670.371789:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546335360:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 12872us (19610us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497670.371800:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2545 00010000:00010000:2.0:1777497670.823470:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497671.424721:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497671.424766:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497671.424771:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335872 00000100:00100000:2.0:1777497671.424780:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335872 00000100:00100000:0.0:1777497671.424804:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497671.424830:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497671.424837:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336000 00000100:00100000:2.0:1777497671.424840:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336000 00000100:00100000:0.0:1777497671.424851:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546335744 00000100:00100000:0.0:1777497671.424854:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546335744 00000100:00100000:2.0:1777497671.424869:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1311 00000100:00100000:2.0:1777497671.424878:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546335872:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497671.424881:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1777497671.424888:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546335744:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497671.424963:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546335744:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497671.424970:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 73 00000100:00100000:0.0:1777497671.425017:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1312 00000100:00100000:0.0:1777497671.425036:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:2412:x1863837546336000:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497671.426465:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546335872:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1580us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497671.426475:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1311 00000100:00100000:3.0:1777497671.428313:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336128 00000100:00100000:3.0:1777497671.428325:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336128 00000100:00100000:3.0:1777497671.428378:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2605 00000100:00100000:3.0:1777497671.428388:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546336128:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497671.428764:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:2412:x1863837546336000:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 3727us (3929us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497671.428775:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1312 00000100:00100000:3.0:1777497671.429576:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546336128:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 1185us (4804us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497671.429597:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2605 00000100:00080000:3.0:1777497671.429622:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:0.0:1777497671.537839:0:88995:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1777497671.539559:0:88995:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777497671.844516:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777497672.812408:0:89045:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497672.813412:0:89045:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777497672.871837:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497673.007499:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.007543:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336256 00000100:00100000:3.0:1777497673.007555:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336256 00000100:00100000:3.0:1777497673.007616:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1352 00000100:00100000:3.0:1777497673.007626:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:70615:x1863837546336256:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1777497673.007650:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497673.007671:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5bc00/0x3e357265691d84c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c359 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497673.007737:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1777497673.008247:0:63727:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 525us 00010000:00010000:1.0:1777497673.085524:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.085547:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.085562:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.085577:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.085584:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.085591:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497673.085798:0:63727:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63727:1863837564982528:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497673.085890:0:63727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497673.085941:0:63727:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497673.085986:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982528 00000100:00100000:1.0:1777497673.086009:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982528 00000100:00100000:1.0:1777497673.086060:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1777497673.086068:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63727:x1863837564982528:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1777497673.086173:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63727:x1863837564982528:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497673.086181:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4007 00000100:00100000:1.0:1777497673.086224:0:63727:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:63727:1863837564982528:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1777497673.086267:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086277:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086284:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497673.086315:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086327:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086334:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086340:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086356:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086362:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497673.086366:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086374:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086385:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497673.086388:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497673.086392:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086399:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca800/0x3e357265691d853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086409:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086414:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086419:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086422:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497673.086425:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086438:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086444:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff92409c7a4100) 00010000:00010000:1.0:1777497673.086446:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497673.086449:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086454:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691d85a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086484:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5bc00/0x3e357265691d84c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c359 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086498:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c359 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.086505:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff92409c7a4b00) 00010000:00010000:1.0:1777497673.086507:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497673.086509:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cbc00, rc 0) 00000100:00100000:1.0:1777497673.086551:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+8:70615:x1863837546336256:12345-192.168.202.4@tcp:101:rm.0 Request processed in 78927us (79063us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497673.086558:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1352 00000100:00100000:1.0:1777497673.099587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.099677:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336384 00000100:00100000:2.0:1777497673.099688:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336384 00000100:00100000:2.0:1777497673.099771:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1353 00000100:00080000:3.0:1777497673.099781:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497673.099783:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+12:70615:x1863837546336384:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497673.099815:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497673.099837:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b800/0x3e357265691d868 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c360 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.099898:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ba00/0x3e357265691d86f lrc: 3/1,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.099914:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ba00/0x3e357265691d86f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.099934:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ba00/0x3e357265691d86f lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497673.099993:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00000004:00200000:2.0:1777497673.099997:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777497673.100034:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b800/0x3e357265691d868 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c360 expref: 14 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.100068:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ba00/0x3e357265691d86f lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c360 expref: 13 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.100077:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:2.0:1777497673.100080:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1777497673.100083:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ba00, rc 0) 00000100:00100000:2.0:1777497673.100181:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+13:70615:x1863837546336384:12345-192.168.202.4@tcp:101:rm.0 Request processed in 401us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.100189:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1353 00000100:00100000:0.0:1777497673.118693:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.118790:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336640 00000100:00100000:3.0:1777497673.118801:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336640 00000100:00100000:3.0:1777497673.118865:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1354 00000100:00100000:3.0:1777497673.118885:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+13:70615:x1863837546336640:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:3.0:1777497673.118908:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497673.118941:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d876 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c367 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497673.119065:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:3.0:1777497673.119215:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d876 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c367 expref: 15 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.119229:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff923f847c8700) 00010000:00010000:3.0:1777497673.119245:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497673.119252:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d876 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c367 expref: 15 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.119272:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b200, rc 0) 00000100:00100000:3.0:1777497673.119330:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+14:70615:x1863837546336640:12345-192.168.202.4@tcp:101:rm.0 Request processed in 456us (647us total) trans 81604378744 rc 301/301 00000100:00100000:3.0:1777497673.119337:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1354 00000100:00100000:3.0:1777497673.134194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497673.134306:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546336768 00000100:00100000:0.0:1777497673.134317:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546336768 00000100:00100000:0.0:1777497673.134379:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:0.0:1777497673.134391:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+14:70615:x1863837546336768:12345-192.168.202.4@tcp:37:rm.0 00000100:00100000:2.0:1777497673.145602:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+14:70615:x1863837546336768:12345-192.168.202.4@tcp:37:rm.0 Request processed in 10652us (10857us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.145617:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 236 00000100:00100000:1.0:1777497673.161807:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.162014:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546337024 00000100:00100000:2.0:1777497673.162025:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546337024 00000100:00100000:2.0:1777497673.162133:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:2.0:1777497673.162144:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+14:70615:x1863837546337024:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:2.0:1777497673.162431:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+15:70615:x1863837546337024:12345-192.168.202.4@tcp:35:rm.0 Request processed in 288us (633us total) trans 81604378745 rc 0/0 00000100:00100000:2.0:1777497673.162439:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 237 00000100:00100000:0.0:1777497673.168989:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.169214:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546337280 00000100:00100000:2.0:1777497673.169225:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546337280 00000100:00100000:2.0:1777497673.169336:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1355 00000100:00100000:2.0:1777497673.169346:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+15:70615:x1863837546337280:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497673.169374:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497673.169412:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b800/0x3e357265691d884 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c36e expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.169519:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ac00/0x3e357265691d88b lrc: 3/1,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.169534:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ac00/0x3e357265691d88b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.169546:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ac00/0x3e357265691d88b lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497673.169557:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:2.0:1777497673.169909:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b800/0x3e357265691d884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c36e expref: 18 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.169945:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ac00/0x3e357265691d88b lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c36e expref: 17 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.169953:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:2.0:1777497673.169956:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777497673.169959:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ac00, rc 0) 00000100:00100000:2.0:1777497673.170033:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+17:70615:x1863837546337280:12345-192.168.202.4@tcp:101:rm.0 Request processed in 688us (1157us total) trans 81604378746 rc 0/0 00000100:00100000:2.0:1777497673.170040:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1355 00000100:00100000:3.0:1777497673.176437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497673.177833:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546337408 00000100:00100000:1.0:1777497673.177846:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546337408 00000100:00100000:1.0:1777497673.177971:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1356 00000100:00100000:1.0:1777497673.177997:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+17:70615:x1863837546337408:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:1.0:1777497673.178024:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497673.178055:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca000/0x3e357265691d899 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c375 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178150:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 3/1,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178166:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178177:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497673.178224:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00000004:00200000:1.0:1777497673.178228:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497673.178250:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 3/1,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178275:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca000/0x3e357265691d899 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c375 expref: 19 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178465:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 3/0,0 mode: PR/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c375 expref: 18 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.178474:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:1.0:1777497673.178477:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497673.178480:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cb200, rc 0) 00000100:00100000:1.0:1777497673.178552:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+18:70615:x1863837546337408:12345-192.168.202.4@tcp:101:rm.0 Request processed in 559us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497673.178568:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1356 00000100:00100000:1.0:1777497673.182953:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.184032:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546337664 00000100:00100000:2.0:1777497673.184149:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546337664 00000100:00100000:2.0:1777497673.184228:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1357 00000100:00100000:2.0:1777497673.184239:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+18:70615:x1863837546337664:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497673.184278:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497673.184313:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe200/0x3e357265691d8a7 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c37c expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497673.184426:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1777497673.184528:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe200/0x3e357265691d8a7 lrc: 1/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c37c expref: 20 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.184541:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:2.0:1777497673.184545:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777497673.184550:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe200/0x3e357265691d8a7 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c37c expref: 20 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.184562:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe200, rc 0) 00000100:00100000:2.0:1777497673.184621:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+19:70615:x1863837546337664:12345-192.168.202.4@tcp:101:rm.0 Request processed in 384us (1678us total) trans 81604378747 rc 301/301 00000100:00100000:2.0:1777497673.184629:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1357 00000100:00100000:1.0:1777497673.191071:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.191196:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546337792 00000100:00100000:2.0:1777497673.191207:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546337792 00000100:00100000:2.0:1777497673.191263:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:2.0:1777497673.191273:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+19:70615:x1863837546337792:12345-192.168.202.4@tcp:37:rm.0 00000100:00100000:3.0:1777497673.202421:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+19:70615:x1863837546337792:12345-192.168.202.4@tcp:37:rm.0 Request processed in 10604us (10813us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.202436:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 238 00000100:00100000:0.0:1777497673.206507:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.206593:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546338048 00000100:00100000:3.0:1777497673.206604:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546338048 00000100:00100000:3.0:1777497673.206744:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:3.0:1777497673.206754:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+19:70615:x1863837546338048:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:2.0:1777497673.207901:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+20:70615:x1863837546338048:12345-192.168.202.4@tcp:35:rm.0 Request processed in 1144us (1397us total) trans 81604378748 rc 0/0 00000100:00100000:2.0:1777497673.207912:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 239 00000100:00100000:0.0:1777497673.212962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.214027:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546338304 00000100:00100000:2.0:1777497673.214039:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546338304 00000100:00100000:2.0:1777497673.214143:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1358 00000100:00100000:2.0:1777497673.214168:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+20:70615:x1863837546338304:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497673.214198:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497673.214219:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe200/0x3e357265691d8b5 lrc: 2/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c383 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.214348:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff200/0x3e357265691d8bc lrc: 3/1,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.214364:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff200/0x3e357265691d8bc lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.214376:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff200/0x3e357265691d8bc lrc: 3/1,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497673.214388:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:2.0:1777497673.214497:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe200/0x3e357265691d8b5 lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c383 expref: 23 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.214515:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff200/0x3e357265691d8bc lrc: 3/0,0 mode: CR/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c383 expref: 22 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.214524:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:2.0:1777497673.214527:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1777497673.214531:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff200, rc 0) 00000100:00100000:2.0:1777497673.214601:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546338304:12345-192.168.202.4@tcp:101:rm.0 Request processed in 434us (1649us total) trans 81604378749 rc 0/0 00000100:00100000:2.0:1777497673.214608:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1358 00000100:00100000:2.0:1777497673.224914:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.225018:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546338432 00000100:00100000:3.0:1777497673.225028:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546338432 00000100:00100000:3.0:1777497673.225084:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1359 00000100:00100000:3.0:1777497673.225116:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+8:70615:x1863837546338432:12345-192.168.202.4@tcp:41:rm.0 00000004:00000024:3.0:1777497673.225168:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 7846010880 avail 7382966272 00000100:00100000:3.0:1777497673.225239:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+8:70615:x1863837546338432:12345-192.168.202.4@tcp:41:rm.0 Request processed in 146us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.225248:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1359 00000100:00100000:0.0:1777497673.230594:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.230684:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546338688 00000100:00100000:3.0:1777497673.230707:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546338688 00000100:00100000:3.0:1777497673.230766:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1360 00000100:00100000:3.0:1777497673.230776:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546338688:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1777497673.230832:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777497673.230858:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902bc00/0x3e357265691d669 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c344 expref: 22 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.230888:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff924090680600) 00010000:00010000:3.0:1777497673.230931:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb200/0x3e357265691d8a0 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c375 expref: 21 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.230942:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:3.0:1777497673.230945:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497673.230965:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,1 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.230978:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.230987:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.230998:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: --/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231005:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231010:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231361:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,1 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231370:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231377:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1777497673.231577:0:73210:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x4c:0x0].2, 64 off8320 00000004:00080000:3.0:1777497673.231586:0:73210:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3802572490747ns, next at 3803572488517ns, rc = 0 00010000:00010000:3.0:1777497673.231633:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231642:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231650:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231658:0:73210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231664:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 4/0,1 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231670:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231708:0:73210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497673.231726:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,1 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231739:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 2/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231745:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231751:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497673.231755:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 3/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231761:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 4/0,0 mode: EX/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231770:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff923f847c8700) 00010000:00010000:3.0:1777497673.231772:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1777497673.231776:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 2/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231782:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691d8d8 lrc: 0/0,0 mode: --/EX res: [0x2400090a5:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231797:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231802:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 2/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231807:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231812:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497673.231820:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231826:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231835:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:3.0:1777497673.231838:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497673.231841:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 2/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231847:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b200/0x3e357265691d8ca lrc: 0/0,0 mode: --/CW res: [0x240006991:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497673.231857:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000008b0b641 reply state 00000000871778d9 transno 81604378750 ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.231869:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232058:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497673.232071:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232076:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497673.232080:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 2/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232085:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 3/0,0 mode: PW/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232115:0:8412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x1:0x0].0x0 (ffff923f847c8700) 00010000:00010000:2.0:1777497673.232117:0:8412:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777497673.232121:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 1/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232126:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691d8df lrc: 0/0,0 mode: --/PW res: [0x2400090a5:0x1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.232138:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497673.232139:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497673.232141:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497673.232611:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff923f847c8b00) 00010000:00010000:3.0:1777497673.232615:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497673.232618:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497673.233057:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546338688:12345-192.168.202.4@tcp:36:rm.0 Request processed in 2269us (2459us total) trans 81604378750 rc 0/0 00000100:00100000:3.0:1777497673.233066:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1360 00000100:00100000:3.0:1777497673.239750:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497673.239840:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546338944 00000100:00100000:0.0:1777497673.239851:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546338944 00000100:00100000:0.0:1777497673.239932:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:0.0:1777497673.239944:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546338944:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:0.0:1777497673.240218:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+23:70615:x1863837546338944:12345-192.168.202.4@tcp:35:rm.0 Request processed in 276us (476us total) trans 81604378751 rc 0/0 00000100:00100000:0.0:1777497673.240226:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 240 00000100:00100000:2.0:1777497673.247312:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497673.247417:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546339200 00000100:00100000:1.0:1777497673.247427:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546339200 00000100:00100000:1.0:1777497673.247485:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1361 00000100:00100000:1.0:1777497673.247496:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+23:70615:x1863837546339200:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:1.0:1777497673.247555:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1777497673.247580:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff200/0x3e357265691d8bc lrc: 0/0,0 mode: --/CR res: [0x240006991:0xc:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c383 expref: 23 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247603:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd9600/0x3e357265691d3d0 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xc:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c313 expref: 22 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247614:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff9240b565d000) 00010000:00010000:1.0:1777497673.247629:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ba00/0x3e357265691d86f lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c360 expref: 21 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247637:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:1.0:1777497673.247639:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497673.247661:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 3/0,1 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247688:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247699:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 3/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247730:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: --/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247738:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247745:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247824:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247833:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.247839:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497673.248088:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xc:0x0]: returning size 4096 00010000:00010000:1.0:1777497673.248159:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248167:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248173:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248179:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cac00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497673.248183:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248202:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248210:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0x0 (ffff92409c7a4800) 00010000:00010000:1.0:1777497673.248213:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497673.248218:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248224:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cac00/0x3e357265691d8f4 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xc:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248244:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248249:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 4/0,1 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248254:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 3/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248260:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248265:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497673.248267:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 4/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248272:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 5/0,0 mode: CW/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248278:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:1.0:1777497673.248286:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497673.248289:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 3/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248295:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb800/0x3e357265691d8e6 lrc: 0/0,0 mode: --/CW res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497673.248303:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000021dc7162 reply state 00000000ab15c929 transno 81604378752 ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: PW/PW res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248313:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.248319:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff92409c7a4100) 00010000:00010000:1.0:1777497673.248321:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497673.248324:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497673.248401:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546339200:12345-192.168.202.4@tcp:36:rm.0 Request processed in 906us (1096us total) trans 81604378752 rc 0/0 00000100:00100000:1.0:1777497673.248408:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1361 00000100:00100000:2.0:1777497673.254980:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.255022:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497673.255149:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546339584 00000100:00100000:0.0:1777497673.255159:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546339584 00000100:00100000:0.0:1777497673.255218:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:0.0:1777497673.255229:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546339584:12345-192.168.202.4@tcp:35:rm.0 00000100:00100000:0.0:1777497673.255456:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+23:70615:x1863837546339584:12345-192.168.202.4@tcp:35:rm.0 Request processed in 229us (432us total) trans 81604378753 rc 0/0 00000100:00100000:0.0:1777497673.255464:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 241 00000100:00100000:3.0:1777497673.256172:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546339328 00000100:00100000:3.0:1777497673.256179:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546339328 00000100:00100000:3.0:1777497673.256230:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 718 00000100:00100000:3.0:1777497673.256239:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:2413:x1863837546339328:12345-192.168.202.4@tcp:103:rm.0 00010000:00010000:3.0:1777497673.256266:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497673.256301:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691d861 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c359 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.256318:0:25500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff92409c7a4b00) 00010000:00010000:3.0:1777497673.256328:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497673.256377:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546339328:12345-192.168.202.4@tcp:103:rm.0 Request processed in 140us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.256384:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 718 00000100:00100000:2.0:1777497673.261177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497673.261393:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546339840 00000100:00100000:3.0:1777497673.261403:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546339840 00000100:00100000:3.0:1777497673.261463:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1362 00000100:00100000:3.0:1777497673.261473:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+23:70615:x1863837546339840:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:3.0:1777497673.261530:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1777497673.261556:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902ac00/0x3e357265691d88b lrc: 0/0,0 mode: --/CR res: [0x240006991:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c36e expref: 23 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.261578:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f82fd8200/0x3e357265691d3b4 lrc: 0/0,0 mode: --/PR res: [0x240006991:0xb:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c30c expref: 22 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.261589:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff9240b565d300) 00010000:00010000:3.0:1777497673.261600:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497673.261646:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x10000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.261654:0:63729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x0 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.261692:0:63729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x1000000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497673.261714:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564982656:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1777497673.261760:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497673.261793:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408c1bdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497673.261841:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982656 00000100:00100000:0.0:1777497673.261846:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982656 00000100:00100000:0.0:1777497673.261899:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4008 00000100:00100000:0.0:1777497673.261907:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:63729:x1863837564982656:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1777497673.261917:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497673.261941:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d8fb expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.261963:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 6 pid: 88707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.261973:0:8407:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.261996:0:8407:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 6 pid: 88707 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.262008:0:8407:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 6 pid: 88707 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497673.262018:0:8407:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8407:1863837564982784:192.168.202.4@tcp:104: 00000100:00100000:0.0:1777497673.262089:0:8407:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497673.266523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497673.266642:0:8407:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8407:1863837564982784:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497673.266688:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.266701:0:8407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497673.266714:0:8407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497673.266719:0:8407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.266729:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee200, rc 0) 00000100:00100000:2.0:1777497673.266791:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63729:x1863837564982656:12345-0@lo:101:mdt00_002.0 Request processed in 4884us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.266799:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4008 00000100:00100000:3.0:1777497673.266900:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564982656:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1777497673.266919:0:63729:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.266939:0:63729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497673.267298:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546339968 00000100:00100000:1.0:1777497673.267307:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546339968 00010000:00010000:1.0:1777497673.267337:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497673.267371:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2546 00000100:00100000:1.0:1777497673.267380:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546339968:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497673.267394:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497673.267400:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267424:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267444:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691d63f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c2fe expref: 7 pid: 88707 timeout: 3902 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267458:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497673.267463:0:6501:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267472:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267481:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.267514:0:6501:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 8 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497673.267527:0:6501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6501:1863837564982912:0@lo:105: 00000100:00100000:1.0:1777497673.267565:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497673.267602:0:6501:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497673.267689:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564982912 00000100:00100000:3.0:1777497673.267693:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564982912 00000100:00100000:3.0:1777497673.267726:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1777497673.267733:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6501:x1863837564982912:12345-0@lo:105: 00010000:00010000:3.0:1777497673.267742:0:13186:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267750:0:13186:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267758:0:13186:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267765:0:13186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267777:0:13186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267784:0:13186:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 6/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.267808:0:13186:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9240baa5b200) 00000100:00100000:3.0:1777497673.267843:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6501:x1863837564982912:12345-0@lo:105: Request processed in 110us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.267848:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:1.0:1777497673.268302:0:63729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.268311:0:63729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1777497673.268346:0:63729:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:1.0:1777497673.268380:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.268389:0:63729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497673.268399:0:63729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497673.268415:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983040:0@lo:101:mdt00_002.0 00000100:00100000:1.0:1777497673.268446:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497673.268475:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497673.268545:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983040 00000100:00100000:3.0:1777497673.268550:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983040 00000100:00100000:3.0:1777497673.268582:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4009 00000100:00100000:3.0:1777497673.268590:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:63729:x1863837564983040:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1777497673.268605:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497673.268620:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691d910 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d909 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.268640:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691d910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d909 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.268650:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691d910 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d909 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.268656:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff923f847c8200) 00010000:00010000:3.0:1777497673.268659:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497673.268668:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ae00, rc 0) 00000100:00100000:3.0:1777497673.268718:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983040:12345-0@lo:101:mdt00_002.0 Request processed in 129us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.268724:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4009 00000100:00100000:0.0:1777497673.268791:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983040:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1777497673.268804:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.268812:0:63729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497673.268836:0:63729:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00000100:00100000:0.0:1777497673.268870:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983168:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1777497673.268910:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497673.268941:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497673.269173:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983168 00000100:00100000:3.0:1777497673.269178:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983168 00000100:00100000:3.0:1777497673.269204:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4010 00000100:00100000:3.0:1777497673.269210:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983168:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777497673.269277:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983168:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.269283:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4010 00000100:00100000:3.0:1777497673.269310:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983168:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777497673.269352:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983296:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777497673.269380:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497673.269394:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408c1bd300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497673.269405:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983296 00000100:00100000:3.0:1777497673.269408:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983296 00000100:00100000:3.0:1777497673.269427:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1777497673.269432:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983296:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777497673.269498:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983296:12345-0@lo:1000:mdt00_002.0 Request processed in 66us (118us total) trans 0 rc 1/1 00000100:00100000:3.0:1777497673.269504:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4011 00000100:00100000:3.0:1777497673.269530:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983296:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1777497673.269570:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.269577:0:63729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.269592:0:63729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497673.269604:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983424:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1777497673.269624:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497673.269636:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497673.269647:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983424 00000100:00100000:3.0:1777497673.269650:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983424 00000100:00100000:3.0:1777497673.269668:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4012 00000100:00100000:3.0:1777497673.269825:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:63729:x1863837564983424:12345-0@lo:101:mdt00_002.0 00010000:00010000:3.0:1777497673.269836:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497673.269848:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691d91e lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d917 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.269866:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691d91e lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d917 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.270029:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691d91e lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d917 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.270038:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff923f847c8900) 00010000:00010000:3.0:1777497673.270042:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497673.270044:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b000, rc 0) 00000100:00100000:3.0:1777497673.270213:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:63729:x1863837564983424:12345-0@lo:101:mdt00_002.0 Request processed in 539us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.270219:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4012 00000100:00100000:2.0:1777497673.270330:0:6501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f841a7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0000_UUID:6501:1863837564982912:0@lo:105: 00010000:00010000:2.0:1777497673.270344:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497673.270396:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546339968:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 3016us (3881us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.270406:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2546 00000100:00100000:0.0:1777497673.274380:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:63729:1863837564983424:0@lo:101:mdt00_002.0 00010000:00010000:0.0:1777497673.274413:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.274428:0:63729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.274473:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,1 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.274483:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.274491:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1777497673.275741:0:63729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].3, 432 off36352 00000040:00080000:0.0:1777497673.275794:0:63729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].3, 512 off36784 00000004:00080000:0.0:1777497673.275800:0:63729:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff923f83e2aa80 with version 11 00000004:00080000:2.0:1777497673.275902:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 11 rpc_version 11 00000020:00100000:2.0:1777497673.275944:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777497673.275955:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9240b5693b80 x1863837564983680/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 1760/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497673.275978:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564983680:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497673.276042:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497673.276075:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497673.276220:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983680 00000100:00100000:0.0:1777497673.276228:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983680 00000100:00100000:0.0:1777497673.276270:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4013 00000100:00100000:0.0:1777497673.276278:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72705:x1863837564983680:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777497673.279633:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72705:x1863837564983680:12345-0@lo:1000:osp_up0-1.0 Request processed in 3348us (3583us total) trans 115964116994 rc 0/0 00000100:00100000:0.0:1777497673.279648:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4013 00000100:00100000:2.0:1777497673.280683:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564983680:0@lo:1000:osp_up0-1.0 00000004:00200000:0.0:1777497673.280990:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240006991:0xb:0x0]: returning size 4096 00010000:00010000:0.0:1777497673.281014:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281024:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281032:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281038:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497673.281043:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281051:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 4/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281068:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff92409c15ef00) 00010000:00010000:0.0:1777497673.281071:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497673.281076:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281081:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691d925 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281170:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281200:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 4/0,1 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281207:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281276:0:63729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1777497673.281299:0:63729:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1777497673.281305:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281311:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.281317:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281428:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497673.281436:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 2/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281443:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a400 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:2.0:1777497673.281447:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497673.281462:0:6503:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 3/0,0 mode: EX/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281498:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 2/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281504:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1777497673.281564:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1777497673.281581:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 1/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281589:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a400/0x3e357265691d917 lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d91e expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281605:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497673.281608:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281613:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b200 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:2.0:1777497673.281616:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497673.281623:0:6503:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281641:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 4/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281648:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497673.281688:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.281697:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497673.281699:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497673.281701:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497673.281716:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564983936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497673.281775:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497673.281834:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983936 00000100:00100000:2.0:1777497673.281841:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983936 00000100:00100000:2.0:1777497673.282473:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:2.0:1777497673.282485:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+12:3659:x1863837564983936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497673.282500:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497673.282520:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691d902 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d8fb expref: 12 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497673.282534:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497673.282538:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497673.282594:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0001-mdtlov_UUID+11:3659:x1863837564983936:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.282600:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:3.0:1777497673.282754:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564983936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497673.282849:0:63729:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1777497673.282856:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5b200/0x3e357265691d8fb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d902 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497673.282872:0:63729:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x200000007:0x1:0x0] 00010000:00010000:0.0:1777497673.282889:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 4/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497673.282897:0:63729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497673.282985:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+22:70615:x1863837546339840:12345-192.168.202.4@tcp:36:rm.0 Request processed in 21513us (21817us total) trans 81604378754 rc 0/0 00000100:00100000:0.0:1777497673.282992:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1362 00010000:00010000:2.0:1777497673.291034:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497673.297499:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564983808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497673.297591:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497673.298640:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564983808 00000100:00100000:3.0:1777497673.298652:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564983808 00000100:00100000:3.0:1777497673.298733:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1777497673.298743:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+11:3657:x1863837564983808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497673.298760:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497673.298785:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691d91e lrc: 0/0,0 mode: --/EX res: [0x240006991:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d917 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497673.298806:0:25500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0x0 (ffff923f847c8900) 00010000:00010000:3.0:1777497673.298815:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497673.298884:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3657:x1863837564983808:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497673.298892:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:2.0:1777497673.299030:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564983808:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497673.762643:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564984064:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497673.762728:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497673.763016:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984064 00000100:00100000:1.0:1777497673.763025:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984064 00000100:00100000:1.0:1777497673.763112:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2126 00000100:00100000:1.0:1777497673.763123:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564984064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497673.763168:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497673.763217:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837564984064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497673.763224:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2126 00000100:00080000:2.0:1777497673.763988:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497673.764041:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564984064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497673.765334:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497673.765354:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564984192:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497673.765415:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497673.765939:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984192 00000100:00100000:2.0:1777497673.765947:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984192 00000100:00100000:2.0:1777497673.766011:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1777497673.766021:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564984192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497673.766048:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497673.766120:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564984192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497673.766127:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00080000:3.0:1777497673.766395:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497673.767403:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564984192:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1777497673.890276:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497674.916682:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497675.301416:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497675.301448:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564984320:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497675.301523:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497675.301571:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984320 00000100:00100000:3.0:1777497675.301579:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984320 00000100:00100000:3.0:1777497675.301640:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4014 00000100:00100000:3.0:1777497675.301650:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564984320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497675.301687:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445437440 avail 1299197952 00000100:00100000:3.0:1777497675.301731:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564984320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497675.301737:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4014 00000100:00100000:3.0:1777497675.301782:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564984320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497675.309290:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564984448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309365:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309403:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564984960:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309439:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309459:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564985472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309479:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309503:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777497675.309508:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564984576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309528:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309546:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564985088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309567:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309582:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564985600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309603:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309633:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564984832:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309657:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309673:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564985344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309692:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309708:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564985856:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309726:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309743:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1777497675.309749:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564984704:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309768:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309782:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564985216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309799:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309813:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564985728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.309837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.309867:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984448 00000100:00100000:1.0:1777497675.309882:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984448 00000100:00100000:1.0:1777497675.309953:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1777497675.309962:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564984448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310014:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564984448:12345-0@lo:400:kworker.0 Request processed in 53us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310020:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1777497675.310056:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984960 00000100:00100000:1.0:1777497675.310061:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984960 00000100:00100000:1.0:1777497675.310090:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985472 00000100:00100000:1.0:1777497675.310117:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985472 00000100:00100000:1.0:1777497675.310132:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984576 00000100:00100000:1.0:1777497675.310135:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984576 00000100:00100000:1.0:1777497675.310146:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984832 00000100:00100000:1.0:1777497675.310149:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984832 00000100:00100000:1.0:1777497675.310160:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985856 00000100:00100000:1.0:1777497675.310162:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985856 00000100:00100000:1.0:1777497675.310171:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564984704 00000100:00100000:1.0:1777497675.310173:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564984704 00000100:00100000:1.0:1777497675.310184:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1777497675.310189:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564984960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310222:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564984960:12345-0@lo:400:kworker.0 Request processed in 32us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310227:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:1.0:1777497675.310238:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1777497675.310243:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564985472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310268:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564985472:12345-0@lo:400:kworker.0 Request processed in 24us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310273:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:1.0:1777497675.310284:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1777497675.310298:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564984576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310325:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837564984576:12345-0@lo:400:kworker.0 Request processed in 29us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310330:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:1.0:1777497675.310343:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1777497675.310348:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564984832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310378:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837564984832:12345-0@lo:400:kworker.0 Request processed in 29us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310383:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1777497675.310394:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1777497675.310400:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564985856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310424:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564985856:12345-0@lo:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310430:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1777497675.310440:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1777497675.310445:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564984704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310468:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564984704:12345-0@lo:400:kworker.0 Request processed in 24us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310473:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1777497675.310493:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985088 00000100:00100000:1.0:1777497675.310497:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985088 00000100:00100000:1.0:1777497675.310523:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1777497675.310528:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3659:x1863837564985088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310567:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3659:x1863837564985088:12345-0@lo:400:kworker.0 Request processed in 39us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310581:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4015 00000100:00100000:1.0:1777497675.310601:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985600 00000100:00100000:1.0:1777497675.310605:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985600 00000100:00100000:1.0:1777497675.310629:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985344 00000100:00100000:1.0:1777497675.310632:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985344 00000100:00100000:1.0:1777497675.310650:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985216 00000100:00100000:1.0:1777497675.310652:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985216 00000100:00100000:1.0:1777497675.310670:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985728 00000100:00100000:1.0:1777497675.310673:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985728 00000100:00100000:1.0:1777497675.310691:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2606 00000100:00100000:1.0:1777497675.310697:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564985600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310726:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837564985600:12345-0@lo:400:kworker.0 Request processed in 30us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310732:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2606 00000100:00100000:1.0:1777497675.310742:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1777497675.310748:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564985344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310776:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564985344:12345-0@lo:400:kworker.0 Request processed in 28us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310780:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2607 00000100:00100000:1.0:1777497675.310790:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1777497675.310795:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564985216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310818:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564985216:12345-0@lo:400:kworker.0 Request processed in 23us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310822:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2608 00000100:00100000:1.0:1777497675.310832:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1777497675.310837:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564985728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310872:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837564985728:12345-0@lo:400:kworker.0 Request processed in 34us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.310877:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2609 00000100:00100000:1.0:1777497675.310938:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837564984576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310951:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089384380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564985088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310961:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564985600:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310969:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564984448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310979:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089386680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564984960:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.310988:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564985472:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311028:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564984704:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311037:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089387800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564985216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311047:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564985728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311056:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837564984832:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311066:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564985344:0@lo:400:kworker.0 00000100:00100000:1.0:1777497675.311078:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564985856:0@lo:400:kworker.0 00000100:00080000:1.0:1777497675.311195:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497675.311199:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497675.311202:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497675.311204:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497675.311453:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497675.311464:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564985984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497675.311500:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497675.311654:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564985984 00000100:00100000:3.0:1777497675.311664:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564985984 00000100:00100000:3.0:1777497675.311703:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1777497675.311711:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1863837564985984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497675.311746:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:3.0:1777497675.311786:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:3660:x1863837564985984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497675.311792:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4016 00000100:00100000:3.0:1777497675.311825:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564985984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497675.812817:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564986112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497675.812961:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564986240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497675.813026:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.813087:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986240 00000100:00100000:3.0:1777497675.813414:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497675.813454:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986112 00000100:00100000:3.0:1777497675.813460:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986112 00000100:00100000:3.0:1777497675.813503:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:3.0:1777497675.813512:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564986112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497675.813540:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497675.813582:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837564986112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497675.813589:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1777497675.814000:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564986112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1777497675.815880:0:72699:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497675.815908:0:72699:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.815971:0:72699:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.815978:0:72699:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497675.816013:0:72699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff923f896cae00/0x3e357265691d909 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691d910 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497675.816033:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378754 is committed 00000004:00080000:0.0:1777497675.816061:0:72699:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 2 committed 00000100:00100000:0.0:1777497675.816213:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497675.816233:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564986368:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1777497675.816295:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497675.816340:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986368 00000100:00100000:0.0:1777497675.816347:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986368 00000100:00100000:0.0:1777497675.816391:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1777497675.816399:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+10:3657:x1863837564986368:12345-0@lo:103:jbd2/dm-1-8.0 00010000:00010000:0.0:1777497675.816413:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497675.816432:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691d910 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x8401ce4f bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d909 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.816447:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8401ce4f (ffff923f847c8200) 00010000:00010000:0.0:1777497675.816456:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497675.816489:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:3657:x1863837564986368:12345-0@lo:103:jbd2/dm-1-8.0 Request processed in 90us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497675.816496:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:0.0:1777497675.816535:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564986368:0@lo:103:jbd2/dm-1-8.0 00000100:00100000:0.0:1777497675.816652:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564986496:0@lo:6:osp-syn-0-1.0 00000100:00100000:0.0:1777497675.816680:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497675.816841:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986240 00000100:00100000:1.0:1777497675.816882:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1777497675.816890:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564986240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497675.816925:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1777497675.816966:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837564986240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (3940us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497675.816972:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1777497675.817007:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564986240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1777497675.817136:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817147:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817152:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817158:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497675.817162:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817167:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817178:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff923f847c8b00) 00010000:00010000:2.0:1777497675.817181:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497675.817185:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817201:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924087d39200/0x3e357265691d662 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817220:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817225:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817229:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817233:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497675.817235:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817240:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817250:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xc:0x0].0xb1bed465 (ffff923f847c8b00) 00010000:00010000:2.0:1777497675.817252:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497675.817255:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817259:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691d8d1 lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xc:0x0].0xb1bed465 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817273:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,1 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817279:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 2/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817291:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817297:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497675.817299:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 3/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817305:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 4/0,0 mode: TXN/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817312:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240006991:0xb:0x0].0xf7117594 (ffff92409c7a4100) 00010000:00010000:2.0:1777497675.817314:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497675.817317:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 2/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817322:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896ca400/0x3e357265691d8ed lrc: 0/0,0 mode: --/TXN res: [0x240006991:0xb:0x0].0xf7117594 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497675.817348:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986496 00000100:00100000:2.0:1777497675.817353:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986496 00000100:00100000:2.0:1777497675.817391:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5890 00000100:00100000:2.0:1777497675.817399:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564986496:12345-0@lo:6:osp-syn-0-1.0 00002000:00080000:2.0:1777497675.817417:0:8398:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000400:1570 count 1 00010000:00010000:2.0:1777497675.817437:0:8398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817456:0:8398:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817475:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777497675.817477:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1777497675.817480:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817508:0:8398:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.817520:0:8398:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 3905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497675.817532:0:8398:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1863837564986624:192.168.202.4@tcp:104: 00000100:00100000:2.0:1777497675.817610:0:8398:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff180 going to sleep for 11 seconds 00000001:00080000:2.0:1777497675.818585:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969457 is committed 00000001:00100000:2.0:1777497675.818635:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00080000:3.0:1777497675.820590:0:88674:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116994 is committed 00000001:00080000:1.0:1777497675.821943:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969452 is committed 00000100:00100000:2.0:1777497675.839395:0:8398:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8398:1863837564986624:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497675.839427:0:8398:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497675.839510:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497675.839591:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340096 00000100:00100000:2.0:1777497675.839599:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340096 00010000:00010000:2.0:1777497675.839658:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 3905 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1777497675.839692:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497675.839703:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2547 00000100:00100000:2.0:1777497675.839726:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:2412:x1863837546340096:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777497675.839740:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497675.839746:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 3905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.839757:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 3905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.839780:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e89544fa/0x3e357265691d6a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400030020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c352 expref: 6 pid: 25493 timeout: 3905 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.839796:0:6500:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497675.839798:0:6500:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497675.839803:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.839813:0:6500:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.839847:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497675.839907:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546340096:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 175us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497675.839915:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2547 00010000:00010000:0.0:1777497675.839983:0:8398:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.839993:0:8398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.840002:0:8398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.840017:0:8398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497675.840038:0:8398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1777497675.840248:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3659:x1863837564986496:12345-0@lo:6:osp-syn-0-1.0 Request processed in 22848us (23566us total) trans 4294969458 rc 0/0 00000100:00100000:0.0:1777497675.840255:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5890 00000004:00080000:1.0:1777497675.840341:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff924089358a80/2, rc 0, transno 4294969458 00000100:00100000:1.0:1777497675.840347:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564986496:0@lo:6:osp-syn-0-1.0 00010000:00010000:2.0:1777497675.840472:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497675.840478:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.840499:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497675.840503:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.840512:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.840525:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.840532:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000120883d0/0x3e357265691d92c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497675.840551:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497675.840553:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497675.840554:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497675.938424:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497676.635035:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497676.635189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497676.635212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497676.635251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497676.638636:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340352 00000100:00100000:2.0:1777497676.638651:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340352 00000100:00100000:2.0:1777497676.638739:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340480 00000100:00100000:2.0:1777497676.638743:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340480 00000100:00100000:2.0:1777497676.638768:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1319 00000100:00100000:2.0:1777497676.638778:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546340352:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497676.638857:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546340352:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 80us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497676.638864:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1319 00000100:00100000:2.0:1777497676.638907:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1320 00000100:00100000:2.0:1777497676.638914:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546340480:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497676.638943:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546340480:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497676.638948:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1320 00000100:00100000:3.0:1777497676.639307:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340608 00000100:00100000:3.0:1777497676.639313:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340608 00000100:00100000:3.0:1777497676.639356:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2610 00000100:00100000:3.0:1777497676.639363:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546340608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497676.639392:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546340608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (4140us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497676.639407:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2610 00000100:00080000:1.0:1777497676.640598:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497676.640616:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497676.645077:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340224 00000100:00100000:0.0:1777497676.645128:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340224 00000100:00100000:0.0:1777497676.645209:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:0.0:1777497676.645220:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546340224:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497676.645294:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546340224:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 77us (10268us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497676.645301:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00010000:00010000:2.0:1777497676.962430:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497677.990967:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497678.882315:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564986752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497678.882388:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497678.882405:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497678.882422:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564986880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497678.882543:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986752 00000100:00100000:3.0:1777497678.882550:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986752 00000100:00100000:1.0:1777497678.882585:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497678.882655:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564986880 00000100:00100000:2.0:1777497678.882661:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564986880 00000100:00100000:3.0:1777497678.882909:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1777497678.882919:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564986752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497678.882948:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497678.882992:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1863837564986752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497678.882998:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:3.0:1777497678.883044:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564986752:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1777497678.886392:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497678.886403:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497678.887299:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1777497678.887316:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564986880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497678.887357:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497678.887444:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564986880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 135us (4858us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497678.887451:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1777497678.887812:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564986880:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1777497679.011490:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497680.042201:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497680.421396:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497680.421419:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564987136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497680.421494:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497680.421569:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987136 00000100:00100000:0.0:1777497680.421577:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987136 00000100:00100000:0.0:1777497680.421628:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4017 00000100:00100000:0.0:1777497680.421652:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564987136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497680.421690:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445236736 avail 1298997248 00000100:00100000:0.0:1777497680.421739:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837564987136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497680.421746:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4017 00000100:00100000:0.0:1777497680.421787:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116994 gen 3 00000004:00080000:0.0:1777497680.421793:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116993 committed transno 115964116994 00000004:00080000:0.0:1777497680.421814:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116994 committed transno 115964116994 00000020:00080000:0.0:1777497680.421820:0:3660:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff923f83e2ab40 refcount 2 committed 0 result 0 batchid 77309411387 00000020:00080000:0.0:1777497680.421824:0:3660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92409c1be400 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff923f83e2aa80 00000020:00080000:0.0:1777497680.421828:0:3660:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].3 00000020:00080000:0.0:1777497680.421831:0:3660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92409c1beb00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff92409c750c00 00000020:00080000:0.0:1777497680.421834:0:3660:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].3 00000100:00100000:0.0:1777497680.421876:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837564987136:0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1777497680.421895:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411387 committed batchid 77309411386 00000020:00080000:0.0:1777497680.421963:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411386 00000100:00100000:2.0:1777497680.422830:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564987008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497680.422894:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497680.423796:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987008 00000100:00100000:0.0:1777497680.423808:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987008 00000100:00100000:0.0:1777497680.423876:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4018 00000100:00100000:0.0:1777497680.423886:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564987008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497680.423918:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497680.423988:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564987008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497680.423995:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4018 00000100:00100000:2.0:1777497680.424167:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564987008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497680.430438:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497680.430462:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564987264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.430534:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.430597:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564987392:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.430625:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497680.430636:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987264 00000100:00100000:1.0:1777497680.430645:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987264 00000100:00100000:2.0:1777497680.430668:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564987520:0@lo:400:kworker.0 00000100:00100000:1.0:1777497680.430686:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1777497680.430689:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497680.430695:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564987264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.430744:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564987648:0@lo:400:kworker.0 00000100:00100000:1.0:1777497680.430745:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564987264:12345-0@lo:400:kworker.0 Request processed in 51us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497680.430752:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1777497680.430763:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.430790:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564987264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.430822:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987392 00000100:00100000:2.0:1777497680.430826:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987392 00000100:00100000:2.0:1777497680.430885:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1777497680.430893:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564987392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.430929:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837564987392:12345-0@lo:400:kworker.0 Request processed in 38us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.430935:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1777497680.430947:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987520 00000100:00100000:2.0:1777497680.430950:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987520 00000100:00100000:2.0:1777497680.430967:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987648 00000100:00100000:2.0:1777497680.430970:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987648 00000100:00100000:2.0:1777497680.430987:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1777497680.430993:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564987520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431027:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837564987520:12345-0@lo:400:kworker.0 Request processed in 35us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.431032:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:2.0:1777497680.431047:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1777497680.431054:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564987648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431083:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837564987648:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.431088:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:2.0:1777497680.431140:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837564987392:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431160:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837564987520:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431190:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837564987648:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431311:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497680.431320:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564987776:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431341:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.431364:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987776 00000100:00100000:2.0:1777497680.431368:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987776 00000100:00100000:2.0:1777497680.431391:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1777497680.431398:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564987776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431427:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837564987776:12345-0@lo:400:kworker.0 Request processed in 30us (84us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.431432:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1777497680.431456:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837564987776:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431483:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564987904:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431507:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.431548:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564988032:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431570:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.431608:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564988160:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431628:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.431650:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988160 00000100:00100000:2.0:1777497680.431654:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988160 00000100:00080000:1.0:1777497680.431672:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497680.431673:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00080000:1.0:1777497680.431676:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497680.431678:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564988160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431720:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837564988160:12345-0@lo:400:kworker.0 Request processed in 41us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.431735:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1777497680.431783:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564988416:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431806:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.431852:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564988544:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.431886:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497680.432007:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988544 00000100:00100000:1.0:1777497680.432012:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988544 00000100:00100000:1.0:1777497680.432045:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:1.0:1777497680.432052:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564988544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497680.432117:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837564988544:12345-0@lo:400:kworker.0 Request processed in 44us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497680.432124:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1777497680.432135:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837564988544:0@lo:400:kworker.0 00000100:00100000:1.0:1777497680.432141:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564988288:0@lo:400:kworker.0 00000100:00100000:1.0:1777497680.432165:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497680.432208:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564987904 00000100:00100000:1.0:1777497680.432208:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837564988160:0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.432211:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564987904 00000100:00100000:3.0:1777497680.432261:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988032 00000100:00100000:3.0:1777497680.432265:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988032 00000100:00100000:3.0:1777497680.432286:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988416 00000100:00100000:3.0:1777497680.432289:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988416 00000100:00100000:3.0:1777497680.432305:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988288 00000100:00100000:3.0:1777497680.432307:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988288 00000100:00100000:3.0:1777497680.432326:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1777497680.432333:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564987904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.432372:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+6:3657:x1863837564987904:12345-0@lo:400:kworker.0 Request processed in 40us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497680.432378:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2611 00000100:00100000:3.0:1777497680.432401:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1777497680.432407:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564988032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.432440:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564988032:12345-0@lo:400:kworker.0 Request processed in 33us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497680.432446:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2612 00000100:00100000:3.0:1777497680.432457:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1777497680.432463:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564988416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.432488:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564988416:12345-0@lo:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497680.432493:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2613 00000100:00100000:3.0:1777497680.432505:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1777497680.432511:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564988288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.432537:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564988288:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497680.432542:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2614 00000100:00100000:3.0:1777497680.432573:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564988032:0@lo:400:kworker.0 00000100:00080000:1.0:1777497680.432643:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497680.432647:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497680.432667:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 2 00000100:00100000:1.0:1777497680.432678:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564988288:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.434642:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 2 00000100:00100000:2.0:1777497680.434667:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564988416:0@lo:400:kworker.0 00000100:00100000:2.0:1777497680.434683:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564987904:0@lo:400:kworker.0 00000100:00100000:3.0:1777497680.930408:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497680.930436:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497680.930532:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497680.930584:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988672 00000100:00100000:3.0:1777497680.930591:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988672 00000100:00100000:3.0:1777497680.930639:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1777497680.930652:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564988672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497680.930684:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497680.930726:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837564988672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497680.930745:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1777497680.930795:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837564988672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497680.936323:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497680.940591:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564988800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497680.940893:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497680.941304:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564988800 00000100:00100000:2.0:1777497680.941313:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564988800 00000100:00100000:2.0:1777497680.941365:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1777497680.941374:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564988800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497680.941407:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497680.941453:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564988800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497680.941460:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:1.0:1777497680.941789:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564988800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1777497681.058645:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777497681.447580:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969458 is committed 00000100:00100000:3.0:1777497681.725063:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497681.725462:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340736 00000100:00100000:0.0:1777497681.725476:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340736 00000100:00100000:0.0:1777497681.725544:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1777497681.725557:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546340736:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497681.725670:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546340736:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 116us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497681.725678:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 77 00000100:00100000:0.0:1777497681.734769:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497681.734852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497681.735067:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340864 00000100:00100000:2.0:1777497681.735083:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340864 00000100:00100000:2.0:1777497681.735369:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1327 00000100:00100000:2.0:1777497681.735385:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2414:x1863837546340864:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497681.735492:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2414:x1863837546340864:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 111us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497681.735500:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1327 00000100:00100000:3.0:1777497681.735978:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341120 00000100:00100000:3.0:1777497681.735986:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341120 00000100:00100000:3.0:1777497681.736034:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2615 00000100:00100000:3.0:1777497681.736042:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546341120:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497681.736118:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546341120:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 55us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497681.736125:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2615 00000100:00100000:3.0:1777497681.736962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:0.0:1777497681.737033:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497681.737041:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497681.737089:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546340992 00000100:00100000:0.0:1777497681.737130:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546340992 00000100:00100000:0.0:1777497681.737191:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1328 00000100:00100000:0.0:1777497681.737213:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546340992:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497681.737275:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546340992:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 76us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497681.737282:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1328 00000100:00080000:0.0:1777497681.737305:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1777497682.084012:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497682.568409:0:89241:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 134: replay creation of a file created in a pool ========================================================== 17:21:20 (1777497680) 00010000:00010000:0.0:1777497683.107346:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777497683.521952:0:89289:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffe1863f20 20000000:00000080:0.0:1777497683.521970:0:89289:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff924085ee9c00 uarg=0000000000000000 00000040:00100000:0.0:1777497683.522507:0:89289:0:(llog.c:1067:llog_reverse_process()) index 51 : idx 49 00000040:00100000:0.0:1777497683.522515:0:89289:0:(llog.c:1067:llog_reverse_process()) index 47 : idx 1 00000040:00080000:0.0:1777497683.522620:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].52, 224 off17176 20000000:01000000:0.0:1777497683.522644:0:89289:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1777497683.522660:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].53, 112 off17288 00000040:00080000:0.0:1777497683.522688:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].54, 224 off17512 00000040:00080000:0.0:1777497683.522755:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 224 off16208 20000000:01000000:0.0:1777497683.522766:0:89289:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1777497683.522783:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 120 off16328 00000040:00080000:0.0:1777497683.523563:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].49, 224 off16608 00000040:00080000:0.0:1777497683.525326:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].46, 224 off16240 20000000:01000000:0.0:1777497683.525353:0:89289:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre pool_134 (null) (null) 00000040:00080000:0.0:1777497683.525390:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].47, 120 off16360 00000040:00080000:0.0:1777497683.525518:0:89289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].49, 224 off16608 10000000:01000000:0.0:1777497683.525542:0:89289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1777497683.525563:0:89289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525582:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d439 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525589:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d519 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525596:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d54a expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525602:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d566 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525607:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d590 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525614:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d59e expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525621:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5ba expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525635:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5c8 expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525642:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d5f9 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525651:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525659:0:89289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525666:0:89289:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525703:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.525718:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 8 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.525732:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564988928:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497683.526621:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.526633:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 8 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.526644:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989056:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497683.526696:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.526704:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 22 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.526713:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989184:0@lo:104: 00000100:00100000:0.0:1777497683.526749:0:89289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777497683.526799:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.526807:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 22 pid: 88680 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.526815:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989312:0@lo:104: 00000100:00100000:3.0:1777497683.526980:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989184 00000100:00100000:3.0:1777497683.526987:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989184 00000100:00100000:3.0:1777497683.527047:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1777497683.527057:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564989184:12345-0@lo:104: 00010000:00010000:3.0:1777497683.527069:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527142:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777497683.527149:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564989184:12345-0@lo:104: Request processed in 95us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.527157:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:3.0:1777497683.527179:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497683.527184:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527214:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902aa00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.527218:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527226:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.527232:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.527237:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.527265:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527271:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.527288:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527294:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902aa00/0x3e357265691d5f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d600 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527305:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.527306:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.527308:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497683.527322:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497683.527334:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564989440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.527361:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.527395:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989440 00000100:00100000:3.0:1777497683.527399:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989440 00010000:00010000:3.0:1777497683.527424:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497683.527448:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1777497683.527453:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564989440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497683.527462:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497683.527466:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527474:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.527490:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497683.527516:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837564989440:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.527522:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1777497683.527557:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564989440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497683.527844:0:89289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497683.528020:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989312 00000100:00100000:2.0:1777497683.528031:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989312 00000100:00100000:2.0:1777497683.528059:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1777497683.528066:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564989312:12345-0@lo:104: 00010000:00010000:2.0:1777497683.528075:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.528213:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.528223:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 22 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.528232:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989568:0@lo:104: 00010000:00010000:2.0:1777497683.529899:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1777497683.529913:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564989312:12345-0@lo:104: Request processed in 1843us (2084us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.529922:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:3.0:1777497683.530200:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497683.530207:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.530217:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734600 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.530221:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.530230:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.530238:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.530255:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.530290:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.530296:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.530313:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.530320:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89734600/0x3e357265691d5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5cf expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.530332:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.530334:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.530336:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497683.530347:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564989696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.530386:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497683.530564:0:89289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777497683.530610:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d59e expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530621:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d59e expref: 22 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530643:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989824:0@lo:104: 00000100:00100000:0.0:1777497683.530667:0:89289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777497683.530687:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d590 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530695:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d590 expref: 22 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530703:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989952:0@lo:104: 00010000:00010000:0.0:1777497683.530720:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d566 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530727:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d566 expref: 22 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530734:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990080:0@lo:104: 00010000:00010000:0.0:1777497683.530750:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d54a expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530756:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d54a expref: 22 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530763:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990208:0@lo:104: 00010000:00010000:0.0:1777497683.530796:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d519 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530803:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d519 expref: 22 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530822:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990336:0@lo:104: 00010000:00010000:0.0:1777497683.530854:0:89289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d439 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.530861:0:89289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d439 expref: 22 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530878:0:89289:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990464:0@lo:104: 00000100:00100000:0.0:1777497683.530892:0:89289:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186a80 going to sleep for 11 seconds 00010000:00010000:0.0:1777497683.530912:0:89289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a400/0x3e357265691d600 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d5f9 expref: 22 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.530923:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989184:0@lo:104: 00000100:00100000:0.0:1777497683.530931:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989312:0@lo:104: 00000100:00100000:3.0:1777497683.531156:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1777497683.531172:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.531201:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.531210:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.531217:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.531224:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.531230:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989568 00000100:00100000:3.0:1777497683.531236:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989568 00000100:00100000:3.0:1777497683.531263:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989824 00000100:00100000:3.0:1777497683.531265:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989824 00000100:00100000:3.0:1777497683.531272:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989952 00000100:00100000:3.0:1777497683.531273:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989952 00000100:00100000:3.0:1777497683.531280:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990080 00000100:00100000:3.0:1777497683.531282:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990080 00000100:00100000:3.0:1777497683.531296:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990208 00000100:00100000:3.0:1777497683.531298:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990208 00000100:00100000:3.0:1777497683.531304:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990336 00000100:00100000:3.0:1777497683.531306:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990336 00000100:00100000:3.0:1777497683.531313:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990464 00000100:00100000:3.0:1777497683.531314:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990464 00000100:00100000:3.0:1777497683.531324:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1777497683.531331:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:89289:x1863837564989568:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531340:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531387:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777497683.531392:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:89289:x1863837564989568:12345-0@lo:104: Request processed in 62us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531398:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1777497683.531413:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1777497683.531419:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924099073450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:89289:x1863837564989824:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531425:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531456:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1777497683.531460:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924099073450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:89289:x1863837564989824:12345-0@lo:104: Request processed in 43us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531466:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1777497683.531496:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1777497683.531502:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:89289:x1863837564989952:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531509:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531552:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1777497683.531557:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:89289:x1863837564989952:12345-0@lo:104: Request processed in 56us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531563:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1777497683.531575:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1777497683.531580:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89289:x1863837564990080:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531587:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531615:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1777497683.531619:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89289:x1863837564990080:12345-0@lo:104: Request processed in 39us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531624:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1777497683.531633:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1777497683.531638:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89289:x1863837564990208:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531645:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531671:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1777497683.531675:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89289:x1863837564990208:12345-0@lo:104: Request processed in 37us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531680:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1777497683.531691:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1777497683.531697:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89289:x1863837564990336:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531702:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.531734:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1777497683.531737:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89289:x1863837564990336:12345-0@lo:104: Request processed in 42us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.531742:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1777497683.531752:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1777497683.531757:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564990464:12345-0@lo:104: 00010000:00010000:3.0:1777497683.531763:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532067:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1777497683.532073:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89289:x1863837564990464:12345-0@lo:104: Request processed in 316us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.532079:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00010000:00010000:3.0:1777497683.532120:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1777497683.532125:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532132:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532136:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532143:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532150:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532156:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532198:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532205:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532228:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532234:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38e00/0x3e357265691d5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5c1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532245:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1777497683.532248:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532252:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532256:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532262:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532268:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532274:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532284:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532289:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532294:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532308:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d38000/0x3e357265691d59e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d5a5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532315:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1777497683.532318:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532323:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532325:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532330:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532335:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532339:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532350:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532356:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532368:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532373:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902a200/0x3e357265691d590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d597 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532381:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1777497683.532390:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532394:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532396:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532401:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532406:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532410:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532423:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532428:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532433:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532438:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8a00/0x3e357265691d566 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d56d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532446:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1777497683.532448:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532453:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532455:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532469:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532474:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532478:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532490:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532495:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532499:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532504:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89734000/0x3e357265691d54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d551 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532511:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497683.532514:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532519:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39c00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532521:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532537:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532543:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532553:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532567:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532573:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532578:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532584:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39c00/0x3e357265691d519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d520 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532593:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497683.532596:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532601:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:3.0:1777497683.532604:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532611:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1777497683.532617:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497683.532621:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1777497683.532633:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532638:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1777497683.532648:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532653:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89735c00/0x3e357265691d439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d440 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.532667:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.532669:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.532671:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.532679:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.532685:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497683.532698:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564990592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.532737:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.532758:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564991104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.532776:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.532809:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1777497683.532815:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564990720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.532847:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497683.533486:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989568:0@lo:104: 00000100:00100000:0.0:1777497683.533496:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989824:0@lo:104: 00000100:00100000:0.0:1777497683.533503:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989952:0@lo:104: 00000100:00100000:0.0:1777497683.533511:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990080:0@lo:104: 00000100:00100000:0.0:1777497683.533518:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990208:0@lo:104: 00000100:00100000:0.0:1777497683.533526:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990336:0@lo:104: 00000100:00100000:0.0:1777497683.533533:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564990464:0@lo:104: 00000100:00100000:2.0:1777497683.533641:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564989696 00000100:00100000:2.0:1777497683.533648:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564989696 00010000:00010000:2.0:1777497683.533678:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 22 pid: 88680 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.533712:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990592 00000100:00100000:2.0:1777497683.533716:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990592 00010000:00010000:2.0:1777497683.533727:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.533743:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991104 00000100:00100000:2.0:1777497683.533746:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991104 00010000:00010000:2.0:1777497683.533757:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d54a expref: 24 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.533765:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990720 00000100:00100000:2.0:1777497683.533767:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990720 00010000:00010000:2.0:1777497683.533776:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d59e expref: 25 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.533800:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1777497683.533816:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837564989696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.533837:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497683.533843:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 25 pid: 88680 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.533853:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 25 pid: 88680 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534032:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902b600/0x3e357265691d5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d5c8 expref: 25 pid: 88680 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534047:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497683.534089:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3658:x1863837564989696:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.534121:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1777497683.534137:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1777497683.534142:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837564990592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.534150:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497683.534154:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534162:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534172:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734200/0x3e357265691d5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d5ba expref: 23 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534180:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497683.534281:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3659:x1863837564990592:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.534293:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000100:00100000:2.0:1777497683.534306:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1777497683.534311:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3659:x1863837564991104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.534318:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497683.534322:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d54a expref: 21 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534329:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d54a expref: 21 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534337:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89735e00/0x3e357265691d551 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d54a expref: 21 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534345:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497683.534366:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3659:x1863837564991104:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.534371:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:2.0:1777497683.534383:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1777497683.534388:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3659:x1863837564990720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.534396:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497683.534399:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d59e expref: 19 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534407:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d59e expref: 19 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534417:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38200/0x3e357265691d5a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d59e expref: 19 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534435:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497683.534459:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3659:x1863837564990720:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.534464:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:2.0:1777497683.534533:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564990848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.534560:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497683.534589:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564991360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.534608:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497683.534625:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497683.534631:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564990976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.534648:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497683.534667:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990848 00000100:00100000:2.0:1777497683.534671:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990848 00010000:00010000:2.0:1777497683.534685:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d590 expref: 18 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.534697:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991360 00000100:00100000:2.0:1777497683.534699:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991360 00010000:00010000:2.0:1777497683.534707:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d439 expref: 19 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.534715:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564990976 00000100:00100000:2.0:1777497683.534717:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564990976 00010000:00010000:2.0:1777497683.534729:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d566 expref: 20 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497683.534738:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1777497683.534744:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3657:x1863837564990848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.534759:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497683.534763:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d590 expref: 20 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.534769:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d590 expref: 20 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497683.535183:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1777497683.535205:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3657:x1863837564991360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497683.535213:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497683.535224:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d439 expref: 20 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535233:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d439 expref: 20 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535243:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39000/0x3e357265691d440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d439 expref: 20 pid: 88681 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535254:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497683.535293:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3657:x1863837564991360:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497683.535298:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1777497683.535314:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1777497683.535320:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3657:x1863837564990976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497683.535327:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497683.535331:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d566 expref: 18 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535337:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d566 expref: 18 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535346:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9a00/0x3e357265691d56d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d566 expref: 18 pid: 88684 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497683.535354:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497683.535373:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:3657:x1863837564990976:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497683.535378:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:3.0:1777497683.535537:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564991232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.535574:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497683.535616:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564990592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.535626:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564991104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.535645:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564990720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.535669:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991232 00000100:00100000:3.0:1777497683.535672:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991232 00010000:00010000:3.0:1777497683.535689:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d519 expref: 17 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497683.535713:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1777497683.535719:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:3659:x1863837564991232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497683.535728:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497683.535731:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d519 expref: 17 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.535738:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d519 expref: 17 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.535748:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39800/0x3e357265691d520 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d519 expref: 17 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.535757:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497683.536589:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:3659:x1863837564991232:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.536603:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00010000:00010000:3.0:1777497683.536638:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497683.536646:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497683.536675:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564989696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497683.536703:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837564991232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497683.536771:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d39400/0x3e357265691d597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d590 expref: 20 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497683.536984:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497683.537028:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3657:x1863837564990848:12345-0@lo:103:ldlm_bl.0 Request processed in 2283us (2466us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497683.537035:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1777497683.537073:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564990976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.537080:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564990848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.537087:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837564991360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497683.545413:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497683.545447:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497683.546601:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341248 00000100:00100000:3.0:1777497683.546612:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341248 00010000:00010000:3.0:1777497683.546661:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 9 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497683.546711:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341376 00000100:00100000:3.0:1777497683.546715:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341376 00010000:00010000:3.0:1777497683.546744:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 10 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497683.546767:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2557 00000100:00100000:3.0:1777497683.546776:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34a4158d-137e-4629-9769-4a4bd53f7f61+10:2414:x1863837546341248:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497683.546793:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497683.546798:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 10 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.546810:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 10 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.546839:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497683.546908:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34a4158d-137e-4629-9769-4a4bd53f7f61+10:2414:x1863837546341248:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 132us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.546915:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2557 00000100:00100000:3.0:1777497683.546933:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2558 00000100:00100000:3.0:1777497683.546940:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546341376:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497683.546950:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497683.546954:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 9 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.546962:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 9 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.546975:0:10268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.546982:0:10268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547004:0:10268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547010:0:10268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547015:0:10268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547021:0:10268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547026:0:10268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497683.547030:0:10268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547036:0:10268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547044:0:10268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497683.547053:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497683.547073:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546341376:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 134us (1625us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497683.547079:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2558 00010000:00010000:1.0:1777497683.552627:0:89289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9e00/0x3e357265691d61c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c33d expref: 8 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497683.552672:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564988928:192.168.202.4@tcp:104: 00010000:00010000:1.0:1777497683.552691:0:89289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38400/0x3e357265691d60e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c32f expref: 7 pid: 88679 timeout: 3912 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497683.552700:0:89289:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89289:1863837564989056:192.168.202.4@tcp:104: 00010000:00010000:1.0:1777497683.552762:0:89289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497683.552773:0:89289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497683.552778:0:89289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497683.552784:0:89289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef200/0x3e357265691d933 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497684.002428:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497684.002463:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564991488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497684.002531:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497684.002771:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991488 00000100:00100000:3.0:1777497684.002792:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991488 00000100:00100000:3.0:1777497684.002867:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:3.0:1777497684.002876:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564991488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497684.002912:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497684.002963:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837564991488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497684.002970:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:3.0:1777497684.003010:0:3657:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969458 gen 2 00000004:00080000:3.0:1777497684.003021:0:3657:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff924089358a80, transno 4294969458 00000100:00100000:3.0:1777497684.003037:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837564991488:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497684.003109:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497684.003140:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564991616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497684.003169:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497684.003240:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991616 00000100:00100000:3.0:1777497684.003245:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991616 00000100:00100000:3.0:1777497684.003286:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1777497684.003293:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564991616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497684.003310:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497684.003347:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564991616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497684.003353:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00080000:1.0:1777497684.003412:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497684.003457:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564991616:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497684.130639:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1777497685.091039:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497685.091047:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240a3af2000 from 52 10000000:01000000:3.0:1777497685.091054:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497685.091142:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.091153:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.091166:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497685.091229:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564991744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.091319:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.091382:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240c20e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.091451:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991744 00000100:00100000:1.0:1777497685.091459:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991744 00000100:00100000:1.0:1777497685.091517:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1777497685.091526:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837564991744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.091543:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497685.091578:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d93a expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.091616:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d93a expref: 15 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.091628:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d93a expref: 15 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.091637:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896ca000, rc 0) 00000100:00100000:1.0:1777497685.091684:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564991744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.091691:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1777497685.092166:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564991744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497685.092184:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.092194:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497685.092268:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564991872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.092299:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.092438:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240c20e7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.105327:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564991872 00000100:00100000:0.0:1777497685.105356:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564991872 00000100:00100000:0.0:1777497685.105425:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1777497685.105436:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564991872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.106496:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564991872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1058us (14191us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.106506:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1777497685.106750:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564991872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.106806:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.106874:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.106916:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240c20e7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.107140:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992000 00000100:00100000:2.0:1777497685.107147:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992000 00000100:00100000:2.0:1777497685.107201:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1777497685.107210:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564992000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.107323:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564992000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.107329:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1777497685.107861:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.108765:0:89291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89291:1863837564992128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.108847:0:89291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.108940:0:89291:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.108996:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992128 00000100:00100000:3.0:1777497685.109003:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992128 00000100:00100000:3.0:1777497685.109057:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1777497685.109067:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89291:x1863837564992128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497685.109254:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89291:x1863837564992128:12345-0@lo:502:llog_process_th.0 Request processed in 188us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.109261:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1777497685.109581:0:89291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89291:1863837564992128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.109632:0:89291:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89291:1863837564992256:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.109667:0:89291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.109696:0:89291:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.109885:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992256 00000100:00100000:3.0:1777497685.109890:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992256 00000100:00100000:3.0:1777497685.109925:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1777497685.109934:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89291:x1863837564992256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497685.110024:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89291:x1863837564992256:12345-0@lo:502:llog_process_th.0 Request processed in 91us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.110032:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1777497685.110510:0:89291:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89291:1863837564992256:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1777497685.110546:0:89291:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:3.0:1777497685.110919:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:3.0:1777497685.110942:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497685.110952:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.110963:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497685.110972:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1777497685.110975:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 46 10000000:01000000:3.0:1777497685.110977:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497685.111020:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.111028:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.111038:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497685.111056:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.111140:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.111181:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c726240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.111425:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992384 00000100:00100000:0.0:1777497685.111432:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992384 00000100:00100000:0.0:1777497685.111477:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1777497685.111486:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837564992384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497685.111507:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497685.111521:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d948 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.111545:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d948 expref: 16 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.111575:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d948 expref: 16 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.111584:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefe00, rc 0) 00000100:00100000:0.0:1777497685.111634:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564992384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.111640:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1777497685.111943:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.111960:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.111968:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497685.112039:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.112067:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.112091:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.112474:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992512 00000100:00100000:3.0:1777497685.112480:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992512 00000100:00100000:3.0:1777497685.112519:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1777497685.112527:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564992512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.112657:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564992512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.112664:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1777497685.112841:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.112872:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.112916:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.112946:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.116163:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992640 00000100:00100000:0.0:1777497685.116183:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992640 00000100:00100000:0.0:1777497685.116250:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1777497685.116261:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564992640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.116453:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564992640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.116460:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1777497685.117182:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564992640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.121383:0:89292:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564992768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.121472:0:89292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.121524:0:89292:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.124054:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992768 00000100:00100000:0.0:1777497685.124069:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992768 00000100:00100000:0.0:1777497685.124463:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1777497685.124475:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564992768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.124739:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564992768:12345-0@lo:502:llog_process_th.0 Request processed in 266us (3267us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.124758:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1777497685.135921:0:89292:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564992768:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497685.135980:0:89292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497685.135998:0:89292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497685.136000:0:89292:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:3.0:1777497685.138542:0:89292:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1777497685.138630:0:89292:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00080000:10000000:3.0:1777497685.139305:0:89292:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00080000:10000000:3.0:1777497685.143997:0:89292:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00080000:10000000:3.0:1777497685.146243:0:89292:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00000100:00100000:3.0:1777497685.148269:0:89292:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564992896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497685.148355:0:89292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.148406:0:89292:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.148481:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564992896 00000100:00100000:1.0:1777497685.148489:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564992896 00000100:00100000:1.0:1777497685.148539:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1777497685.148548:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564992896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.148680:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564992896:12345-0@lo:502:llog_process_th.0 Request processed in 133us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.148688:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1777497685.148926:0:89292:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2edc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564992896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.148971:0:89292:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564993024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.149007:0:89292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.149038:0:89292:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.149077:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993024 00000100:00100000:2.0:1777497685.149082:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993024 00000100:00100000:2.0:1777497685.149133:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1777497685.149141:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564993024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.149222:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89292:x1863837564993024:12345-0@lo:502:llog_process_th.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.149229:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1777497685.149343:0:89292:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89292:1863837564993024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497685.149367:0:89292:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497685.149374:0:89292:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497685.149377:0:89292:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000040:00080000:3.0:1777497685.149381:0:89292:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 50 count 49 00000020:01000000:0.0:1777497685.149549:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 46-49 (rc=0) 10000000:01000000:0.0:1777497685.149572:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1777497685.149582:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.149593:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497685.149605:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497685.149607:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 52 10000000:01000000:0.0:1777497685.149610:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497685.149634:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.149642:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.149651:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.149665:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.149693:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.149729:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.149787:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993152 00000100:00100000:1.0:1777497685.149792:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993152 00000100:00100000:1.0:1777497685.149830:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1777497685.149836:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837564993152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.149845:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497685.149867:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d956 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.149888:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d956 expref: 17 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.149898:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d956 expref: 17 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.149907:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cba00, rc 0) 00000100:00100000:1.0:1777497685.149947:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.149962:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1777497685.150041:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497685.150053:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.150061:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.150152:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.150177:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.150203:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.150385:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993280 00000100:00100000:2.0:1777497685.150389:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993280 00000100:00100000:2.0:1777497685.150420:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1777497685.150427:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.150531:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.150536:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1777497685.150598:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.150629:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.150665:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.150689:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.150737:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993408 00000100:00100000:1.0:1777497685.150742:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993408 00000100:00100000:1.0:1777497685.150770:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1777497685.150776:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.150942:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.150949:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1777497685.151043:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.151637:0:89293:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89293:1863837564993536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.151685:0:89293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.151720:0:89293:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.152336:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993536 00000100:00100000:0.0:1777497685.152343:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993536 00000100:00100000:0.0:1777497685.152380:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1777497685.152388:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89293:x1863837564993536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.152502:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89293:x1863837564993536:12345-0@lo:502:llog_process_th.0 Request processed in 114us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.152508:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1777497685.152787:0:89293:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89293:1863837564993536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.152846:0:89293:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89293:1863837564993664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.152970:0:89293:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.153001:0:89293:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.153072:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993664 00000100:00100000:2.0:1777497685.153076:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993664 00000100:00100000:2.0:1777497685.153136:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1777497685.153146:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89293:x1863837564993664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.153229:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89293:x1863837564993664:12345-0@lo:502:llog_process_th.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.153235:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1777497685.153527:0:89293:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89293:1863837564993664:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497685.153550:0:89293:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:0.0:1777497685.154029:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:0.0:1777497685.154054:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497685.154063:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.154081:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497685.154467:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1777497685.154471:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 46 10000000:01000000:0.0:1777497685.154475:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1777497685.154507:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.154515:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.154523:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.154542:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.154585:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.154610:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.154732:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993792 00000100:00100000:1.0:1777497685.154738:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993792 00000100:00100000:1.0:1777497685.154775:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1777497685.154783:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837564993792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.154794:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497685.154807:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d964 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.154861:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d964 expref: 18 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.154872:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d964 expref: 18 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.154882:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cb400, rc 0) 00000100:00100000:1.0:1777497685.154917:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564993792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.154923:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1777497685.155527:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497685.155545:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.155554:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.155618:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.155654:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.155700:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186840 going to sleep for 11 seconds 00010000:00010000:3.0:1777497685.155999:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497685.156056:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564993920 00000100:00100000:2.0:1777497685.156062:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564993920 00000100:00100000:2.0:1777497685.156142:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1777497685.156151:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564993920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.156262:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564993920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.156273:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1777497685.156601:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564993920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.156634:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.156664:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.156688:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.156731:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994048 00000100:00100000:1.0:1777497685.156734:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994048 00000100:00100000:1.0:1777497685.156752:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1777497685.156756:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564994048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.156879:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564994048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.156884:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1777497685.157047:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.157525:0:89294:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497685.157564:0:89294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.157596:0:89294:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67af00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.157643:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994176 00000100:00100000:0.0:1777497685.157647:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994176 00000100:00100000:0.0:1777497685.157673:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1777497685.157678:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.158841:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994176:12345-0@lo:502:llog_process_th.0 Request processed in 1157us (1271us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.158858:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1777497685.159013:0:89294:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497685.159049:0:89294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497685.159060:0:89294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497685.159062:0:89294:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre-MDT0001-m new lustre.pool_134 00000020:00000080:1.0:1777497685.159066:0:89294:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1777497685.159153:0:89294:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1777497685.159183:0:89294:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.159225:0:89294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.159264:0:89294:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.159426:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994304 00000100:00100000:0.0:1777497685.159431:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994304 00000100:00100000:0.0:1777497685.159474:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777497685.159483:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.159583:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994304:12345-0@lo:502:llog_process_th.0 Request processed in 101us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.159589:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1777497685.159710:0:89294:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.159749:0:89294:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.159781:0:89294:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.159808:0:89294:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497685.159865:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994432 00000100:00100000:0.0:1777497685.159870:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994432 00000100:00100000:0.0:1777497685.159901:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1777497685.159909:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497685.159980:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89294:x1863837564994432:12345-0@lo:502:llog_process_th.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.159993:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1777497685.160084:0:89294:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89294:1863837564994432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497685.160136:0:89294:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497685.160142:0:89294:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497685.160143:0:89294:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre-MDT0001-m new lustre.pool_134 00000040:00080000:1.0:1777497685.160147:0:89294:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 50 count 49 00000020:01000000:0.0:1777497685.160423:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 46-49 (rc=0) 10000000:01000000:0.0:1777497685.160445:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1777497685.160455:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.160466:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497685.160474:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497685.160477:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 52 10000000:01000000:0.0:1777497685.160479:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497685.160504:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.160512:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.160520:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.160534:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.160563:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.160593:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186000 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.160695:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994560 00000100:00100000:1.0:1777497685.160699:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994560 00000100:00100000:1.0:1777497685.160731:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1777497685.160738:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837564994560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.160747:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497685.160759:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d972 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.160780:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d972 expref: 19 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.160791:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d972 expref: 19 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.160799:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896ca400, rc 0) 00000100:00100000:1.0:1777497685.161064:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564994560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.161070:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777497685.161385:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497685.161400:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.161408:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497685.161473:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.161502:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.161535:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186000 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.161699:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994688 00000100:00100000:1.0:1777497685.161704:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994688 00000100:00100000:1.0:1777497685.161739:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1777497685.161746:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564994688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.161881:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564994688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.161888:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1777497685.162070:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.162138:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.162177:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.162257:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186000 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.163426:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994816 00000100:00100000:2.0:1777497685.163434:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994816 00000100:00100000:2.0:1777497685.163479:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1777497685.163487:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564994816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.163611:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564994816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.163618:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1777497685.163707:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564994816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.164702:0:89295:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89295:1863837564994944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497685.164760:0:89295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.164796:0:89295:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.164846:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564994944 00000100:00100000:1.0:1777497685.164859:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564994944 00000100:00100000:1.0:1777497685.164898:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1777497685.164906:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89295:x1863837564994944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.165022:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89295:x1863837564994944:12345-0@lo:502:llog_process_th.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.165028:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1777497685.165265:0:89295:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89295:1863837564994944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.165314:0:89295:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89295:1863837564995072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.165349:0:89295:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.165379:0:89295:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.165429:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995072 00000100:00100000:1.0:1777497685.165434:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995072 00000100:00100000:1.0:1777497685.165467:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1777497685.165474:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89295:x1863837564995072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497685.165545:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89295:x1863837564995072:12345-0@lo:502:llog_process_th.0 Request processed in 71us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.165551:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1777497685.165615:0:89295:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89295:1863837564995072:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777497685.165634:0:89295:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:1.0:1777497685.165776:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:1.0:1777497685.165801:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497685.165819:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.165830:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497685.165847:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1777497685.165858:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1777497685.165860:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497685.165886:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.165893:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.165902:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497685.165916:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.165942:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.165965:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.166087:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995200 00000100:00100000:3.0:1777497685.166124:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995200 00000100:00100000:3.0:1777497685.166153:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1777497685.166161:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837564995200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497685.166170:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497685.166184:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d980 expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.166204:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d980 expref: 20 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.166215:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d980 expref: 20 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.166224:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b000, rc 0) 00000100:00100000:3.0:1777497685.166258:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.166264:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1777497685.166296:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497685.166320:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.166328:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497685.166377:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.166401:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.166421:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.166432:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995328 00000100:00100000:3.0:1777497685.166435:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995328 00000100:00100000:3.0:1777497685.166456:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1777497685.166462:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.166568:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.166575:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1777497685.166607:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.166633:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.166668:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.166679:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.166689:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995456 00000100:00100000:3.0:1777497685.166692:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995456 00000100:00100000:3.0:1777497685.166711:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1777497685.166715:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.166784:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.166798:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1777497685.167021:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497685.174475:0:89296:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1777497685.174630:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1777497685.174650:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1777497685.174661:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.174673:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497685.174682:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497685.174685:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 52 10000000:01000000:2.0:1777497685.174687:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497685.174723:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.174731:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.174755:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497685.174780:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.174856:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.174894:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.175006:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995584 00000100:00100000:3.0:1777497685.175013:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995584 00000100:00100000:3.0:1777497685.175089:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1777497685.175123:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837564995584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497685.175139:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497685.175152:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d98e expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.175174:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d98e expref: 21 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.175183:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d98e expref: 21 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.175193:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a600, rc 0) 00000100:00100000:3.0:1777497685.175233:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564995584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.175240:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1777497685.175338:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.175351:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.175360:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497685.175408:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497685.175432:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.175952:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.176033:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995712 00000100:00100000:2.0:1777497685.176046:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995712 00000100:00100000:2.0:1777497685.176084:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777497685.176110:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564995712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.176231:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564995712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.176237:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777497685.176275:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0eea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.176310:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.176351:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.176369:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995840 00000100:00100000:2.0:1777497685.176372:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995840 00000100:00100000:2.0:1777497685.176388:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777497685.176393:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564995840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.176461:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564995840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.176468:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777497685.176497:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.176514:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564995840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.176729:0:89297:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89297:1863837564995968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.176764:0:89297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.176784:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564995968 00000100:00100000:2.0:1777497685.176787:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564995968 00000100:00100000:2.0:1777497685.176803:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1777497685.176820:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89297:x1863837564995968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.176899:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89297:x1863837564995968:12345-0@lo:502:llog_process_th.0 Request processed in 90us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.176904:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1777497685.176934:0:89297:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.176946:0:89297:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89297:1863837564995968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.176980:0:89297:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89297:1863837564996096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.177008:0:89297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.177026:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996096 00000100:00100000:2.0:1777497685.177030:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996096 00000100:00100000:2.0:1777497685.177045:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777497685.177051:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89297:x1863837564996096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497685.177134:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89297:x1863837564996096:12345-0@lo:502:llog_process_th.0 Request processed in 83us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.177141:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777497685.177168:0:89297:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.177179:0:89297:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89297:1863837564996096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1777497685.177198:0:89297:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 55 count 54 00000020:01000000:2.0:1777497685.177257:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 52-54 (rc=0) 10000000:01000000:2.0:1777497685.177276:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497685.177282:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177291:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497685.177300:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1777497685.177302:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1777497685.177305:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1777497685.177326:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177333:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177341:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497685.177354:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.177378:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.177391:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.177402:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996224 00000100:00100000:2.0:1777497685.177406:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996224 00000100:00100000:2.0:1777497685.177422:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1777497685.177427:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837564996224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497685.177437:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497685.177449:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d99c expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177480:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d99c expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177490:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d99c expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177499:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fee00, rc 0) 00000100:00100000:2.0:1777497685.177526:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.177532:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1777497685.177561:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497685.177576:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.177584:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497685.177622:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.177644:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.177655:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86750780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.177665:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996352 00000100:00100000:2.0:1777497685.177668:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996352 00000100:00100000:2.0:1777497685.177687:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777497685.177693:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.177769:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.177784:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777497685.177826:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.177851:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.177882:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.177896:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97a80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497685.177906:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996480 00000100:00100000:2.0:1777497685.177910:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996480 00000100:00100000:2.0:1777497685.177925:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1777497685.177930:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.178000:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.178006:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1777497685.178039:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497685.180512:0:89298:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:2.0:1777497685.180857:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1777497685.180881:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1777497685.180891:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.180902:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497685.180912:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1777497685.180914:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:2.0:1777497685.180917:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1777497685.180952:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.180978:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.180990:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497685.181015:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.181077:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.181143:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97a80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497685.181209:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996608 00000100:00100000:1.0:1777497685.181217:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996608 00000100:00100000:1.0:1777497685.181283:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1777497685.181293:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837564996608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497685.181306:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497685.181318:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d9aa expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.181340:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d9aa expref: 23 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.181348:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9aa expref: 23 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497685.181356:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cb200, rc 0) 00000100:00100000:1.0:1777497685.181401:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564996608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.181407:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1777497685.182409:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497685.182430:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.182441:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497685.182505:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497685.182549:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.182583:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924088e97a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497685.182631:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996736 00000100:00100000:3.0:1777497685.182636:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996736 00000100:00100000:3.0:1777497685.182677:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1777497685.182686:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564996736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.182842:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837564996736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (292us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497685.182861:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1777497685.182990:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837564996736:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1777497685.183017:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1777497685.183024:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497685.183032:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497685.373411:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497685.373523:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341504 00000100:00100000:3.0:1777497685.373533:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341504 00000100:00100000:3.0:1777497685.373587:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:3.0:1777497685.373597:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546341504:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497685.373614:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497685.373633:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c38a expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.373662:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.373672:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497685.373680:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a200, rc 0) 00000100:00100000:3.0:1777497685.373750:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546341504:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 153us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.373757:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 118 00000100:00100000:3.0:1777497685.377464:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497685.377660:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341632 00000100:00100000:0.0:1777497685.377671:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341632 00000100:00100000:0.0:1777497685.377730:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:0.0:1777497685.377741:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546341632:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497685.377921:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546341632:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 182us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.377930:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 119 00000100:00100000:0.0:1777497685.383288:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497685.383856:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341760 00000100:00100000:3.0:1777497685.383868:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341760 00000100:00100000:3.0:1777497685.383929:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:3.0:1777497685.383939:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546341760:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.384132:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ef4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546341760:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 193us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.384149:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 120 00000100:00100000:1.0:1777497685.398009:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497685.398135:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546341888 00000100:00100000:0.0:1777497685.398146:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546341888 00000100:00100000:0.0:1777497685.398217:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:0.0:1777497685.398228:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71207:x1863837546341888:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1777497685.398394:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71207:x1863837546341888:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 168us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.398401:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 121 00000100:00100000:0.0:1777497685.403380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497685.403487:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342016 00000100:00100000:3.0:1777497685.403507:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342016 00000100:00100000:3.0:1777497685.403569:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:3.0:1777497685.403579:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71207:x1863837546342016:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777497685.403733:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71207:x1863837546342016:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 154us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497685.403740:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 122 00000100:00100000:1.0:1777497685.415864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497685.416372:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342144 00000100:00100000:0.0:1777497685.416383:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342144 00000100:00100000:0.0:1777497685.416445:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1777497685.416454:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546342144:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497685.416471:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497685.416488:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c391 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.416529:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 9 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.416539:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 9 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497685.416548:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee200, rc 0) 00000100:00100000:0.0:1777497685.416612:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546342144:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 159us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.416618:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 123 00000100:00100000:0.0:1777497685.420915:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497685.422756:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342272 00000100:00100000:3.0:1777497685.422779:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342272 00000100:00100000:3.0:1777497685.422866:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:3.0:1777497685.422877:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546342272:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497685.423008:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546342272:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 132us (2101us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497685.423017:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 124 00000100:00100000:1.0:1777497685.538529:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497685.538553:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564996864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497685.538619:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.538791:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996864 00000100:00100000:0.0:1777497685.538800:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996864 00000100:00100000:0.0:1777497685.538870:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4019 00000100:00100000:0.0:1777497685.538880:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837564996864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497685.538917:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445175296 avail 1298935808 00000100:00100000:0.0:1777497685.538962:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837564996864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.538969:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4019 00000100:00100000:3.0:1777497685.539360:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564996992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497685.539391:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.539478:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564996992 00000100:00100000:1.0:1777497685.539483:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564996992 00000100:00100000:1.0:1777497685.539525:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4020 00000100:00100000:1.0:1777497685.539534:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564996992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497685.539556:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445437440 avail 1299197952 00000100:00100000:1.0:1777497685.539594:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564996992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.539614:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4020 00000100:00100000:1.0:1777497685.539660:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564996992:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497685.539689:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564996864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497685.545396:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564997376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497685.545475:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.545628:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564997120:0@lo:400:kworker.0 00000100:00100000:3.0:1777497685.545728:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564997504:0@lo:400:kworker.0 00000100:00100000:0.0:1777497685.545785:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564997888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.545975:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564997248:0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.550164:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.550321:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564997632:0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.550370:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.550391:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564998144:0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.550415:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.550468:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997632 00000100:00100000:1.0:1777497685.550476:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997632 00000100:00100000:1.0:1777497685.550635:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998144 00000100:00100000:1.0:1777497685.550639:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998144 00000100:00100000:1.0:1777497685.550674:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1777497685.550682:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564997632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.550737:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837564997632:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.550744:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2616 00000100:00100000:1.0:1777497685.551136:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2617 00000100:00100000:1.0:1777497685.551144:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564998144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.551272:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837564998144:12345-0@lo:400:kworker.0 Request processed in 129us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.551279:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2617 00000100:00080000:1.0:1777497685.551306:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497685.551359:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837564997632:0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.551369:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837564998144:0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.551417:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997376 00000100:00100000:1.0:1777497685.551421:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997376 00000100:00100000:1.0:1777497685.551457:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997120 00000100:00100000:1.0:1777497685.551460:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997120 00000100:00100000:1.0:1777497685.551480:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1777497685.551486:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564997376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.551532:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837564997376:12345-0@lo:400:kworker.0 Request processed in 47us (6058us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.551538:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1777497685.551550:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1777497685.551557:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564997120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.551589:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837564997120:12345-0@lo:400:kworker.0 Request processed in 33us (1431us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.551594:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00080000:1.0:1777497685.551615:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497685.551633:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837564997120:0@lo:400:kworker.0 00000100:00100000:3.0:1777497685.552034:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497685.552074:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564998016:0@lo:400:kworker.0 00000100:00100000:3.0:1777497685.552115:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497685.554378:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997504 00000100:00100000:1.0:1777497685.554390:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997504 00000100:00100000:1.0:1777497685.554455:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1777497685.554467:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564997504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.554562:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837564997504:12345-0@lo:400:kworker.0 Request processed in 99us (2528us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.554569:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1331 00000100:00100000:1.0:1777497685.554593:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998016 00000100:00100000:1.0:1777497685.554609:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998016 00000100:00100000:1.0:1777497685.554640:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2618 00000100:00100000:1.0:1777497685.554647:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564998016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497685.554678:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564998016:12345-0@lo:400:kworker.0 Request processed in 33us (2562us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497685.554684:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2618 00000100:00080000:1.0:1777497685.554707:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497685.554711:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497685.556282:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837564997504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497685.556299:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564998016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497685.561545:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497685.561631:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837564997376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497685.561675:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997888 00000100:00100000:0.0:1777497685.561681:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997888 00000100:00100000:0.0:1777497685.561725:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1777497685.561732:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564997888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497685.561786:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837564997888:12345-0@lo:400:kworker.0 Request processed in 55us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497685.561793:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1777497685.561994:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837564997888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562124:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.562148:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564997760:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562192:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.562211:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564998272:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562232:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497685.562262:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997760 00000100:00100000:2.0:1777497685.562265:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997760 00000100:00100000:2.0:1777497685.562294:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1777497685.562300:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564997760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562332:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837564997760:12345-0@lo:400:kworker.0 Request processed in 33us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.562338:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2619 00000100:00100000:2.0:1777497685.562355:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564997248 00000100:00100000:2.0:1777497685.562359:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564997248 00000100:00100000:2.0:1777497685.562388:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998272 00000100:00100000:2.0:1777497685.562390:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998272 00000100:00100000:2.0:1777497685.562406:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1777497685.562411:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564997248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562440:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837564997248:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.562446:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1777497685.562457:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:2.0:1777497685.562462:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564998272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562485:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837564998272:12345-0@lo:400:kworker.0 Request processed in 24us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497685.562513:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:2.0:1777497685.562536:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497685.562556:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837564997248:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562565:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837564997760:0@lo:400:kworker.0 00000100:00100000:2.0:1777497685.562573:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837564998272:0@lo:400:kworker.0 00000100:00100000:3.0:1777497686.050279:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497686.050302:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564998400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497686.050376:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497686.050404:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998400 00000100:00100000:2.0:1777497686.050412:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998400 00000100:00100000:2.0:1777497686.050470:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1777497686.050481:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564998400:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497686.050542:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564998528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497686.050574:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497686.050627:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998528 00000100:00100000:3.0:1777497686.050631:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998528 00000100:00100000:3.0:1777497686.050668:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:3.0:1777497686.050675:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564998528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497686.050694:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497686.050745:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837564998528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497686.050752:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00002000:00000024:2.0:1777497686.050777:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497686.050831:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837564998400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 351us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497686.050837:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:3.0:1777497686.050954:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837564998400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497686.051125:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837564998528:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1777497686.195527:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1777497686.576590:0:72699:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411387 batchid updated 00000020:00080000:1.0:1777497686.577291:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:1.0:1777497686.577361:0:72719:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff92408c1bd300 with version 12 00000020:00080000:1.0:1777497686.577379:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411387 cancel update log [0x2000088d1:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1777497686.577464:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411387 cancel update log [0x2400090a0:0x2:0x0].3: rc = 0 00000020:00080000:1.0:1777497686.577480:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000004:00080000:0.0:1777497686.579207:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 12 rpc_version 12 00000020:00100000:0.0:1777497686.579255:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777497686.579268:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff923f8410c000 x1863837564998784/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497686.579293:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564998784:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777497686.579372:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497686.579416:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497686.579811:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564998784 00000100:00100000:1.0:1777497686.579820:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564998784 00000100:00100000:1.0:1777497686.580869:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4021 00000100:00100000:1.0:1777497686.580886:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72705:x1863837564998784:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:1.0:1777497686.581124:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72705:x1863837564998784:12345-0@lo:1000:osp_up0-1.0 Request processed in 244us (1751us total) trans 115964116995 rc 0/0 00000100:00100000:1.0:1777497686.581133:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4021 00000100:00100000:0.0:1777497686.582497:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837564998784:0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777497686.847315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497686.847400:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497686.847435:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497686.847471:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497686.847525:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342400 00000100:00100000:1.0:1777497686.847535:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342400 00000100:00100000:1.0:1777497686.847580:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:1.0:1777497686.847588:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546342400:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497686.847662:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546342400:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497686.847696:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 125 00000100:00100000:2.0:1777497686.847910:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342784 00000100:00100000:2.0:1777497686.847915:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342784 00000100:00100000:2.0:1777497686.847974:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2620 00000100:00100000:2.0:1777497686.847982:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546342784:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497686.848019:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546342784:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497686.848025:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2620 00000100:00080000:1.0:1777497686.848586:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497686.850586:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342528 00000100:00100000:0.0:1777497686.850597:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342528 00000100:00100000:0.0:1777497686.850825:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342656 00000100:00100000:0.0:1777497686.850830:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342656 00000100:00100000:3.0:1777497686.850880:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1335 00000100:00100000:3.0:1777497686.850892:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546342528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497686.850983:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546342528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 93us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497686.850991:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1335 00000100:00080000:2.0:1777497686.851439:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497686.851443:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497686.851837:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1336 00000100:00100000:1.0:1777497686.851847:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546342656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497686.851899:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546342656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 54us (4427us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497686.851905:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1336 00010000:00010000:3.0:1777497687.205289:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777497687.587430:0:89395:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffea0a70190 20000000:00000080:3.0:1777497687.587445:0:89395:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff924085ee8800 uarg=0000000000000000 00000040:00100000:3.0:1777497687.588657:0:89395:0:(llog.c:1067:llog_reverse_process()) index 54 : idx 49 20000000:01000000:3.0:1777497687.588670:0:89395:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 53 cmd:0xce020 lustre.pool_134 00000040:00080000:3.0:1777497687.588782:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].55, 224 off17736 20000000:01000000:3.0:1777497687.588816:0:89395:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1777497687.588837:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].56, 136 off17872 00000040:00080000:3.0:1777497687.588853:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].57, 224 off18096 00000040:00080000:3.0:1777497687.588918:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].50, 224 off16832 20000000:01000000:3.0:1777497687.588925:0:89395:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1777497687.588935:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].51, 144 off16976 00000040:00080000:3.0:1777497687.588943:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].52, 224 off17200 00000040:00080000:3.0:1777497687.588978:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].50, 224 off16832 20000000:01000000:3.0:1777497687.588982:0:89395:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1777497687.588989:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].51, 144 off16976 00000040:00080000:3.0:1777497687.588997:0:89395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].52, 224 off17200 10000000:01000000:3.0:1777497687.589003:0:89395:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1777497687.589019:0:89395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589034:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d93a expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589039:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d948 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589043:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589047:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d964 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589050:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d972 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589054:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d980 expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589063:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d98e expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589067:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d99c expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589070:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9aa expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589076:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589079:0:89395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.589084:0:89395:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589304:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589335:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 8 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589349:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564998912:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497687.589454:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589461:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 8 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589469:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999040:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497687.589498:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589505:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589513:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999168:0@lo:104: 00000100:00100000:2.0:1777497687.589547:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497687.589589:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d99c expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589595:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d99c expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589600:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999296:0@lo:104: 00000100:00100000:2.0:1777497687.589617:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497687.589644:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d98e expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589649:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d98e expref: 22 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589654:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999424:0@lo:104: 00010000:00010000:2.0:1777497687.589676:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d980 expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589684:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d980 expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589691:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999552:0@lo:104: 00010000:00010000:2.0:1777497687.589713:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d972 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.589732:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d972 expref: 22 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.589739:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999680:0@lo:104: 00000100:00100000:0.0:1777497687.589865:0:13186:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1777497687.589882:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497687.589902:0:13186:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497687.589909:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999168 00000100:00100000:0.0:1777497687.589915:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999168 00000100:00100000:0.0:1777497687.589950:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999296 00000100:00100000:0.0:1777497687.589953:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999296 00000100:00100000:1.0:1777497687.589989:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999424 00000100:00100000:1.0:1777497687.589994:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999424 00000100:00100000:1.0:1777497687.590011:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999552 00000100:00100000:1.0:1777497687.590013:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999552 00000100:00100000:1.0:1777497687.590028:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1777497687.590035:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89395:x1863837564999168:12345-0@lo:104: 00010000:00010000:1.0:1777497687.590047:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590133:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777497687.590139:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89395:x1863837564999168:12345-0@lo:104: Request processed in 104us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.590145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:1.0:1777497687.590162:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1777497687.590168:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924082d34450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89395:x1863837564999296:12345-0@lo:104: 00010000:00010000:1.0:1777497687.590175:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590215:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1777497687.590230:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924082d34450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89395:x1863837564999296:12345-0@lo:104: Request processed in 61us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.590236:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1777497687.590267:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1777497687.590273:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89395:x1863837564999424:12345-0@lo:104: 00010000:00010000:1.0:1777497687.590280:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590326:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1777497687.590331:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89395:x1863837564999424:12345-0@lo:104: Request processed in 59us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.590336:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1777497687.590350:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1777497687.590355:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837564999552:12345-0@lo:104: 00010000:00010000:1.0:1777497687.590361:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590390:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1777497687.590395:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837564999552:12345-0@lo:104: Request processed in 40us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.590400:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:1.0:1777497687.590415:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777497687.590421:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590427:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.590431:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590448:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.590455:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.590460:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.590490:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590497:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.590516:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590524:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe800/0x3e357265691d9aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9b1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590538:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497687.590541:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590547:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.590549:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590555:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.590561:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.590573:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.590588:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590594:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.590609:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590615:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff000/0x3e357265691d99c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d9a3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590623:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497687.590626:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590636:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fea00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.590639:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590644:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.590650:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.590654:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.590677:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590683:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.590694:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590700:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fea00/0x3e357265691d98e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d995 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590708:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497687.590711:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590715:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cae00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.590717:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590723:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.590728:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.590733:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.590745:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590750:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.590755:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590760:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691d980 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d987 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.590767:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.590775:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.590777:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.590783:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.590801:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497687.590822:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564999808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497687.590852:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497687.590971:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497687.591031:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497687.591286:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565000064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.591330:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497687.591400:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497687.591406:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565000192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497687.591429:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497687.591460:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999808 00000100:00100000:1.0:1777497687.591466:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999808 00010000:00010000:1.0:1777497687.591487:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 23 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497687.591508:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000064 00000100:00100000:1.0:1777497687.591511:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000064 00010000:00010000:1.0:1777497687.591520:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d98e expref: 24 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497687.591532:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000192 00000100:00100000:1.0:1777497687.591535:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000192 00010000:00010000:1.0:1777497687.591543:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d980 expref: 25 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497687.591558:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1777497687.591565:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837564999808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497687.591576:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497687.591580:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 25 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591601:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 25 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591617:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497687.591646:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837564999808:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.591652:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1777497687.591686:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1777497687.591692:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3660:x1863837565000064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497687.591699:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497687.591703:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d98e expref: 24 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591711:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d98e expref: 24 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591719:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497687.591740:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3660:x1863837565000064:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.591746:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1777497687.591758:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1777497687.591764:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565000192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497687.591771:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497687.591774:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d980 expref: 23 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591781:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d980 expref: 23 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591808:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497687.591828:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565000192:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.591835:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1777497687.591864:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999680 00000100:00100000:1.0:1777497687.591868:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999680 00000100:00100000:1.0:1777497687.591882:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1777497687.591887:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837564999680:12345-0@lo:104: 00010000:00010000:1.0:1777497687.591896:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591928:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777497687.591933:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837564999680:12345-0@lo:104: Request processed in 47us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.591939:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:1.0:1777497687.591951:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497687.591955:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591962:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee600 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.591965:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.591973:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.591980:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.591994:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.592015:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.592021:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.592029:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.592035:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee600/0x3e357265691d972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d979 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.592045:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.592046:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.592048:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497687.592064:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565000320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497687.592085:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497687.592140:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565000192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497687.592149:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837564999808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497687.592172:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000320 00000100:00100000:1.0:1777497687.592175:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000320 00010000:00010000:1.0:1777497687.592188:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d972 expref: 23 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497687.592203:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1777497687.592209:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565000320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497687.592216:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497687.592220:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d972 expref: 23 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.592234:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d972 expref: 23 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.592244:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497687.592269:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565000320:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.592275:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1777497687.592299:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565000320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497687.592393:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d964 expref: 22 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.592403:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d964 expref: 22 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592412:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000448:0@lo:104: 00000100:00100000:2.0:1777497687.592436:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497687.592476:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.592484:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592493:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000576:0@lo:104: 00000100:00100000:2.0:1777497687.592513:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497687.592533:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d948 expref: 22 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.592540:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d948 expref: 22 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592548:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000704:0@lo:104: 00000100:00100000:2.0:1777497687.592573:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1777497687.592588:0:89395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691d93a expref: 22 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.592596:0:89395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691d93a expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592603:0:89395:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000832:0@lo:104: 00000100:00100000:2.0:1777497687.592623:0:89395:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497687.592633:0:89395:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d49a80 going to sleep for 11 seconds 00010000:00010000:2.0:1777497687.592645:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896cb200/0x3e357265691d9b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d9aa expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592653:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d0b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999168:0@lo:104: 00000100:00100000:2.0:1777497687.592661:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999296:0@lo:104: 00010000:00010000:2.0:1777497687.592679:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a600/0x3e357265691d995 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d98e expref: 21 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592688:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999424:0@lo:104: 00010000:00010000:2.0:1777497687.592696:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b000/0x3e357265691d987 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d980 expref: 20 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592704:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999552:0@lo:104: 00010000:00010000:2.0:1777497687.592711:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896ca400/0x3e357265691d979 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d972 expref: 19 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.592718:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999680:0@lo:104: 00000100:00100000:1.0:1777497687.592958:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1777497687.592968:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000448 00000100:00100000:1.0:1777497687.592972:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000448 00000100:00100000:1.0:1777497687.592990:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000576 00000100:00100000:1.0:1777497687.592993:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000576 00000100:00100000:1.0:1777497687.593001:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000704 00000100:00100000:1.0:1777497687.593003:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000704 00000100:00100000:1.0:1777497687.593010:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000832 00000100:00100000:1.0:1777497687.593012:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000832 00000100:00100000:1.0:1777497687.593022:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1777497687.593027:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89395:x1863837565000448:12345-0@lo:104: 00010000:00010000:1.0:1777497687.593036:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593084:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777497687.593090:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:89395:x1863837565000448:12345-0@lo:104: Request processed in 63us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.593122:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1777497687.593135:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1777497687.593140:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89395:x1863837565000576:12345-0@lo:104: 00010000:00010000:1.0:1777497687.593153:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593187:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1777497687.593192:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:89395:x1863837565000576:12345-0@lo:104: Request processed in 52us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.593198:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1777497687.593211:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1777497687.593217:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89395:x1863837565000704:12345-0@lo:104: 00010000:00010000:1.0:1777497687.593223:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593252:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1777497687.593257:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:89395:x1863837565000704:12345-0@lo:104: Request processed in 41us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.593263:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1777497687.593274:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1777497687.593279:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837565000832:12345-0@lo:104: 00010000:00010000:1.0:1777497687.593286:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593418:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1777497687.593423:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924084987050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:89395:x1863837565000832:12345-0@lo:104: Request processed in 144us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497687.593428:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:1.0:1777497687.593470:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777497687.593475:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593487:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.593490:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593497:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.593503:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.593508:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.593533:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593539:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.593548:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593554:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691d964 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d96b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593566:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497687.593568:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593573:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.593575:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593589:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.593595:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.593600:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.593612:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593617:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497687.593625:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593631:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef000/0x3e357265691d956 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d95d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593639:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497687.593642:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593648:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ac00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.593650:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593655:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.593660:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.593821:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000448:0@lo:104: 00000100:00100000:2.0:1777497687.593830:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5693b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000576:0@lo:104: 00000100:00100000:2.0:1777497687.593836:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000704:0@lo:104: 00000100:00100000:2.0:1777497687.593842:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837565000832:0@lo:104: 10000000:01000000:1.0:1777497687.593887:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.593902:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593907:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1777497687.593945:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1777497687.593965:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593971:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5ac00/0x3e357265691d948 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d94f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593980:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497687.593983:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593988:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497687.593991:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.593996:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497687.594002:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497687.594006:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1777497687.594020:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.594026:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1777497687.594223:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565000064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.594243:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565001088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.594277:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497687.594314:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1777497687.594320:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564999936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.594339:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497687.594364:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565000960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.594382:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497687.594405:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497687.594413:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565001344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.594436:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497687.594464:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001088 00000100:00100000:3.0:1777497687.594469:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001088 00010000:00010000:3.0:1777497687.594490:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d956 expref: 19 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.594512:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837564999936 00000100:00100000:3.0:1777497687.594514:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837564999936 00010000:00010000:3.0:1777497687.594527:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d99c expref: 20 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.594536:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565000960 00000100:00100000:3.0:1777497687.594539:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565000960 00010000:00010000:3.0:1777497687.594548:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d964 expref: 21 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.594557:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001344 00000100:00100000:3.0:1777497687.594559:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001344 00010000:00010000:3.0:1777497687.594566:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d93a expref: 22 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.594577:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1777497687.594584:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3660:x1863837565001088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.594594:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.594598:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594618:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594631:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896cba00/0x3e357265691d95d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d956 expref: 22 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594643:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.594683:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3660:x1863837565001088:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.594690:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:3.0:1777497687.594704:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1777497687.594710:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837564999936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.594717:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.594721:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d99c expref: 20 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594729:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d99c expref: 20 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594739:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7fee00/0x3e357265691d9a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d99c expref: 20 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594747:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.594768:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3660:x1863837564999936:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.594773:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1777497687.594785:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1777497687.594803:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3660:x1863837565000960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.594815:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.594819:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d964 expref: 18 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594825:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d964 expref: 18 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594833:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896cb400/0x3e357265691d96b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d964 expref: 18 pid: 88681 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594846:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.594863:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:3660:x1863837565000960:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.594868:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:3.0:1777497687.594881:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1777497687.594885:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:3657:x1863837565001344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.594890:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.594893:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d93a expref: 16 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594899:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d93a expref: 16 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594907:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896ca000/0x3e357265691d941 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d93a expref: 16 pid: 88680 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.594914:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.594933:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:3657:x1863837565001344:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.594945:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:3.0:1777497687.595027:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497687.595137:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565001344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.595159:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837564999936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.595166:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565000960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.595172:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565001088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497687.595188:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546342912 00000100:00100000:3.0:1777497687.595191:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546342912 00010000:00010000:3.0:1777497687.595205:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 9 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.595218:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2567 00000100:00100000:3.0:1777497687.595224:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546342912:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.595230:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.595234:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 9 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.595243:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 9 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.595253:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.595289:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546342912:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.595295:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2567 00000100:00100000:3.0:1777497687.595565:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497687.595593:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343040 00000100:00100000:3.0:1777497687.595597:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343040 00010000:00010000:3.0:1777497687.595610:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 9 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.595623:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2568 00000100:00100000:3.0:1777497687.595628:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546343040:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.595635:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.595638:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 9 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.595647:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 9 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.595657:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497687.595680:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546343040:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497687.595686:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2568 00010000:00010000:3.0:1777497687.596191:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691d9bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c391 expref: 8 pid: 88679 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.596206:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564998912:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497687.596217:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a200/0x3e357265691d9b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c38a expref: 7 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.596226:0:89395:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d09500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89395:1863837564999040:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497687.596272:0:89395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497687.596433:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565001216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497687.596472:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497687.596640:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001216 00000100:00100000:3.0:1777497687.596645:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001216 00010000:00010000:1.0:1777497687.596649:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.596657:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5b800/0x3e357265691d93a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691d941 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596662:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d948 expref: 15 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.596689:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:3.0:1777497687.596696:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:3658:x1863837565001216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497687.596704:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497687.596708:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691d948 expref: 15 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596717:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691d948 expref: 15 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596740:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefe00/0x3e357265691d94f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691d948 expref: 15 pid: 88684 timeout: 3916 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.596754:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.596756:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497687.596758:0:19127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.596758:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497687.596767:0:19127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.596778:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497687.596781:0:19127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596795:0:19127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596802:0:19127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497687.596805:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497687.596814:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497687.596816:0:19127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596821:0:19127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497687.596825:0:19127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596833:0:19127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596854:0:19127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497687.596863:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497687.596883:0:89395:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497687.596891:0:89395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.596896:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3658:x1863837565001216:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (423us total) trans 0 rc 0/0 00010000:00010000:2.0:1777497687.596897:0:89395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a800/0x3e357265691d9c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497687.596903:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:1.0:1777497687.597838:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565001216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497688.226329:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497689.122641:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497689.122668:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565001472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497689.122757:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.122953:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497689.122964:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565001600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497689.122995:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.123049:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001472 00000100:00100000:3.0:1777497689.123058:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001472 00000100:00100000:2.0:1777497689.123157:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001600 00000100:00100000:2.0:1777497689.123163:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001600 00000100:00100000:3.0:1777497689.123249:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:3.0:1777497689.123258:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565001472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497689.123303:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497689.123353:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565001472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.123359:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:3.0:1777497689.123648:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565001472:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497689.124245:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497689.124250:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497689.124457:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1777497689.124469:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565001600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497689.124495:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497689.124556:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565001600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.124562:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:3.0:1777497689.124709:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565001600:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1777497689.252515:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1777497689.252809:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497689.252813:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240a3af2000 from 55 10000000:01000000:2.0:1777497689.252818:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497689.252870:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.252881:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.252892:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.252920:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.252988:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.253040:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.254170:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001728 00000100:00100000:3.0:1777497689.254183:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001728 00000100:00100000:3.0:1777497689.254248:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1777497689.254259:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837565001728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.254274:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497689.254303:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a200/0x3e357265691d9d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d9cd expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.254330:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a200/0x3e357265691d9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d9cd expref: 15 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.254341:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a200/0x3e357265691d9d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9cd expref: 15 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.254350:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a200, rc 0) 00000100:00100000:3.0:1777497689.254417:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565001728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.254424:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777497689.256497:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.256525:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.256558:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.256639:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.256693:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.256733:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d300 going to sleep for 11 seconds 00000100:00100000:1.0:1777497689.256811:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001856 00000100:00100000:1.0:1777497689.256818:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001856 00000100:00100000:1.0:1777497689.256863:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1777497689.256873:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a697c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565001856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.257006:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a697c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565001856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497689.257013:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1777497689.257199:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.257230:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.257276:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.257319:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a38c2240 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.257395:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565001984 00000100:00100000:0.0:1777497689.257399:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565001984 00000100:00100000:0.0:1777497689.257434:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1777497689.257442:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565001984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.257529:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565001984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.257536:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1777497689.257686:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565001984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.263159:0:89396:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89396:1863837565002112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.263267:0:89396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.263324:0:89396:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d900 going to sleep for 11 seconds 00000100:00100000:1.0:1777497689.263736:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002112 00000100:00100000:1.0:1777497689.263744:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002112 00000100:00100000:1.0:1777497689.263805:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1777497689.263815:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89396:x1863837565002112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497689.263947:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89396:x1863837565002112:12345-0@lo:502:llog_process_th.0 Request processed in 133us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497689.263959:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1777497689.264249:0:89396:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89396:1863837565002112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.264330:0:89396:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89396:1863837565002240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.264368:0:89396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.264400:0:89396:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.264556:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002240 00000100:00100000:0.0:1777497689.264561:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002240 00000100:00100000:0.0:1777497689.264609:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1777497689.264619:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89396:x1863837565002240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.264713:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:89396:x1863837565002240:12345-0@lo:502:llog_process_th.0 Request processed in 96us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.264720:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1777497689.265009:0:89396:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89396:1863837565002240:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777497689.265046:0:89396:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:0.0:1777497689.265432:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1777497689.265455:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497689.265465:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.265476:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497689.265486:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1777497689.265488:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 50 10000000:01000000:0.0:1777497689.265491:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1777497689.265518:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.265525:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.265533:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.265547:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.265580:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.265651:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497689.265785:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002368 00000100:00100000:1.0:1777497689.265791:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002368 00000100:00100000:1.0:1777497689.265868:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1777497689.265877:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565002368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497689.265887:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497689.265900:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cae00/0x3e357265691d9e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d9db expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497689.265922:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cae00/0x3e357265691d9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d9db expref: 16 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497689.265932:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cae00/0x3e357265691d9e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9db expref: 16 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497689.265939:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cae00, rc 0) 00000100:00100000:1.0:1777497689.265981:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565002368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497689.265987:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1777497689.266062:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.266075:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.266083:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.266175:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.266203:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.266726:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.266954:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002496 00000100:00100000:0.0:1777497689.266959:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002496 00000100:00100000:0.0:1777497689.267002:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1777497689.267010:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565002496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.274862:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565002496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7841us (8646us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.274878:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1777497689.275040:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.275125:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.275182:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.275216:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.275806:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002624 00000100:00100000:0.0:1777497689.275814:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002624 00000100:00100000:0.0:1777497689.275872:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1777497689.275882:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565002624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.275997:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565002624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.276003:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1777497689.276196:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565002624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.278032:0:89397:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89397:1863837565002752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.278156:0:89397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.278194:0:89397:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.278327:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002752 00000100:00100000:0.0:1777497689.278336:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002752 00000100:00100000:0.0:1777497689.278388:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1777497689.278398:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89397:x1863837565002752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.278527:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89397:x1863837565002752:12345-0@lo:502:llog_process_th.0 Request processed in 129us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.278534:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1777497689.279614:0:89397:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89397:1863837565002752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497689.279651:0:89397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497689.279665:0:89397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497689.279667:0:89397:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1777497689.279673:0:89397:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1777497689.279688:0:89397:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:3.0:1777497689.283356:0:89397:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89397:1863837565002880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.283437:0:89397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.283474:0:89397:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d540 going to sleep for 11 seconds 00000020:01000004:1.0:1777497689.283651:0:89398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9240a3af2000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497689.283657:0:89398:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a3af2000 4 00000100:00100000:0.0:1777497689.283856:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565002880 00000100:00100000:0.0:1777497689.283864:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565002880 00000100:00100000:0.0:1777497689.283921:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1777497689.283931:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89397:x1863837565002880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.284073:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:89397:x1863837565002880:12345-0@lo:502:llog_process_th.0 Request processed in 144us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.284081:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1777497689.284337:0:89397:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89397:1863837565002880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497689.284367:0:89397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497689.284373:0:89397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497689.284375:0:89397:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1777497689.284379:0:89397:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:0.0:1777497689.284592:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 50-52 (rc=0) 10000000:01000000:0.0:1777497689.284617:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1777497689.284625:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.284636:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497689.284652:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497689.284655:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 55 10000000:01000000:0.0:1777497689.284657:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497689.284683:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.284691:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.284699:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.284714:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.284748:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.284789:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85dc6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.284870:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003008 00000100:00100000:3.0:1777497689.284875:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003008 00000100:00100000:3.0:1777497689.284901:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1777497689.284908:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565003008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.284918:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497689.284929:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b400/0x3e357265691d9f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d9e9 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.284950:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b400/0x3e357265691d9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d9e9 expref: 17 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.284961:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b400/0x3e357265691d9f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9e9 expref: 17 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.284969:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b400, rc 0) 00000100:00100000:3.0:1777497689.284999:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.285014:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1777497689.286276:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497689.288006:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.288024:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.288135:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.288190:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.288229:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85dc6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.288370:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003136 00000100:00100000:3.0:1777497689.288377:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003136 00000100:00100000:3.0:1777497689.288410:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1777497689.288417:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.288531:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.288538:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1777497689.288788:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.288835:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.288872:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497689.288899:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408547f600 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.289109:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003264 00000100:00100000:2.0:1777497689.289113:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003264 00000100:00100000:2.0:1777497689.289142:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1777497689.289148:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.289220:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.289226:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1777497689.289332:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.289709:0:89399:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89399:1863837565003392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497689.289741:0:89399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497689.289779:0:89399:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110f300 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.289871:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003392 00000100:00100000:2.0:1777497689.289875:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003392 00000100:00100000:2.0:1777497689.289905:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1777497689.289910:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89399:x1863837565003392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.289982:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89399:x1863837565003392:12345-0@lo:502:llog_process_th.0 Request processed in 72us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.289988:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1777497689.290626:0:89399:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89399:1863837565003392:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497689.290681:0:89399:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89399:1863837565003520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497689.290715:0:89399:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497689.290726:0:89399:0:(client.c:2691:ptlrpc_set_wait()) set ffff92408547f600 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.290824:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003520 00000100:00100000:2.0:1777497689.290829:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003520 00000100:00100000:2.0:1777497689.290861:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1777497689.290867:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89399:x1863837565003520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.290941:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:89399:x1863837565003520:12345-0@lo:502:llog_process_th.0 Request processed in 75us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.290955:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1777497689.291462:0:89399:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89399:1863837565003520:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497689.291486:0:89399:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1777497689.291651:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:2.0:1777497689.291692:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497689.291702:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.291714:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497689.291725:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1777497689.291728:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 50 10000000:01000000:2.0:1777497689.291731:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1777497689.291757:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.291765:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.291785:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.291802:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.291839:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.291874:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d300 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.291935:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003648 00000100:00100000:0.0:1777497689.291941:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003648 00000100:00100000:0.0:1777497689.291990:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1777497689.291997:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565003648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497689.292006:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497689.292020:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef400/0x3e357265691d9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691d9f7 expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.292043:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef400/0x3e357265691d9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d9f7 expref: 18 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.292054:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef400/0x3e357265691d9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d9f7 expref: 18 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.292062:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef400, rc 0) 00000100:00100000:0.0:1777497689.292132:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565003648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.292138:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1777497689.292710:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.292726:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.292736:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.292824:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.292854:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.292886:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.293506:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003776 00000100:00100000:3.0:1777497689.293513:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003776 00000100:00100000:3.0:1777497689.293554:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1777497689.293562:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565003776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.293692:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86fdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565003776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.293699:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1777497689.294521:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.294567:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.294623:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.294659:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94d300 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.294719:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565003904 00000100:00100000:0.0:1777497689.294725:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565003904 00000100:00100000:0.0:1777497689.294768:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1777497689.294785:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565003904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.294890:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565003904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.294896:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1777497689.294980:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565003904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.296872:0:89400:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89400:1863837565004032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.296946:0:89400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.296989:0:89400:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.299693:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004032 00000100:00100000:3.0:1777497689.299708:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004032 00000100:00100000:3.0:1777497689.299783:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1777497689.299796:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89400:x1863837565004032:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.299992:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89400:x1863837565004032:12345-0@lo:502:llog_process_th.0 Request processed in 198us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.299999:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1777497689.300187:0:89400:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89400:1863837565004032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777497689.300228:0:89400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497689.300240:0:89400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497689.300243:0:89400:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:2.0:1777497689.300249:0:89400:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1777497689.300267:0:89400:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1777497689.300310:0:89400:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89400:1863837565004160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.300353:0:89400:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.300380:0:89400:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.300596:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004160 00000100:00100000:0.0:1777497689.300601:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004160 00000100:00100000:0.0:1777497689.300641:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1777497689.300647:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89400:x1863837565004160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.300738:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:89400:x1863837565004160:12345-0@lo:502:llog_process_th.0 Request processed in 91us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.300751:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1777497689.301272:0:89400:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89400:1863837565004160:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777497689.301313:0:89400:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497689.301319:0:89400:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497689.301321:0:89400:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0001-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1777497689.301325:0:89400:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000020:01000000:3.0:1777497689.301580:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 50-52 (rc=0) 10000000:01000000:3.0:1777497689.301600:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1777497689.301615:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.301626:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497689.301636:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497689.301638:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 55 10000000:01000000:3.0:1777497689.301641:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497689.301667:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.301674:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.301683:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.301700:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.301736:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.301761:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.301827:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004288 00000100:00100000:0.0:1777497689.301833:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004288 00000100:00100000:0.0:1777497689.301872:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1777497689.301880:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565004288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497689.301890:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497689.301902:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691da0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691da05 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.301923:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691da0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691da05 expref: 19 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.301934:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeec00/0x3e357265691da0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691da05 expref: 19 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.301941:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:0.0:1777497689.301979:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.301985:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1777497689.302165:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.302178:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.302187:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.302236:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.302267:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.302282:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.304327:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004416 00000100:00100000:2.0:1777497689.304341:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004416 00000100:00100000:2.0:1777497689.304404:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1777497689.304414:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.304566:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (2297us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.304573:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1777497689.304961:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.305009:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.305076:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.305138:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.305235:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004544 00000100:00100000:0.0:1777497689.305241:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004544 00000100:00100000:0.0:1777497689.305283:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1777497689.305290:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.305379:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.305386:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1777497689.306283:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.308393:0:89401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89401:1863837565004672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.308468:0:89401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.308510:0:89401:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.308559:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004672 00000100:00100000:3.0:1777497689.308567:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004672 00000100:00100000:3.0:1777497689.308603:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1777497689.308612:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89401:x1863837565004672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497689.308732:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89401:x1863837565004672:12345-0@lo:502:llog_process_th.0 Request processed in 120us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.308739:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1777497689.308830:0:89401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89401:1863837565004672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.308875:0:89401:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89401:1863837565004800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.308901:0:89401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.308920:0:89401:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2900 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.308974:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004800 00000100:00100000:0.0:1777497689.308983:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004800 00000100:00100000:0.0:1777497689.309016:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1777497689.309031:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89401:x1863837565004800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.309129:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:89401:x1863837565004800:12345-0@lo:502:llog_process_th.0 Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.309136:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1777497689.309318:0:89401:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89401:1863837565004800:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1777497689.309338:0:89401:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:3.0:1777497689.309490:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:3.0:1777497689.309511:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497689.309521:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.309531:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497689.309540:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1777497689.309542:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1777497689.309545:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1777497689.309569:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.309583:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.309593:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.309606:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.309639:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.309670:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.311178:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565004928 00000100:00100000:2.0:1777497689.311190:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565004928 00000100:00100000:2.0:1777497689.311240:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1777497689.311249:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565004928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.311264:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497689.311281:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff200/0x3e357265691da1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691da13 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.311307:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff200/0x3e357265691da1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691da13 expref: 20 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.311334:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff200/0x3e357265691da1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691da13 expref: 20 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.311342:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff200, rc 0) 00000100:00100000:2.0:1777497689.311398:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565004928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.311404:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1777497689.312193:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565004928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.312218:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.312228:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.312301:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.312339:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.312373:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.314555:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005056 00000100:00100000:2.0:1777497689.314568:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005056 00000100:00100000:2.0:1777497689.314637:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1777497689.314649:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565005056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.314842:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565005056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (2500us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.314851:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1777497689.315398:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.315445:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.315498:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497689.315535:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.315592:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005184 00000100:00100000:2.0:1777497689.315597:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005184 00000100:00100000:2.0:1777497689.315634:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1777497689.315642:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565005184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.315736:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565005184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.315743:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1777497689.315843:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497689.316951:0:89402:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1777497689.317296:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1777497689.317316:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1777497689.317326:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.317348:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497689.317358:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497689.317360:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 55 10000000:01000000:2.0:1777497689.317363:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497689.317393:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.317401:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.317411:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.317430:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.317476:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.317512:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186780 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.317818:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005312 00000100:00100000:3.0:1777497689.317826:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005312 00000100:00100000:3.0:1777497689.317870:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1777497689.317879:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565005312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.317892:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497689.317904:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a800/0x3e357265691da28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691da21 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.317927:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a800/0x3e357265691da28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691da21 expref: 21 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.317937:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a800/0x3e357265691da28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691da21 expref: 21 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.317946:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a800, rc 0) 00000100:00100000:3.0:1777497689.317990:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.317997:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1777497689.318244:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.318260:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.318270:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.318329:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.318356:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.318388:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.318442:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005440 00000100:00100000:0.0:1777497689.318447:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005440 00000100:00100000:0.0:1777497689.318485:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1777497689.318494:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.318593:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.318599:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1777497689.318672:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.318697:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.318732:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.326794:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186780 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.328391:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005568 00000100:00100000:3.0:1777497689.328405:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005568 00000100:00100000:3.0:1777497689.328516:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1777497689.328526:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.328687:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (9954us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.328694:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1777497689.328797:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.332419:0:89403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89403:1863837565005696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.332522:0:89403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.336521:0:89403:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.339433:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005696 00000100:00100000:0.0:1777497689.339451:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005696 00000100:00100000:0.0:1777497689.339543:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1777497689.339555:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89403:x1863837565005696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.339783:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89403:x1863837565005696:12345-0@lo:502:llog_process_th.0 Request processed in 219us (7248us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.339790:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1777497689.340191:0:89403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89403:1863837565005696:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.340264:0:89403:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89403:1863837565005824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497689.340311:0:89403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.340340:0:89403:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1860c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.341813:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005824 00000100:00100000:0.0:1777497689.341825:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005824 00000100:00100000:0.0:1777497689.341897:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1777497689.341909:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89403:x1863837565005824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497689.342079:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:89403:x1863837565005824:12345-0@lo:502:llog_process_th.0 Request processed in 171us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.342130:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1777497689.342342:0:89403:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:89403:1863837565005824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1777497689.342378:0:89403:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000100:00100000:3.0:1777497689.342766:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497689.342880:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343168 00000100:00100000:0.0:1777497689.342886:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343168 00000100:00100000:0.0:1777497689.342921:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 159 00000100:00100000:0.0:1777497689.342929:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546343168:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497689.342939:0:88684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497689.342956:0:88684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eefc00/0x3e357265691da2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c398 expref: -99 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.342979:0:88684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eefc00/0x3e357265691da2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c398 expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.342988:0:88684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eefc00/0x3e357265691da2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c398 expref: 8 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.342997:0:88684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefc00, rc 0) 00000100:00100000:0.0:1777497689.343388:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343168:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 458us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.343395:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 159 00000020:01000000:0.0:1777497689.343427:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 55-57 (rc=0) 10000000:01000000:0.0:1777497689.343448:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497689.343456:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.343466:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497689.343474:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1777497689.343486:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1777497689.343489:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1777497689.343516:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.343523:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.343531:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.343550:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.343586:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.343837:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240c20e7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497689.348046:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565005952 00000100:00100000:1.0:1777497689.348061:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565005952 00000100:00100000:2.0:1777497689.348483:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1777497689.348496:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565005952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.348514:0:88679:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497689.348533:0:88679:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff400/0x3e357265691da3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691da36 expref: -99 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.348560:0:88679:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff400/0x3e357265691da3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691da36 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.348572:0:88679:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff400/0x3e357265691da3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691da36 expref: 22 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.348594:0:88679:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff400, rc 0) 00000100:00100000:2.0:1777497689.348679:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565005952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (5091us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.348686:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1777497689.357422:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565005952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.357456:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.357469:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497689.357570:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497689.357627:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497689.357676:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.358234:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006080 00000100:00100000:0.0:1777497689.358242:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006080 00000100:00100000:0.0:1777497689.358297:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1777497689.358307:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565006080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.358454:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565006080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.358461:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1777497689.358509:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.358546:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.358590:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.358614:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ffe40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497689.358629:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006208 00000100:00100000:0.0:1777497689.358632:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006208 00000100:00100000:0.0:1777497689.358657:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1777497689.358672:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565006208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.358747:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565006208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.358753:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1777497689.358812:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.359070:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497689.359109:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343296 00000100:00100000:3.0:1777497689.359120:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343296 00000100:00100000:3.0:1777497689.359159:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 163 00000100:00100000:3.0:1777497689.359166:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343296:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.359246:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f890dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343296:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 81us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.359253:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 163 00000040:00080000:0.0:1777497689.359573:0:89404:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1777497689.359637:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1777497689.359660:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1777497689.359669:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.359678:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497689.359687:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1777497689.359689:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:0.0:1777497689.359692:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1777497689.359717:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.359724:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.359731:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.359745:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.359785:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.359819:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497689.359972:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006336 00000100:00100000:2.0:1777497689.359977:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006336 00000100:00100000:2.0:1777497689.360005:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1777497689.360014:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565006336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497689.360024:0:88681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497689.360036:0:88681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fe600/0x3e357265691da4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691da44 expref: -99 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.360057:0:88681:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fe600/0x3e357265691da4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691da44 expref: 23 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.360066:0:88681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fe600/0x3e357265691da4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691da44 expref: 23 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497689.360081:0:88681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe600, rc 0) 00000100:00100000:2.0:1777497689.360136:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565006336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497689.360142:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1777497689.361411:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497689.361436:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497689.361449:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497689.361524:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497689.361572:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497689.361611:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497689.364438:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006464 00000100:00100000:3.0:1777497689.364453:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006464 00000100:00100000:3.0:1777497689.364527:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1777497689.364537:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565006464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497689.364672:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565006464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (3097us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497689.364679:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1777497689.367483:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565006464:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1777497689.367540:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1777497689.367550:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497689.367563:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497689.368415:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497689.369217:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343424 00000100:00100000:1.0:1777497689.369249:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343424 00000100:00100000:1.0:1777497689.369317:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:1.0:1777497689.369326:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343424:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.369665:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086cd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343424:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 336us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497689.369672:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 166 00000100:00100000:3.0:1777497689.382661:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497689.383192:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343552 00000100:00100000:0.0:1777497689.383204:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343552 00000100:00100000:0.0:1777497689.383267:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:0.0:1777497689.383278:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71251:x1863837546343552:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1777497689.383446:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86608c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71251:x1863837546343552:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 169us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497689.383453:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 167 00000100:00100000:0.0:1777497689.392896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497689.393131:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343680 00000100:00100000:1.0:1777497689.393141:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343680 00000100:00100000:1.0:1777497689.393211:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:1.0:1777497689.393223:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71251:x1863837546343680:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:1.0:1777497689.393394:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8660a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:71251:x1863837546343680:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 173us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497689.393402:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 168 00000100:00100000:0.0:1777497689.409407:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497689.412451:0:88680:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343808 00000100:00100000:3.0:1777497689.412641:0:88680:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343808 00000100:00100000:3.0:1777497689.412799:0:88680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:3.0:1777497689.412810:0:88680:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546343808:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497689.412829:0:88680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497689.412846:0:88680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5b800/0x3e357265691da52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c39f expref: -99 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.412875:0:88680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5b800/0x3e357265691da52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c39f expref: 9 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.412886:0:88680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5b800/0x3e357265691da52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c39f expref: 9 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497689.412910:0:88680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b800, rc 0) 00000100:00100000:3.0:1777497689.412992:0:88680:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546343808:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 185us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497689.412999:0:88680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 169 00000100:00100000:0.0:1777497689.417000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497689.417128:0:88684:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546343936 00000100:00100000:1.0:1777497689.417139:0:88684:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546343936 00000100:00100000:1.0:1777497689.417263:0:88684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:1.0:1777497689.417273:0:88684:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546343936:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497689.417403:0:88684:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae491c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546343936:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 131us (413us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497689.417410:0:88684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00010000:00010000:0.0:1777497690.274797:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497690.658414:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565006848:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658479:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658501:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565007360:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658527:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565007872:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658536:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658552:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777497690.658555:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565006976:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658566:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658575:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565007488:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658585:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658593:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565008000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.658603:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.658625:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006848 00000100:00100000:2.0:1777497690.658630:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006848 00000100:00100000:0.0:1777497690.658813:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565006592:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.658838:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497690.658950:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565006720:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.659021:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497690.659084:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006976 00000100:00100000:2.0:1777497690.659113:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006976 00000100:00100000:0.0:1777497690.664679:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565007104:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.664775:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497690.664847:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565007616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.664871:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497690.664883:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565008128:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.664912:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497690.664944:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565007232:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.664971:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006592 00000100:00100000:0.0:1777497690.664982:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006592 00000100:00100000:1.0:1777497690.665039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497690.665052:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1777497690.665066:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565006592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.665641:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565006720 00000100:00100000:2.0:1777497690.665648:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565006720 00000100:00100000:2.0:1777497690.665729:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007104 00000100:00100000:2.0:1777497690.665733:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007104 00000100:00100000:2.0:1777497690.665770:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007616 00000100:00100000:2.0:1777497690.665774:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007616 00000100:00100000:2.0:1777497690.665784:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008128 00000100:00100000:2.0:1777497690.665786:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008128 00000100:00100000:2.0:1777497690.665798:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1777497690.665806:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565006848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497690.665889:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1777497690.665899:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565006976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.669203:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae492c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565006592:12345-0@lo:400:kworker.0 Request processed in 4132us (10352us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.669219:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1777497690.669309:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565006592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.669951:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565007744:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.670056:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497690.670829:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007360 00000100:00100000:1.0:1777497690.670842:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007360 00000100:00100000:1.0:1777497690.670913:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007872 00000100:00100000:1.0:1777497690.670917:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007872 00000100:00100000:1.0:1777497690.670950:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007488 00000100:00100000:1.0:1777497690.670953:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007488 00000100:00100000:1.0:1777497690.670976:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008000 00000100:00100000:1.0:1777497690.670982:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008000 00000100:00100000:1.0:1777497690.671030:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2621 00000100:00100000:1.0:1777497690.671042:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565007360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671079:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1777497690.671137:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565006720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671224:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565006720:12345-0@lo:400:kworker.0 Request processed in 132us (12202us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.671231:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1339 00000100:00100000:0.0:1777497690.671257:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1777497690.671264:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565007104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671298:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565007104:12345-0@lo:400:kworker.0 Request processed in 36us (6524us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.671304:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1777497690.671316:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1777497690.671322:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565007616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671350:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565007616:12345-0@lo:400:kworker.0 Request processed in 29us (6479us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.671363:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1777497690.671378:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:0.0:1777497690.671384:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565008128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671416:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565008128:12345-0@lo:400:kworker.0 Request processed in 33us (6504us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.671422:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00080000:0.0:1777497690.671444:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497690.671449:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497690.671452:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497690.671454:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497690.671825:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565007104:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671841:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565007616:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671851:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565008128:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.671875:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497690.671885:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565008256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497690.671921:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497690.671958:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007232 00000100:00100000:0.0:1777497690.671964:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007232 00000100:00100000:0.0:1777497690.671998:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565007744 00000100:00100000:0.0:1777497690.672001:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565007744 00000100:00100000:0.0:1777497690.672011:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1777497690.672016:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3658:x1863837565007232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.672051:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3658:x1863837565007232:12345-0@lo:400:kworker.0 Request processed in 35us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.672057:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4022 00000100:00100000:0.0:1777497690.672077:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008256 00000100:00100000:0.0:1777497690.672080:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008256 00000100:00100000:0.0:1777497690.672115:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1777497690.672121:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565007744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.672150:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565007744:12345-0@lo:400:kworker.0 Request processed in 30us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.672156:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4023 00000100:00100000:0.0:1777497690.672167:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1777497690.672172:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565008256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497690.672196:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445437440 avail 1299197952 00000100:00100000:0.0:1777497690.672227:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565008256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.672232:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4024 00000100:00100000:0.0:1777497690.672257:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565008256:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497690.672305:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1777497690.672313:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565007872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.672342:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565007872:12345-0@lo:400:kworker.0 Request processed in 32us (13804us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.672347:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2622 00000100:00100000:0.0:1777497690.672362:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1777497690.672368:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565007488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.672394:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565007488:12345-0@lo:400:kworker.0 Request processed in 27us (13808us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497690.672399:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2623 00000100:00100000:0.0:1777497690.672408:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2624 00000100:00100000:0.0:1777497690.672421:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565008000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.672450:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565008000:12345-0@lo:400:kworker.0 Request processed in 30us (13846us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497690.672852:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565007360:12345-0@lo:400:kworker.0 Request processed in 1807us (14326us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497690.672864:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2621 00000100:00100000:1.0:1777497690.672947:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86224000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565006720:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.672964:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565007232:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.672977:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565007744:0@lo:400:kworker.0 00000100:00100000:0.0:1777497690.673259:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2624 00000100:00100000:2.0:1777497690.673564:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497690.673579:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565008384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497690.673621:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497690.673689:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008384 00000100:00100000:1.0:1777497690.673699:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008384 00000100:00100000:1.0:1777497690.673748:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4025 00000100:00100000:1.0:1777497690.673771:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1863837565008384:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497690.673819:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565007488:0@lo:400:kworker.0 00000004:00000024:1.0:1777497690.673820:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445175296 avail 1298935808 00000100:00100000:2.0:1777497690.673845:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565008000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.673861:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565007360:0@lo:400:kworker.0 00000100:00100000:2.0:1777497690.673881:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565007872:0@lo:400:kworker.0 00000100:00100000:1.0:1777497690.673904:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1863837565008384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497690.673912:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4025 00000100:00100000:2.0:1777497690.673951:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565006848:12345-0@lo:400:kworker.0 Request processed in 8144us (15469us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497690.673961:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:1.0:1777497690.673980:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565008384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497690.674008:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565006848:0@lo:400:kworker.0 00000100:00100000:3.0:1777497690.675348:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565006976:12345-0@lo:400:kworker.0 Request processed in 9445us (16773us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497690.675361:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1777497690.675427:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565006976:0@lo:400:kworker.0 00000100:00100000:3.0:1777497690.935304:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497690.935340:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344064 00000100:00100000:3.0:1777497690.935350:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344064 00000100:00100000:3.0:1777497690.935413:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1363 00000100:00100000:3.0:1777497690.935425:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:71271:x1863837546344064:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:3.0:1777497690.935446:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497690.935466:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3a6 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935530:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935546:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935560:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497690.935628:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497690.935632:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497690.935887:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935917:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3a6 expref: 8 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935934:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3a6 expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.935942:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:3.0:1777497690.935945:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497690.935948:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b000, rc 0) 00000100:00100000:3.0:1777497690.936004:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546344064:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 582us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497690.936012:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1363 00000100:00080000:3.0:1777497690.936041:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497690.942357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497690.952940:0:88691:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344192 00000100:00100000:3.0:1777497690.952957:0:88691:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344192 00000100:00100000:3.0:1777497690.953037:0:88691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:3.0:1777497690.953048:0:88691:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546344192:12345-192.168.202.4@tcp:700:mkdir.0 00000100:00100000:3.0:1777497690.953162:0:88691:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0002:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546344192:12345-192.168.202.4@tcp:700:mkdir.0 Request processed in 115us (10812us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497690.953169:0:88691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 15 00000100:00100000:2.0:1777497690.963222:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497690.963268:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344448 00000100:00100000:2.0:1777497690.963279:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344448 00000100:00100000:2.0:1777497690.963335:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1364 00000100:00100000:2.0:1777497690.963344:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546344448:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:2.0:1777497690.963402:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497690.963440:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691da60 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3a6 expref: 7 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963460:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497690.963465:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497690.963527:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963540:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963549:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963564:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963571:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.963576:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975027:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975057:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975069:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497690.975086:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000034e1c815 reply state 000000002697157c transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975117:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975125:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5b00) 00010000:00010000:3.0:1777497690.975128:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497690.975132:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777497690.975137:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1777497690.975146:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975152:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975159:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975165:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497690.975169:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975176:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975196:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:3.0:1777497690.975199:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497690.975202:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975208:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691da67 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497690.975219:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000034e1c815 reply state 000000002697157c transno 115964116996 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975228:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497690.975233:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9240aeddfb00) 00010000:00010000:3.0:1777497690.975235:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497690.975237:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1777497690.975338:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:71271:x1863837546344448:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 11992us (12124us total) trans 115964116996 rc 0/0 00000100:00100000:3.0:1777497690.975347:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1364 00000100:00100000:0.0:1777497690.985341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497690.985422:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344576 00000100:00100000:2.0:1777497690.985432:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344576 00000100:00100000:2.0:1777497690.985488:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1365 00000100:00100000:2.0:1777497690.985497:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:71271:x1863837546344576:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:2.0:1777497690.985518:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497690.985538:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691da7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3ad expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985614:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985628:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985639:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497690.985693:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497690.985697:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497690.985719:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985745:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691da7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ad expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985771:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ad expref: 9 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497690.985780:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497690.985783:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497690.985786:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fee00, rc 0) 00000100:00100000:2.0:1777497690.985836:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:71271:x1863837546344576:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 341us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497690.985843:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1365 00000100:00100000:1.0:1777497690.992657:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497690.992692:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344832 00000100:00100000:1.0:1777497690.992702:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344832 00000100:00100000:1.0:1777497690.993063:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1366 00000100:00100000:1.0:1777497690.993073:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:71271:x1863837546344832:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:1.0:1777497690.993189:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497690.993212:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691da8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3b4 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993287:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993302:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993313:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993323:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993331:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993338:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497690.993445:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1777497690.993515:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993536:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993542:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993549:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993554:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497690.993559:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993567:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993579:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497690.993581:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497690.993586:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993592:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691da91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993602:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993608:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993613:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993624:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497690.993627:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993633:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993641:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9240aeddfb00) 00010000:00010000:1.0:1777497690.993643:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497690.993645:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993651:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691da98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993685:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691da8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3b4 expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993696:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497690.993698:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497690.993701:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691da8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3b4 expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497690.993947:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cb000, rc 0) 00000100:00100000:1.0:1777497690.994009:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:71271:x1863837546344832:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 938us (1361us total) trans 115964116997 rc 301/301 00000100:00100000:1.0:1777497690.994017:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1366 00000100:00100000:2.0:1777497691.001774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497691.001862:0:63738:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546344960 00000100:00100000:0.0:1777497691.001872:0:63738:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546344960 00000100:00100000:0.0:1777497691.001941:0:63738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00100000:0.0:1777497691.001952:0:63738:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d146155b-4321-4b14-9284-f644ed9631fb+5:71271:x1863837546344960:12345-192.168.202.4@tcp:900:mkdir.0 00000100:00100000:0.0:1777497691.002031:0:63738:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d146155b-4321-4b14-9284-f644ed9631fb+5:71271:x1863837546344960:12345-192.168.202.4@tcp:900:mkdir.0 Request processed in 82us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.002037:0:63738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 14 00000100:00080000:3.0:1777497691.002236:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497691.004818:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.004895:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546345216 00000100:00100000:2.0:1777497691.004916:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546345216 00000100:00100000:2.0:1777497691.004972:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:2.0:1777497691.004981:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:71271:x1863837546345216:12345-192.168.202.4@tcp:35:mkdir.0 00000100:00100000:2.0:1777497691.005264:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:71271:x1863837546345216:12345-192.168.202.4@tcp:35:mkdir.0 Request processed in 284us (454us total) trans 115964116998 rc 0/0 00000100:00100000:2.0:1777497691.005271:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 242 00000100:00100000:0.0:1777497691.012446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.012628:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546345472 00000100:00100000:2.0:1777497691.012649:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546345472 00000100:00100000:2.0:1777497691.012713:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1367 00000100:00100000:2.0:1777497691.012725:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:71271:x1863837546345472:12345-192.168.202.4@tcp:36:mkdir.0 00000100:00100000:2.0:1777497691.012869:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008512:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.012918:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.012950:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.013125:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008512 00000100:00100000:0.0:1777497691.013129:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008512 00000100:00100000:0.0:1777497691.013169:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4026 00000100:00100000:0.0:1777497691.013176:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008512:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497691.013276:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008512:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.013296:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4026 00000100:00100000:2.0:1777497691.013422:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008512:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.013478:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008640:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.013499:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.013520:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.013695:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008640 00000100:00100000:1.0:1777497691.013700:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008640 00000100:00100000:1.0:1777497691.013745:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4027 00000100:00100000:1.0:1777497691.013752:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497691.013831:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008640:12345-0@lo:1000:mdt00_004.0 Request processed in 80us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.013837:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4027 00000100:00100000:3.0:1777497691.014158:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008640:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1777497691.014200:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008768:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1777497691.014228:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.014253:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497691.014418:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008768 00000100:00100000:2.0:1777497691.014423:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008768 00000100:00100000:2.0:1777497691.014455:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4028 00000100:00100000:2.0:1777497691.014462:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008768:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.014541:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008768:12345-0@lo:1000:mdt00_004.0 Request processed in 79us (311us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777497691.014547:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4028 00000100:00100000:3.0:1777497691.014608:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008768:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1777497691.014676:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.014696:0:65418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.014719:0:65418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.014736:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008896:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1777497691.014768:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.014787:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a840 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.014836:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565008896 00000100:00100000:1.0:1777497691.014840:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565008896 00000100:00100000:1.0:1777497691.014870:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4029 00000100:00100000:1.0:1777497691.014877:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565008896:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1777497691.014886:0:8407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497691.014900:0:8407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691daa6 expref: -99 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.014922:0:8407:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 2/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.014931:0:8407:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.014947:0:8407:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00080000:00080000:1.0:1777497691.014975:0:8407:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1777497691.015022:0:8407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.015060:0:8407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5b00) 00010000:00010000:1.0:1777497691.015064:0:8407:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497691.015067:0:8407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 9 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.015074:0:8407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cb000, rc 0) 00000100:00100000:1.0:1777497691.015126:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565008896:12345-0@lo:101:mdt00_004.0 Request processed in 250us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.015132:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4029 00000100:00100000:3.0:1777497691.015510:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565008896:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1777497691.015524:0:65418:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.015531:0:65418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777497691.020307:0:88674:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116998 is committed 00000001:00080000:2.0:1777497691.020351:0:88674:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964116995 is committed 00010000:00010000:0.0:1777497691.020420:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020433:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020440:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020456:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497691.020461:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020468:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020483:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9240aeddfb00) 00010000:00010000:0.0:1777497691.020486:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497691.020491:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020497:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691da6e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020515:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020521:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020526:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020530:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ac00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497691.020533:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020538:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020554:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5b00) 00010000:00010000:0.0:1777497691.020556:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497691.020562:0:3643:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020573:0:3643:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020580:0:3643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.020618:0:3643:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 7 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497691.020632:0:3643:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3643:1863837565009024:0@lo:105: 00000100:00100000:0.0:1777497691.020718:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497691.020776:0:3643:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.020788:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009024 00000100:00100000:1.0:1777497691.020796:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009024 00000100:00100000:1.0:1777497691.020850:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1777497691.020860:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3643:x1863837565009024:12345-0@lo:105: 00010000:00010000:1.0:1777497691.020869:0:6498:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020878:0:6498:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020887:0:6498:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020894:0:6498:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020900:0:6498:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020915:0:6498:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.020939:0:6498:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9240baa5a600) 00010000:00010000:3.0:1777497691.020983:0:65418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.020983:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:3643:x1863837565009024:12345-0@lo:105: Request processed in 124us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.020990:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:3.0:1777497691.020992:0:65418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497691.021016:0:65418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:3.0:1777497691.021048:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.021054:0:65418:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.021073:0:65418:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.021088:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009152:0@lo:101:mdt00_004.0 00000100:00100000:3.0:1777497691.021154:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.021168:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.021241:0:3643:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpc_hr00_000:lustre-MDT0000_UUID:3643:1863837565009024:0@lo:105: 00010000:00010000:0.0:1777497691.021255:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.021262:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ac00/0x3e357265691da75 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.021311:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009152 00000100:00100000:1.0:1777497691.021316:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009152 00000100:00100000:1.0:1777497691.021349:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4030 00000100:00100000:1.0:1777497691.021356:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:65418:x1863837565009152:12345-0@lo:101:mdt00_004.0 00010000:00010000:1.0:1777497691.021372:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497691.021386:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691dab4 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.021406:0:8406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dab4 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.021417:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dab4 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.021423:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff924086627500) 00010000:00010000:1.0:1777497691.021425:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497691.021427:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cbe00, rc 0) 00000100:00100000:1.0:1777497691.021463:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009152:12345-0@lo:101:mdt00_004.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.021476:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4030 00000100:00100000:3.0:1777497691.021721:0:65418:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964116995 gen 3 00000004:00080000:3.0:1777497691.021727:0:65418:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116995 committed transno 115964116995 00000100:00100000:3.0:1777497691.021743:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009152:0@lo:101:mdt00_004.0 00010000:00010000:3.0:1777497691.021765:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.021775:0:65418:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497691.021787:0:65418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:3.0:1777497691.021819:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009280:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1777497691.021845:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.021867:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.021910:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009280 00000100:00100000:0.0:1777497691.021915:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009280 00000100:00100000:0.0:1777497691.021947:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4031 00000100:00100000:0.0:1777497691.021954:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009280:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777497691.022029:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009280:12345-0@lo:1000:mdt00_004.0 Request processed in 76us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.022035:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4031 00000100:00100000:3.0:1777497691.022225:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009280:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.022326:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009408:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.022352:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.022376:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.022714:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009408 00000100:00100000:1.0:1777497691.022719:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009408 00000100:00100000:1.0:1777497691.022752:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4032 00000100:00100000:1.0:1777497691.022768:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009408:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497691.022844:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009408:12345-0@lo:1000:mdt00_004.0 Request processed in 77us (490us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497691.022850:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4032 00000100:00100000:2.0:1777497691.022868:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009408:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.022929:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009536:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.022951:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.022973:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.023019:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009536 00000100:00100000:0.0:1777497691.023024:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009536 00000100:00100000:0.0:1777497691.023053:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4033 00000100:00100000:0.0:1777497691.023059:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009536:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777497691.023142:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009536:12345-0@lo:1000:mdt00_004.0 Request processed in 83us (190us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497691.023148:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4033 00000100:00100000:2.0:1777497691.023210:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009536:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.023250:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.023271:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.023287:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.023305:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009664 00000100:00100000:1.0:1777497691.023309:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009664 00000100:00100000:1.0:1777497691.023339:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4034 00000100:00100000:1.0:1777497691.023345:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009664:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497691.023393:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009664:12345-0@lo:1000:mdt00_004.0 Request processed in 49us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.023400:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4034 00000100:00100000:2.0:1777497691.023408:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009664:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.023447:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009792:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497691.023470:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.023490:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.023530:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565009792 00000100:00100000:0.0:1777497691.023534:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565009792 00000100:00100000:0.0:1777497691.023562:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4035 00000100:00100000:0.0:1777497691.023568:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009792:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1777497691.023630:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:65418:x1863837565009792:12345-0@lo:1000:mdt00_004.0 Request processed in 62us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.023635:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4035 00000100:00100000:2.0:1777497691.023751:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-mdtlov_UUID:65418:1863837565009792:0@lo:1000:mdt00_004.0 00000040:00080000:2.0:1777497691.024202:0:65418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].4, 968 off37320 00000040:00080000:2.0:1777497691.024257:0:65418:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].4, 1120 off37904 00000004:00080000:2.0:1777497691.024263:0:65418:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff923f83e2a6c0 with version 13 00000004:00080000:0.0:1777497691.024416:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 13 rpc_version 13 00000020:00100000:0.0:1777497691.024438:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777497691.024445:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff923f8410ea00 x1863837565010048/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2392/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497691.024459:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565010048:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777497691.024509:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497691.024533:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ff9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497691.024589:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010048 00000100:00100000:2.0:1777497691.024593:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010048 00000100:00100000:2.0:1777497691.024631:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4036 00000100:00100000:2.0:1777497691.024638:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72705:x1863837565010048:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497691.029072:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:72705:x1863837565010048:12345-0@lo:1000:osp_up0-1.0 Request processed in 4423us (4550us total) trans 115964116999 rc 0/0 00000100:00100000:2.0:1777497691.029092:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4036 00000100:00100000:1.0:1777497691.029181:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ea00 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565010048:0@lo:1000:osp_up0-1.0 00010000:00010000:2.0:1777497691.033954:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.033977:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.033992:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497691.034012:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001e58646a reply state 00000000f160a50c transno 81604378755 ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034023:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034030:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497691.034032:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497691.034036:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1777497691.034042:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00080000:2.0:1777497691.034052:0:65418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1777497691.034061:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034070:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034077:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034126:0:65418:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1777497691.034146:0:65418:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1777497691.034151:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.034158:0:65418:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497691.034264:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546345472:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 21538us (21822us total) trans 81604378755 rc 0/0 00000100:00100000:2.0:1777497691.034272:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1367 00010000:00010000:1.0:1777497691.035284:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497691.035295:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.035305:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a600 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:1.0:1777497691.035311:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497691.035320:0:83956:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.035375:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.035381:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497691.035415:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.035422:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5a600/0x3e357265691daa6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691daad expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.035445:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497691.035447:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497691.035449:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497691.035854:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497691.035874:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565010176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497691.035930:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497691.038559:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010176 00000100:00100000:1.0:1777497691.038573:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010176 00000100:00100000:1.0:1777497691.038645:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1777497691.038655:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:3659:x1863837565010176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497691.038680:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497691.038713:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb000/0x3e357265691daad lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691daa6 expref: 10 pid: 8407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.038732:0:25500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5b00) 00010000:00010000:1.0:1777497691.038744:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497691.038828:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+9:3659:x1863837565010176:12345-0@lo:103:ldlm_bl.0 Request processed in 175us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.038835:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:3.0:1777497691.038882:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565010176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497691.040303:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.040391:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546345728 00000100:00100000:2.0:1777497691.040399:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546345728 00000100:00100000:2.0:1777497691.040447:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1368 00000100:00100000:2.0:1777497691.040455:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546345728:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:2.0:1777497691.040512:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497691.040533:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691da83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ad expref: 7 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.040548:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497691.040552:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497691.040690:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:71271:x1863837546345728:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 236us (392us total) trans 0 rc -17/-17 00000100:00100000:2.0:1777497691.040698:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1368 00000100:00100000:0.0:1777497691.044955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.045053:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546345856 00000100:00100000:3.0:1777497691.045074:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546345856 00000100:00100000:2.0:1777497691.045851:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1369 00000100:00100000:2.0:1777497691.045864:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:71271:x1863837546345856:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:2.0:1777497691.045887:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497691.045908:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691dac9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3bb expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.045982:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.045997:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.046010:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497691.046052:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497691.046055:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497691.046074:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.046117:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691dac9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3bb expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.046134:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3bb expref: 7 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.046142:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497691.046145:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497691.046148:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe800, rc 0) 00000100:00100000:2.0:1777497691.046213:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546345856:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 352us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.046220:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1369 00000100:00100000:0.0:1777497691.049983:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.050088:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546345984 00000100:00100000:3.0:1777497691.050397:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546345984 00000100:00100000:3.0:1777497691.050481:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1370 00000100:00100000:3.0:1777497691.050493:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546345984:12345-192.168.202.4@tcp:101:mkdir.0 00010000:00010000:3.0:1777497691.050524:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.050629:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691dad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3c2 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050906:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050924:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050938:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050956:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050963:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.050970:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.051068:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.051076:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.051907:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497691.051969:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497691.051973:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497691.051999:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052013:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052020:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052026:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052032:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.052037:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052044:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052057:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:3.0:1777497691.052060:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.052066:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052072:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052225:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052232:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052419:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052426:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.052429:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052435:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052445:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff92408cba5100) 00010000:00010000:3.0:1777497691.052448:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.052452:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052457:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691dae5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052508:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691dad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 9 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052524:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 8 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.052630:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5e00) 00010000:00010000:3.0:1777497691.052633:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497691.052636:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b200, rc 0) 00000100:00100000:2.0:1777497691.052845:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:71271:x1863837546345984:12345-192.168.202.4@tcp:101:mkdir.0 Request processed in 2343us (2859us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.052873:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1370 00000100:00100000:3.0:1777497691.056912:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.057014:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546346240 00000100:00100000:2.0:1777497691.057029:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546346240 00000100:00100000:2.0:1777497691.057139:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1371 00000100:00100000:2.0:1777497691.057150:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:71271:x1863837546346240:12345-192.168.202.4@tcp:36:mkdir.0 00000100:00100000:2.0:1777497691.057289:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.057356:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.057395:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.057515:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010304 00000100:00100000:1.0:1777497691.057545:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010304 00000100:00100000:1.0:1777497691.057603:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4037 00000100:00100000:1.0:1777497691.057613:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:64885:x1863837565010304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777497691.057772:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:64885:x1863837565010304:12345-0@lo:1000:mdt00_003.0 Request processed in 159us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.057781:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4037 00000100:00100000:2.0:1777497691.057826:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.057875:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010432:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.057905:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.057929:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.058000:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010432 00000100:00100000:1.0:1777497691.058006:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010432 00000100:00100000:1.0:1777497691.058039:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4038 00000100:00100000:1.0:1777497691.058047:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:64885:x1863837565010432:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777497691.058194:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:64885:x1863837565010432:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (288us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497691.058213:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4038 00000100:00100000:2.0:1777497691.058243:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010432:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1777497691.058300:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.058311:0:64885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.058322:0:64885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497691.058334:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010560:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1777497691.058362:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.058386:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497691.058436:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010560 00000100:00100000:3.0:1777497691.058442:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010560 00000100:00100000:3.0:1777497691.058482:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4039 00000100:00100000:3.0:1777497691.058490:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:64885:x1863837565010560:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1777497691.058503:0:8406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.058518:0:8406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691daf3 expref: -99 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.058543:0:8406:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 7 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.058557:0:8406:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 4/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.058584:0:8406:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 7 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.058599:0:8406:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 7 pid: 73210 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.058612:0:8406:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8406:1863837565010688:192.168.202.4@tcp:104: 00000100:00100000:3.0:1777497691.058681:0:8406:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a840 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.064022:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.064192:0:8406:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:8406:1863837565010688:192.168.202.4@tcp:104: 00000100:00100000:1.0:1777497691.064420:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546346368 00000100:00100000:1.0:1777497691.064431:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546346368 00010000:00010000:1.0:1777497691.064480:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 8 pid: 73210 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.064535:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2570 00000100:00100000:1.0:1777497691.064546:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+8:2414:x1863837546346368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497691.064565:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497691.064573:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 8 pid: 73210 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.064588:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 8 pid: 73210 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.064639:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691daec lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c2 expref: 8 pid: 73210 timeout: 3920 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.064661:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5e00) 00010000:00010000:1.0:1777497691.064669:0:6500:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.064695:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.064829:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.065551:0:8406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.065565:0:8406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5e00) 00010000:00010000:3.0:1777497691.065568:0:8406:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.065571:0:8406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b600, rc 0) 00000100:00100000:3.0:1777497691.065660:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:64885:x1863837565010560:12345-0@lo:101:mdt00_003.0 Request processed in 7171us (7296us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.065669:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4039 00000100:00100000:2.0:1777497691.065763:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010560:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777497691.065817:0:64885:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.065831:0:64885:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.065895:0:6500:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.065914:0:6500:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6500:1863837565010816:0@lo:105: 00000100:00100000:1.0:1777497691.065961:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497691.066014:0:6500:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497691.066066:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010816 00000100:00100000:2.0:1777497691.066077:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010816 00000100:00100000:2.0:1777497691.066169:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1777497691.066178:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6500:x1863837565010816:12345-0@lo:105: 00010000:00010000:2.0:1777497691.066189:0:13186:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066200:0:13186:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066208:0:13186:0:(ldlm_lockd.c:2045:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 5/0,1 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066217:0:13186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 5/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066225:0:13186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066233:0:13186:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 6/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066266:0:13186:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9240bb7ff000) 00000100:00100000:2.0:1777497691.066332:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0001-mdtlov_UUID+4:6500:x1863837565010816:12345-0@lo:105: Request processed in 155us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.066338:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:2.0:1777497691.066362:0:64885:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066370:0:64885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497691.066394:0:64885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:2.0:1777497691.066430:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066439:0:64885:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.066450:0:64885:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497691.066471:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010944:0@lo:101:mdt00_003.0 00000100:00100000:2.0:1777497691.066507:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.066541:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497691.066667:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565010944 00000100:00100000:3.0:1777497691.066675:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565010944 00000100:00100000:1.0:1777497691.066873:0:6500:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-MDT0000_UUID:6500:1863837565010816:0@lo:105: 00010000:00010000:1.0:1777497691.066892:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497691.066957:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546346368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 2411us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.066966:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2570 00000100:00100000:3.0:1777497691.067032:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4040 00000100:00100000:3.0:1777497691.067043:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+10:64885:x1863837565010944:12345-0@lo:101:mdt00_003.0 00010000:00010000:3.0:1777497691.067066:0:80394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.067089:0:80394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691db01 expref: -99 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.067474:0:80394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691db01 expref: 11 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.067492:0:80394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691db01 expref: 11 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.067500:0:80394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff92408cba5100) 00010000:00010000:3.0:1777497691.067503:0:80394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.067506:0:80394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ae00, rc 0) 00000100:00100000:3.0:1777497691.067561:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565010944:12345-0@lo:101:mdt00_003.0 Request processed in 520us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.067582:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4040 00000100:00100000:2.0:1777497691.067687:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565010944:0@lo:101:mdt00_003.0 00010000:00010000:2.0:1777497691.067707:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.067718:0:64885:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497691.067750:0:64885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00000100:00100000:2.0:1777497691.067802:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.067842:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.067866:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.069178:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011072 00000100:00100000:1.0:1777497691.069192:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011072 00000100:00100000:1.0:1777497691.069628:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4041 00000100:00100000:1.0:1777497691.069639:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011072:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777497691.070023:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011072:12345-0@lo:1000:mdt00_003.0 Request processed in 384us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.070033:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4041 00000100:00100000:2.0:1777497691.070443:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011072:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.070535:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.070584:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.070660:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.070709:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011200 00000100:00100000:0.0:1777497691.070715:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011200 00000100:00100000:0.0:1777497691.070811:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4042 00000100:00100000:0.0:1777497691.070820:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011200:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1777497691.070966:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011200:12345-0@lo:1000:mdt00_003.0 Request processed in 147us (381us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497691.070973:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4042 00000100:00100000:2.0:1777497691.071041:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011200:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.071160:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.071183:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.071208:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497691.071380:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011328 00000100:00100000:3.0:1777497691.071385:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011328 00000100:00100000:3.0:1777497691.071423:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4043 00000100:00100000:3.0:1777497691.071431:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011328:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777497691.071501:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011328:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (316us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497691.071508:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4043 00000100:00100000:2.0:1777497691.071677:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011328:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.071730:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011456:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.071765:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.071787:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497691.071839:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011456 00000100:00100000:3.0:1777497691.071844:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011456 00000100:00100000:3.0:1777497691.071880:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4044 00000100:00100000:3.0:1777497691.071887:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011456:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777497691.071958:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011456:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.071964:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4044 00000100:00100000:1.0:1777497691.072035:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011456:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777497691.072086:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011584:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1777497691.072142:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497691.072170:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409110fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497691.072221:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011584 00000100:00100000:2.0:1777497691.072225:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011584 00000100:00100000:2.0:1777497691.072385:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4045 00000100:00100000:2.0:1777497691.072393:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011584:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1777497691.072448:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:64885:x1863837565011584:12345-0@lo:1000:mdt00_003.0 Request processed in 57us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.072455:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4045 00000100:00100000:1.0:1777497691.072788:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565011584:0@lo:1000:mdt00_003.0 00000040:00080000:1.0:1777497691.073707:0:64885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2400090a0:0x2:0x0].5, 968 off38288 00000040:00080000:1.0:1777497691.073799:0:64885:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x2000088d1:0x2:0x0].5, 1120 off39024 00000004:00080000:1.0:1777497691.073805:0:64885:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff92409110ff00 with version 14 00000004:00080000:0.0:1777497691.074493:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 14 rpc_version 14 00000020:00100000:0.0:1777497691.074542:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1777497691.074558:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9240865d9880 x1863837565011840/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 2136/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497691.074585:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565011840:0@lo:1000:osp_up0-1.0 00000100:00100000:0.0:1777497691.074666:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497691.074783:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69ffcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497691.074932:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011840 00000100:00100000:2.0:1777497691.074941:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011840 00000100:00100000:2.0:1777497691.075060:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4046 00000100:00100000:2.0:1777497691.075073:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+11:72705:x1863837565011840:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497691.075875:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+12:72705:x1863837565011840:12345-0@lo:1000:osp_up0-1.0 Request processed in 801us (1205us total) trans 115964117000 rc 0/0 00000100:00100000:2.0:1777497691.075887:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4046 00000100:00100000:0.0:1777497691.076887:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865d9880 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565011840:0@lo:1000:osp_up0-1.0 00010000:00010000:1.0:1777497691.077088:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077226:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077378:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497691.077403:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007b59a0b6 reply state 00000000619a24a0 transno 81604378756 ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077418:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077498:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:1.0:1777497691.077515:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497691.077521:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1777497691.077529:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00080000:1.0:1777497691.077541:0:64885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1777497691.077553:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077563:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077570:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077643:0:64885:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1777497691.077650:0:64885:0:(osp_object.c:1397:osp_invalidate()) Invalidate osp_object [0x20000cf21:0x1:0x0] 00010000:00010000:1.0:1777497691.077656:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.077665:0:64885:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.077860:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:71271:x1863837546346240:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 20706us (20958us total) trans 81604378756 rc 0/0 00000100:00100000:1.0:1777497691.077870:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1371 00010000:00010000:2.0:1777497691.077944:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497691.077952:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.077961:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff000 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:2.0:1777497691.077967:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497691.077975:0:6503:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.078015:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.078021:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497691.078055:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 1/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.078063:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7ff000/0x3e357265691daf3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x3e357265691dafa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.078084:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497691.078134:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497691.078136:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497691.078180:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497691.078199:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565011968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497691.078278:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.078552:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565011968 00000100:00100000:2.0:1777497691.078561:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565011968 00000100:00100000:2.0:1777497691.078624:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:2.0:1777497691.078634:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+12:3658:x1863837565011968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497691.078651:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497691.078674:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dafa lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691daf3 expref: 12 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.078690:0:6501:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5e00) 00010000:00010000:2.0:1777497691.078701:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497691.078739:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:3658:x1863837565011968:12345-0@lo:103:ldlm_bl.0 Request processed in 106us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.078746:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1777497691.078916:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565011968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497691.096001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.096417:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546346496 00000100:00100000:2.0:1777497691.096506:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546346496 00000100:00100000:2.0:1777497691.096594:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1372 00000100:00100000:2.0:1777497691.096607:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:71272:x1863837546346496:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497691.096637:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497691.096664:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691db16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3c9 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097514:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097534:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097568:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097588:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097595:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097601:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097820:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097829:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097837:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497691.097885:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497691.097889:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497691.097934:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097950:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097958:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097974:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097980:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.097987:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497691.097993:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098000:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098013:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497691.098017:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497691.098022:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098029:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691db1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098047:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098053:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098059:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098064:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497691.098073:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098079:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098086:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff924090680300) 00010000:00010000:2.0:1777497691.098088:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497691.098091:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098378:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691db24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098437:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691db16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c9 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098454:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c9 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.098461:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680000) 00010000:00010000:2.0:1777497691.098464:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777497691.098466:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fec00, rc 0) 00000100:00100000:2.0:1777497691.098574:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+8:71272:x1863837546346496:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 1970us (2588us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.098585:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1372 00000100:00100000:3.0:1777497691.101153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.101952:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546346624 00000100:00100000:2.0:1777497691.101966:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546346624 00000100:00100000:2.0:1777497691.102060:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1373 00000100:00100000:2.0:1777497691.102072:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:71272:x1863837546346624:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497691.102138:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497691.102169:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691db32 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3d0 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102395:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102414:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102558:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102574:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102586:0:65418:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dab4 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102595:0:65418:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.102642:0:65418:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691dab4 expref: 10 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497691.102661:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837565012096:0@lo:104: 00000100:00100000:2.0:1777497691.102880:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.102974:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497691.103395:0:6498:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012096 00000100:00100000:1.0:1777497691.103403:0:6498:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012096 00000100:00100000:1.0:1777497691.103563:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1777497691.103573:0:6498:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65418:x1863837565012096:12345-0@lo:104: 00010000:00010000:1.0:1777497691.103590:0:6498:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.103774:0:6498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1777497691.103782:0:6498:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:65418:x1863837565012096:12345-0@lo:104: Request processed in 210us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.103790:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1777497691.103847:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497691.103855:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.103865:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ba00 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:0.0:1777497691.103871:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497691.103882:0:6502:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.103943:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.103950:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497691.103977:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.103985:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240baa5ba00/0x3e357265691dab4 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691dabb expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.104009:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497691.104011:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497691.104012:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497691.104023:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497691.104038:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565012224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497691.104083:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497691.104142:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012224 00000100:00100000:0.0:1777497691.104147:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012224 00010000:00010000:0.0:1777497691.104171:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x3e357265691dab4 expref: 11 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497691.104194:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:0.0:1777497691.104201:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+11:3657:x1863837565012224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497691.104213:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777497691.105166:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:65418:1863837565012096:0@lo:104: 00010000:00010000:3.0:1777497691.105197:0:65418:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777497691.107024:0:88674:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117000 is committed 00010000:00010000:0.0:1777497691.107352:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691dabb lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691dab4 expref: 9 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.107393:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff924086627500) 00010000:00010000:0.0:1777497691.107398:0:6499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.107407:0:6499:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.107415:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.107458:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497691.107551:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:3657:x1863837565012224:12345-0@lo:103:ldlm_bl.0 Request processed in 3348us (3466us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.107560:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00010000:00010000:3.0:1777497691.107683:0:65418:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.107692:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.107723:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565012224:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497691.107851:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837565012352:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1777497691.107942:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.107975:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497691.108183:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012352 00000100:00100000:0.0:1777497691.108193:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012352 00000100:00100000:1.0:1777497691.108527:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4047 00000100:00100000:1.0:1777497691.108554:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837565012352:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497691.108705:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837565012352:12345-0@lo:1000:mdt00_004.0 Request processed in 160us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.108712:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4047 00000100:00100000:3.0:1777497691.108994:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837565012352:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1777497691.109056:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109073:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109084:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497691.109220:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109238:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109244:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109249:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109255:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109260:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.109264:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109270:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109293:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680000) 00010000:00010000:3.0:1777497691.109296:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.109300:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109306:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe000/0x3e357265691db39 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109320:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109326:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109332:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109336:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.109338:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109343:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109350:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff924086627500) 00010000:00010000:3.0:1777497691.109352:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.109354:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109359:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691db40 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109408:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691db32 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d0 expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109420:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d0 expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.109427:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff92408cba5700) 00010000:00010000:3.0:1777497691.109430:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497691.109432:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a400, rc 0) 00000100:00100000:3.0:1777497691.109495:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:71272:x1863837546346624:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 7426us (8403us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.109504:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1373 00000100:00100000:0.0:1777497691.118632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.118723:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546346752 00000100:00100000:3.0:1777497691.118733:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546346752 00000100:00100000:3.0:1777497691.118794:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1374 00000100:00100000:3.0:1777497691.118803:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+9:71272:x1863837546346752:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497691.118827:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.118847:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691db4e lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3d7 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.118908:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691db55 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.118923:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691db55 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.118934:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691db55 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497691.118993:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1777497691.118998:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777497691.119034:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691db4e lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d7 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.119053:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691db55 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d7 expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.119062:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:3.0:1777497691.119064:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777497691.119067:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5bc00, rc 0) 00000100:00100000:3.0:1777497691.119152:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:71272:x1863837546346752:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 350us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.119159:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1374 00000100:00100000:1.0:1777497691.132665:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.132794:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546347008 00000100:00100000:3.0:1777497691.132810:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546347008 00000100:00100000:3.0:1777497691.132886:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1375 00000100:00100000:3.0:1777497691.132896:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:71272:x1863837546347008:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497691.132917:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.132940:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691db5c lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3de expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497691.133040:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1777497691.133194:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691db5c lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3de expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.133227:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff92408cba5400) 00010000:00010000:3.0:1777497691.133230:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497691.133235:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691db5c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3de expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.133254:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5be00, rc 0) 00000100:00100000:3.0:1777497691.133313:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+11:71272:x1863837546347008:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 418us (661us total) trans 81604378757 rc 301/301 00000100:00100000:3.0:1777497691.133320:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1375 00000100:00100000:0.0:1777497691.138504:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.138667:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546347264 00000100:00100000:3.0:1777497691.138678:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546347264 00000100:00100000:3.0:1777497691.138734:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1376 00000100:00100000:3.0:1777497691.138744:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:71272:x1863837546347264:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1777497691.138811:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497691.138838:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691db55 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d7 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.138857:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:3.0:1777497691.138861:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497691.138880:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.138892:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.138901:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497691.139055:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f4ae79ea reply state 00000000c4589233 transno 81604378758 ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.139068:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.139075:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:3.0:1777497691.139077:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1777497691.139080:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777497691.139088:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000100:00100000:3.0:1777497691.139422:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:71272:x1863837546347264:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 678us (926us total) trans 81604378758 rc 0/0 00000100:00100000:3.0:1777497691.139430:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1376 00000100:00100000:0.0:1777497691.142846:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497691.144425:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546347520 00000100:00100000:1.0:1777497691.144439:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546347520 00000100:00100000:1.0:1777497691.144510:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 243 00000100:00100000:1.0:1777497691.144519:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+12:71272:x1863837546347520:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:1.0:1777497691.144778:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+13:71272:x1863837546347520:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 259us (1939us total) trans 81604378759 rc 0/0 00000100:00100000:1.0:1777497691.144785:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 243 00000100:00100000:0.0:1777497691.170501:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497691.170525:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565012480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497691.170590:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.170977:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497691.170989:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565012608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497691.171021:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497691.171121:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012480 00000100:00100000:2.0:1777497691.171143:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012480 00000100:00100000:2.0:1777497691.171188:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012608 00000100:00100000:2.0:1777497691.171190:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012608 00000100:00100000:2.0:1777497691.171212:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1777497691.171221:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565012480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497691.171252:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497691.171296:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565012480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.171303:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1777497691.171319:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1777497691.171325:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565012608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497691.171340:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497691.171366:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565012608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497691.171371:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:3.0:1777497691.171506:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565012608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497691.171587:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565012480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497691.174140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.174281:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546347648 00000100:00100000:3.0:1777497691.174291:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546347648 00000100:00100000:3.0:1777497691.174346:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1377 00000100:00100000:3.0:1777497691.174356:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+9:71273:x1863837546347648:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497691.174375:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.174397:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5bc00/0x3e357265691db71 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3e5 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174462:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174486:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174499:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174511:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174521:0:63728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691db01 expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174529:0:63728:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 4/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.174561:0:63728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691db01 expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.174574:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837565012736:0@lo:104: 00000100:00100000:3.0:1777497691.174611:0:63728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497691.174971:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012736 00000100:00100000:0.0:1777497691.174976:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012736 00000100:00100000:0.0:1777497691.175012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1777497691.175019:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:63728:x1863837565012736:12345-0@lo:104: 00010000:00010000:0.0:1777497691.175038:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.175087:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497691.175112:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:63728:x1863837565012736:12345-0@lo:104: Request processed in 75us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.175120:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:1.0:1777497691.175190:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497691.175197:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1400000000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.175205:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc1911ee0) 00010000:00010000:1.0:1777497691.175210:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1408400000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497691.175219:0:8412:0:(mdt_handler.c:3963:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 4/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x1409400000000 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.175245:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 2/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.175252:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497691.175280:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.175288:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff9240bb7fee00/0x3e357265691db01 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x2 rrc: 2 type: IBT gid 0 flags: 0x5c09400000020 nid: local remote: 0x3e357265691db08 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497691.175305:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497691.175307:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497691.175308:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497691.175316:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497691.175326:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565012864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497691.175352:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497691.175376:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012864 00000100:00100000:1.0:1777497691.175380:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012864 00010000:00010000:1.0:1777497691.175401:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 5/0,0 mode: PW/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000400000020 nid: 0@lo remote: 0x3e357265691db01 expref: 8 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497691.175421:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1777497691.175426:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3658:x1863837565012864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497691.175434:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497691.176029:0:10268:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff92408cba5100) 00010000:00010000:0.0:1777497691.176036:0:10268:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.176046:0:10268:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.176052:0:10268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 4/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.176070:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497691.176136:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:3658:x1863837565012864:12345-0@lo:103:ldlm_bl.0 Request processed in 709us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497691.176143:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1777497691.176272:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7ab40 going to sleep for 11 seconds 00010000:00010000:3.0:1777497691.176296:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ae00/0x3e357265691db08 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691db01 expref: 7 pid: 80394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.176309:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:63728:1863837565012736:0@lo:104: 00010000:00010000:3.0:1777497691.176325:0:63728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.176334:0:63728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.176347:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497691.176439:0:63728:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:63728:1863837565012992:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777497691.176470:0:63728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497691.176495:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565012992 00000100:00100000:3.0:1777497691.176499:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565012992 00000100:00100000:3.0:1777497691.176526:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4048 00000100:00100000:3.0:1777497691.176532:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63728:x1863837565012992:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1777497691.176581:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63728:x1863837565012992:12345-0@lo:1000:mdt00_001.0 Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.176587:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4048 00000100:00100000:1.0:1777497691.176872:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565012864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497691.176954:0:63728:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a600 going to sleep for 11 seconds 00000100:00100000:3.0:1777497691.176966:0:63728:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:63728:1863837565012992:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1777497691.177002:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177013:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177020:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497691.177039:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177051:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177067:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177073:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177080:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177086:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.177090:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177125:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177135:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680000) 00010000:00010000:3.0:1777497691.177138:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.177141:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177147:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691db78 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177158:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177164:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177169:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177179:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497691.177182:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177188:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177194:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff92408cba5100) 00010000:00010000:3.0:1777497691.177196:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497691.177198:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177204:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691db7f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177237:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5bc00/0x3e357265691db71 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3e5 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177250:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3e5 expref: 10 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.177257:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff92408cba5400) 00010000:00010000:3.0:1777497691.177259:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497691.177261:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5b200, rc 0) 00000100:00100000:3.0:1777497691.177344:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:71273:x1863837546347648:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 2990us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.177350:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1377 00000100:00100000:0.0:1777497691.191839:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497691.193425:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546347776 00000100:00100000:3.0:1777497691.193455:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546347776 00000100:00100000:3.0:1777497691.193592:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1378 00000100:00100000:3.0:1777497691.193603:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+13:71273:x1863837546347776:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497691.193632:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497691.194001:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691db8d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3ec expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.194064:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691db94 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.194083:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691db94 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.194119:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691db94 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497691.194172:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777497691.194176:0:63729:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777497691.194215:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691db8d lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ec expref: 15 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.194233:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691db94 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ec expref: 14 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497691.194241:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:3.0:1777497691.194243:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1777497691.194247:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ac00, rc 0) 00000100:00100000:3.0:1777497691.194319:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+14:71273:x1863837546347776:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 718us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497691.194327:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1378 00000100:00100000:0.0:1777497691.216215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.216367:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348032 00000100:00100000:2.0:1777497691.216379:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348032 00000100:00100000:2.0:1777497691.216448:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1379 00000100:00100000:2.0:1777497691.216457:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+14:71273:x1863837546348032:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497691.216478:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497691.216501:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691db9b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3f3 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497691.216609:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1777497691.216729:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691db9b lrc: 1/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3f3 expref: 16 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.216772:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680300) 00010000:00010000:2.0:1777497691.216775:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1777497691.216780:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691db9b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3f3 expref: 16 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497691.216798:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff000, rc 0) 00000100:00100000:2.0:1777497691.216862:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+15:71273:x1863837546348032:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 407us (657us total) trans 81604378760 rc 301/301 00000100:00100000:2.0:1777497691.216870:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1379 00000100:00100000:1.0:1777497691.222745:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497691.223066:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348288 00000100:00100000:0.0:1777497691.223077:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348288 00000100:00100000:0.0:1777497691.223180:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1380 00000100:00100000:0.0:1777497691.223192:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+15:71273:x1863837546348288:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:0.0:1777497691.223253:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497691.223287:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691db94 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3ec expref: 15 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.223326:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:0.0:1777497691.223332:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497691.223358:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.223371:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.223381:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497691.223544:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000fa229f1d reply state 00000000485b76da transno 81604378761 ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.223557:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497691.223563:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:0.0:1777497691.223566:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:0.0:1777497691.223569:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1777497691.223576:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000100:00100000:0.0:1777497691.223876:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+16:71273:x1863837546348288:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 683us (1138us total) trans 81604378761 rc 0/0 00000100:00100000:0.0:1777497691.223883:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1380 00000100:00100000:0.0:1777497691.227689:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497691.227824:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348544 00000100:00100000:2.0:1777497691.227849:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348544 00000100:00100000:2.0:1777497691.227907:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 244 00000100:00100000:2.0:1777497691.227918:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+16:71273:x1863837546348544:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:2.0:1777497691.228168:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+17:71273:x1863837546348544:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 252us (485us total) trans 81604378762 rc 0/0 00000100:00100000:2.0:1777497691.228174:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 244 00010000:00010000:0.0:1777497691.301228:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497691.970376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497691.970421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497691.970462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497691.970501:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497691.970542:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349056 00000100:00100000:1.0:1777497691.970555:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349056 00000100:00100000:1.0:1777497691.970629:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2625 00000100:00100000:1.0:1777497691.970641:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546349056:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497691.970756:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546349056:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.970766:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2625 00000100:00100000:1.0:1777497691.970797:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348800 00000100:00100000:1.0:1777497691.970802:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348800 00000100:00100000:1.0:1777497691.970835:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348928 00000100:00100000:1.0:1777497691.970837:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348928 00000100:00100000:1.0:1777497691.970859:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1343 00000100:00100000:1.0:1777497691.970866:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:2412:x1863837546348800:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497691.970901:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:2412:x1863837546348800:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.970918:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1343 00000100:00100000:1.0:1777497691.970932:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1344 00000100:00100000:1.0:1777497691.970938:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+17:2412:x1863837546348928:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497691.970976:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+17:2412:x1863837546348928:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.970982:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1344 00000100:00080000:1.0:1777497691.971000:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497691.971223:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546348672 00000100:00100000:1.0:1777497691.971228:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546348672 00000100:00100000:1.0:1777497691.971260:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:1.0:1777497691.971267:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546348672:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497691.971301:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546348672:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497691.971307:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00010000:00010000:1.0:1777497692.322531:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1777497692.341610:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378762 is committed 00010000:00010000:2.0:1777497692.341755:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341769:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341776:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341783:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497692.341803:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341811:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341827:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497692.341831:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497692.341835:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341852:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ffe00/0x3e357265691dac2 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341872:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341877:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341883:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341888:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497692.341891:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341897:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341904:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:2.0:1777497692.341906:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497692.341916:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341922:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f896cb000/0x3e357265691db0f lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341934:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341940:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341945:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341950:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ba00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497692.341952:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341958:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341965:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497692.341968:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497692.341971:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341976:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ba00/0x3e357265691db6a lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341993:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.341999:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.342009:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.342015:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497692.342018:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.342024:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.342031:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924086627b00) 00010000:00010000:2.0:1777497692.342033:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497692.342035:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.342041:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dba9 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497692.424358:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497692.424499:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349184 00000100:00100000:3.0:1777497692.424510:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349184 00000100:00100000:3.0:1777497692.424580:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1381 00000100:00100000:3.0:1777497692.424592:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:71282:x1863837546349184:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497692.424631:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445158912 avail 1298919424 00000100:00100000:3.0:1777497692.424710:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:71282:x1863837546349184:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 109us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497692.424718:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1381 00000100:00080000:1.0:1777497692.424856:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497692.436290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497692.436362:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349312 00000100:00100000:3.0:1777497692.436372:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349312 00000100:00100000:3.0:1777497692.436429:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1382 00000100:00100000:3.0:1777497692.436440:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:71282:x1863837546349312:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497692.436475:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:3.0:1777497692.437198:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:71282:x1863837546349312:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 755us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497692.437207:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1382 00000100:00100000:1.0:1777497692.450642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497692.450723:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349440 00000100:00100000:2.0:1777497692.450733:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349440 00000100:00100000:2.0:1777497692.450807:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2142 00000100:00100000:2.0:1777497692.450818:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:71282:x1863837546349440:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497692.450844:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497692.450905:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:71282:x1863837546349440:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 89us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497692.450912:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2142 00000100:00100000:3.0:1777497692.455651:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497692.464409:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349568 00000100:00100000:1.0:1777497692.464424:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349568 00000100:00100000:1.0:1777497692.464481:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5891 00000100:00100000:1.0:1777497692.464489:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:0+-99:2411:x1863837546349568:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:1.0:1777497692.464528:0:25492:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3821 last 0 00000020:00000080:1.0:1777497692.464558:0:25492:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691dbb0 00002000:00100000:1.0:1777497692.464578:0:25492:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff9240bb785000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1777497692.464589:0:25492:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1777497692.464681:0:25492:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1777497692.464734:0:25492:0:(import.c:65:import_set_state_nolock()) ffff9240bb784000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497692.464813:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546349568:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 323us (9171us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497692.464821:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5891 00000100:00100000:1.0:1777497692.468619:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497692.471183:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349696 00000100:00100000:3.0:1777497692.471198:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349696 00000100:00100000:3.0:1777497692.471276:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2143 00000100:00100000:3.0:1777497692.471287:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71282:x1863837546349696:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497692.471314:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497692.471387:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71282:x1863837546349696:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 103us (2775us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497692.471395:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2143 00000100:00080000:3.0:1777497692.471418:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497692.554182:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497692.554281:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349952 00000100:00100000:0.0:1777497692.554292:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349952 00000100:00100000:0.0:1777497692.554371:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1383 00000100:00100000:0.0:1777497692.554381:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+10:71289:x1863837546349952:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:0.0:1777497692.554443:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497692.554471:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691dad0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3bb expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554490:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497692.554495:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497692.554554:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554567:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554576:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554589:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554595:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554601:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554977:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.554986:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555004:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555010:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497692.555014:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555022:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555031:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497692.555033:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497692.555037:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555043:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbb7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497692.555055:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008b24e595 reply state 00000000caa89500 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555065:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.555072:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215100) 00010000:00010000:0.0:1777497692.555074:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497692.555076:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497692.555198:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:71289:x1863837546349952:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 818us (1027us total) trans 115964117001 rc 0/0 00000100:00100000:0.0:1777497692.555206:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1383 00000100:00100000:3.0:1777497692.586548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497692.586891:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350080 00000100:00100000:0.0:1777497692.586902:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350080 00000100:00100000:0.0:1777497692.586968:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1384 00000100:00100000:0.0:1777497692.586979:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:71292:x1863837546350080:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:0.0:1777497692.587004:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497692.587024:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c3fa expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587280:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587298:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587312:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497692.587358:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1777497692.587362:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497692.587387:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587415:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3fa expref: 13 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587433:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3fa expref: 12 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.587443:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497692.587446:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1777497692.587461:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee600, rc 0) 00000100:00100000:0.0:1777497692.587643:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+12:71292:x1863837546350080:12345-192.168.202.4@tcp:101:rm.0 Request processed in 667us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497692.587651:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1384 00000100:00100000:0.0:1777497692.591829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497692.591927:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350208 00000100:00100000:1.0:1777497692.591937:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350208 00000100:00100000:1.0:1777497692.592031:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1385 00000100:00100000:1.0:1777497692.592042:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+12:71292:x1863837546350208:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:1.0:1777497692.592061:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497692.592080:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691dbd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c401 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592174:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592189:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592200:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592210:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592216:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592237:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592316:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592323:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592331:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497692.592373:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x3:0x0]: returning size 0 00000004:00200000:1.0:1777497692.592377:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497692.592396:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592409:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592418:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592424:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592431:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592438:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592454:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cac00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497692.592459:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592466:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592478:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:1.0:1777497692.592481:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497692.592485:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592491:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cac00/0x3e357265691dbda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592504:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592509:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592515:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592519:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497692.592522:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592626:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592645:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215100) 00010000:00010000:1.0:1777497692.592647:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497692.592650:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592657:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cb800/0x3e357265691dbe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592683:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbc00/0x3e357265691dbd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c401 expref: 14 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592708:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c401 expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497692.592716:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff924086627400) 00010000:00010000:1.0:1777497692.592718:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497692.592720:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896caa00, rc 0) 00000100:00100000:1.0:1777497692.592797:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+13:71292:x1863837546350208:12345-192.168.202.4@tcp:101:rm.0 Request processed in 757us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497692.592805:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1385 00000100:00100000:2.0:1777497692.595687:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497692.597864:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350464 00000100:00100000:0.0:1777497692.597879:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350464 00000100:00100000:0.0:1777497692.598020:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1386 00000100:00100000:0.0:1777497692.598032:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+13:71292:x1863837546350464:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:0.0:1777497692.598154:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1777497692.598187:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691dbe8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c401 expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598211:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff924086627400) 00010000:00010000:0.0:1777497692.598229:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dbcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3fa expref: 12 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598240:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497692.598243:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497692.598268:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598282:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598292:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598303:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598326:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598333:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598416:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598425:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598432:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598635:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598644:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598652:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598660:0:73210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598667:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598673:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598715:0:73210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497692.598734:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598751:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598758:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598764:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497692.598768:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598775:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598785:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff923f85215300) 00010000:00010000:0.0:1777497692.598788:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1777497692.598791:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598797:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dbfd lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598812:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598819:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598825:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598837:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497692.598840:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598847:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598855:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:0.0:1777497692.598858:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497692.598861:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598866:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee200/0x3e357265691dbef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497692.598876:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a1a8cadb reply state 00000000d761f796 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598887:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497692.598893:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215100) 00010000:00010000:0.0:1777497692.598896:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497692.598899:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497692.598983:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+13:71292:x1863837546350464:12345-192.168.202.4@tcp:36:rm.0 Request processed in 952us (3306us total) trans 115964117002 rc 0/0 00000100:00100000:0.0:1777497692.598991:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1386 00010000:00010000:2.0:1777497692.600537:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497692.600561:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.600571:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497692.600575:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.600583:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.600598:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff923f85215300) 00010000:00010000:2.0:1777497692.600601:0:6503:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1777497692.600604:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.600610:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691dc04 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497692.600632:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497692.600634:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497692.600635:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497693.363161:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497694.243657:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497694.243679:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565013120:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497694.243755:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497694.243811:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013120 00000100:00100000:1.0:1777497694.243820:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013120 00000100:00100000:1.0:1777497694.243874:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:1.0:1777497694.243882:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565013120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497694.243921:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497694.243964:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565013120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497694.243971:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000100:00080000:1.0:1777497694.243995:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497694.244032:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565013120:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497694.244598:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565013248:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497694.244632:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497694.244707:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013248 00000100:00100000:2.0:1777497694.244712:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013248 00000100:00100000:2.0:1777497694.244777:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1777497694.244785:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565013248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497694.244804:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497694.244843:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565013248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497694.244849:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1777497694.244885:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565013248:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1777497694.245028:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497694.370878:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497695.401286:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497695.778342:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565013376:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497695.778415:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.778475:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013376 00000100:00100000:1.0:1777497695.778483:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013376 00000100:00100000:1.0:1777497695.778528:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4049 00000100:00100000:1.0:1777497695.778536:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565013376:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497695.778567:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:1.0:1777497695.778605:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565013376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.778612:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4049 00000100:00100000:1.0:1777497695.778656:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565013376:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497695.778837:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497695.778848:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565013504:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497695.778891:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497695.778921:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013504 00000100:00100000:0.0:1777497695.778925:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013504 00000100:00100000:0.0:1777497695.778954:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1777497695.778961:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565013504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497695.778984:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445158912 avail 1298919424 00010000:00000080:0.0:1777497695.778996:0:23359:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b8b480 x1863837565013504/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:451/0 lens 224/368 e 0 to 0 dl 1777497706 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497695.779028:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565013504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497695.779034:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4050 00000100:00100000:0.0:1777497695.779062:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565013504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497695.779336:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565013760:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779363:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779382:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565014272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779401:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779417:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565014784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779435:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779450:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777497695.779464:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565013888:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779487:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779504:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565014400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779522:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779537:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565014912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779556:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497695.779582:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013760 00000100:00100000:1.0:1777497695.779586:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013760 00000100:00100000:1.0:1777497695.779624:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013888 00000100:00100000:1.0:1777497695.779627:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013888 00000100:00100000:1.0:1777497695.779644:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014912 00000100:00100000:1.0:1777497695.779647:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014912 00000100:00100000:1.0:1777497695.779662:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1777497695.779668:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565013760:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497695.779681:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240af503800 x1863837565013760/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:451/0 lens 224/224 e 0 to 0 dl 1777497706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497695.779724:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565013760:12345-0@lo:400:kworker.0 Request processed in 44us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.779730:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:1.0:1777497695.779742:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1777497695.779748:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565013888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779773:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565013888:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.779778:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1777497695.779791:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1777497695.779796:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565014912:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497695.779815:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240af500700 x1863837565014912/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:451/0 lens 224/224 e 0 to 0 dl 1777497706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497695.779839:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565014912:12345-0@lo:400:kworker.0 Request processed in 44us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.779845:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:1.0:1777497695.779862:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014272 00000100:00100000:1.0:1777497695.779865:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014272 00000100:00100000:1.0:1777497695.779886:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014784 00000100:00100000:1.0:1777497695.779889:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014784 00000100:00100000:1.0:1777497695.779908:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014400 00000100:00100000:1.0:1777497695.779911:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014400 00000100:00100000:1.0:1777497695.779928:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1777497695.779933:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565014272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.779964:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565014272:12345-0@lo:400:kworker.0 Request processed in 31us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.779969:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2626 00000100:00100000:1.0:1777497695.779980:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1777497695.779986:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565014784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780010:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565014784:12345-0@lo:400:kworker.0 Request processed in 25us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.780015:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2627 00000100:00100000:1.0:1777497695.780025:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2628 00000100:00100000:1.0:1777497695.780030:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565014400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780052:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565014400:12345-0@lo:400:kworker.0 Request processed in 23us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497695.780057:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2628 00000100:00080000:1.0:1777497695.780092:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497695.780126:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497695.780128:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497695.780172:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565013888:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780182:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565014400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780190:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565014912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780197:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565013760:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780205:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565014272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497695.780213:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565014784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780309:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565014016:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780340:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497695.780356:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565014528:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780375:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497695.780391:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1777497695.780396:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565013632:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780418:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497695.780440:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565014144:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780457:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497695.780473:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565014656:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780492:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497695.780516:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014656 00000100:00100000:2.0:1777497695.780520:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014656 00000100:00100000:2.0:1777497695.780552:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1777497695.780559:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565014656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780591:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565014656:12345-0@lo:400:kworker.0 Request processed in 33us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497695.780597:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2629 00000100:00100000:2.0:1777497695.780616:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014016 00000100:00100000:2.0:1777497695.780620:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014016 00000100:00100000:2.0:1777497695.780642:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014528 00000100:00100000:2.0:1777497695.780644:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014528 00000100:00100000:2.0:1777497695.780658:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565014144 00000100:00100000:2.0:1777497695.780661:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565014144 00000100:00100000:2.0:1777497695.780674:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1777497695.780680:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565014016:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497695.780700:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b3b80 x1863837565014016/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:451/0 lens 224/224 e 0 to 0 dl 1777497706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497695.780751:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565014016:12345-0@lo:400:kworker.0 Request processed in 71us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497695.780758:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:2.0:1777497695.780771:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1777497695.780777:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565014528:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497695.780788:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b3480 x1863837565014528/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:451/0 lens 224/224 e 0 to 0 dl 1777497706 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497695.780813:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565014528:12345-0@lo:400:kworker.0 Request processed in 37us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497695.780818:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1777497695.780828:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:2.0:1777497695.780833:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565014144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780858:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565014144:12345-0@lo:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497695.780863:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00080000:2.0:1777497695.780882:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497695.780885:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497695.780888:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497695.780907:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565014144:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780917:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565014656:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780926:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565014016:0@lo:400:kworker.0 00000100:00100000:2.0:1777497695.780934:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565014528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497695.781027:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565013632 00000100:00100000:0.0:1777497695.781032:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565013632 00000100:00100000:0.0:1777497695.781069:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1777497695.781076:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565013632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497695.781134:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565013632:12345-0@lo:400:kworker.0 Request processed in 58us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497695.781140:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1777497695.781173:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565013632:0@lo:400:kworker.0 00000100:00100000:1.0:1777497696.290832:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565015040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497696.290911:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497696.291481:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015040 00000100:00100000:1.0:1777497696.291489:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015040 00000100:00100000:1.0:1777497696.291539:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:1.0:1777497696.291548:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565015040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497696.291575:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497696.291616:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565015040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497696.291623:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:1.0:1777497696.292198:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565015040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497696.292267:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565015168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497696.292301:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497696.293830:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015168 00000100:00100000:2.0:1777497696.293840:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015168 00000100:00100000:2.0:1777497696.293917:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1777497696.293926:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565015168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497696.293954:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497696.294009:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565015168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497696.294015:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:1.0:1777497696.302170:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565015168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1777497696.418401:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497697.086976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497697.087016:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497697.087043:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497697.087062:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497697.087083:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497697.087128:0:88681:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350592 00000100:00100000:3.0:1777497697.087138:0:88681:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350592 00000100:00100000:3.0:1777497697.087191:0:88681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1777497697.087201:0:88681:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546350592:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497697.087265:0:88681:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae490c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546350592:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 66us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497697.087272:0:88681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1777497697.087305:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350848 00000100:00100000:3.0:1777497697.087309:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350848 00000100:00100000:3.0:1777497697.087348:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350720 00000100:00100000:3.0:1777497697.087351:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350720 00000100:00100000:3.0:1777497697.087374:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1351 00000100:00100000:3.0:1777497697.087381:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546350848:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497697.087412:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546350848:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497697.087419:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1351 00000100:00100000:3.0:1777497697.087431:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1352 00000100:00100000:3.0:1777497697.087451:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+13:2413:x1863837546350720:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:3.0:1777497697.087469:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3adce00 x1863837546350720/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:453/0 lens 224/224 e 0 to 0 dl 1777497708 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497697.087493:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+13:2413:x1863837546350720:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497697.087499:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1352 00000100:00100000:3.0:1777497697.087520:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351104 00000100:00100000:3.0:1777497697.087523:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351104 00000100:00100000:3.0:1777497697.087547:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350976 00000100:00100000:3.0:1777497697.087549:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350976 00000100:00100000:3.0:1777497697.087569:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2630 00000100:00100000:3.0:1777497697.087576:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546351104:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497697.087601:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546351104:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497697.087606:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2630 00000100:00100000:3.0:1777497697.087617:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2631 00000100:00100000:3.0:1777497697.087623:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546350976:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497697.087645:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546350976:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 23us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497697.087651:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2631 00000100:00080000:3.0:1777497697.087798:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497697.087802:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497697.087805:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497697.087807:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1777497697.444145:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497698.471122:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1777497698.853562:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00080000:2.0:1777497698.867408:0:88674:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:2.0:1777497698.867437:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867449:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867457:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867464:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497698.867468:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867477:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867509:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215100) 00010000:00010000:2.0:1777497698.867512:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497698.867517:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867523:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef000/0x3e357265691dbbe lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867540:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867545:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867551:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867556:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497698.867559:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867564:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867571:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215100) 00010000:00010000:2.0:1777497698.867573:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497698.867575:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497698.867580:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee800/0x3e357265691dbf6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1777497698.965941:0:89852:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000 00000100:00100000:1.0:1777497699.065300:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497699.068917:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351232 00000100:00100000:2.0:1777497699.068935:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351232 00000100:00100000:2.0:1777497699.069122:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1387 00000100:00100000:2.0:1777497699.069134:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:71360:x1863837546351232:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497699.069168:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497699.069197:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691dc0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c408 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069275:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069289:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069302:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497699.069350:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497699.069354:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497699.069390:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069414:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff000/0x3e357265691dc0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c408 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069431:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c408 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.069440:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff924093ca0500) 00010000:00010000:2.0:1777497699.069454:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497699.069458:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ffe00, rc 0) 00010000:00000080:2.0:1777497699.069466:0:64885:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240af502a00 x1863837546351232/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:455/0 lens 576/688 e 0 to 0 dl 1777497710 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497699.069543:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:71360:x1863837546351232:12345-192.168.202.4@tcp:101:touch.0 Request processed in 414us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497699.069550:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1387 00000100:00080000:0.0:1777497699.073617:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497699.077819:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.077921:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351360 00000100:00100000:0.0:1777497699.077931:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351360 00000100:00100000:0.0:1777497699.077993:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1388 00000100:00100000:0.0:1777497699.078003:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:71360:x1863837546351360:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497699.078049:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497699.078070:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dc19 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c40f expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078184:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078198:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078209:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078224:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078231:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078237:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078291:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078299:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078305:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497699.078333:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078354:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078360:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078367:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078373:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078378:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497699.078382:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078388:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078399:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680000) 00010000:00010000:0.0:1777497699.078404:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497699.078408:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078414:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee600/0x3e357265691dc20 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078426:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078431:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078443:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078448:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497699.078450:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078455:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078462:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff924091207700) 00010000:00010000:0.0:1777497699.078464:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497699.078466:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078471:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef200/0x3e357265691dc27 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078501:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eee400/0x3e357265691dc19 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c40f expref: 12 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078513:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c40f expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.078520:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff92408cba5700) 00010000:00010000:0.0:1777497699.078522:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1777497699.078524:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefe00, rc 0) 00010000:00000080:0.0:1777497699.078532:0:63729:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3adc380 x1863837546351360/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:455/0 lens 576/584 e 0 to 0 dl 1777497710 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497699.078601:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+11:71360:x1863837546351360:12345-192.168.202.4@tcp:101:touch.0 Request processed in 600us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.078609:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1388 00000100:00100000:0.0:1777497699.089929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.089969:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.089998:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351616 00000100:00100000:0.0:1777497699.090007:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351616 00000100:00100000:0.0:1777497699.090073:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 724 00000100:00100000:0.0:1777497699.090084:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546351616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497699.090121:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497699.090155:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eefe00/0x3e357265691dc2e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c40f expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.090172:0:19127:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff92408cba5700) 00010000:00010000:0.0:1777497699.090177:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497699.090227:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d146155b-4321-4b14-9284-f644ed9631fb+10:2413:x1863837546351616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.090234:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 724 00000100:00100000:3.0:1777497699.091268:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351488 00000100:00100000:3.0:1777497699.091282:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351488 00000100:00100000:3.0:1777497699.091337:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1389 00000100:00100000:3.0:1777497699.091345:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:71360:x1863837546351488:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497699.091364:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497699.091385:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691dc35 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c416 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.091448:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691dc3c lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.091462:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691dc3c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.091474:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691dc3c lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497699.091520:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:3.0:1777497699.091524:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777497699.091573:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691dc35 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c416 expref: 7 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.091589:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5a600/0x3e357265691dc3c lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c416 expref: 6 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.091596:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff923f847c8b00) 00010000:00010000:3.0:1777497699.091599:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1777497699.091602:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a600, rc 0) 00000100:00100000:3.0:1777497699.091651:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:71360:x1863837546351488:12345-192.168.202.4@tcp:101:touch.0 Request processed in 307us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497699.091658:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1389 00000100:00080000:0.0:1777497699.092298:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497699.099582:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497699.099655:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546351872 00000100:00100000:3.0:1777497699.099666:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546351872 00000100:00100000:3.0:1777497699.099736:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1390 00000100:00100000:3.0:1777497699.099747:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:71360:x1863837546351872:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497699.099769:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497699.099791:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691dc43 lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c41d expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099900:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099915:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099927:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099941:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099948:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.099954:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497699.100389:0:64885:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565015296:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1777497699.100445:0:64885:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497699.100479:0:64885:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497699.100523:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015296 00000100:00100000:2.0:1777497699.100528:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015296 00000100:00100000:2.0:1777497699.100567:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1777497699.100574:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:64885:x1863837565015296:12345-0@lo:1000:mdt00_003.0 00010000:00000080:2.0:1777497699.100609:0:8407:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3adc000 x1863837565015296/t0(0) o1000->lustre-MDT0001-mdtlov_UUID@0@lo:455/0 lens 328/4320 e 0 to 0 dl 1777497710 ref 1 fl Interpret:/200/0 rc 0/0 job:'mdt00_003.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497699.100655:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:64885:x1863837565015296:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497699.100663:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4051 00000100:00100000:2.0:1777497699.100719:0:64885:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-mdtlov_UUID:64885:1863837565015296:0@lo:1000:mdt00_003.0 00000004:00080000:2.0:1777497699.100988:0:64885:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x2c0000400:0x491:0x0], count =401 00000004:00080000:2.0:1777497699.100996:0:64885:0:(osp_object.c:1640:osp_create()) Writing gap [0x2c0000400:0x491:0x0]+401 in llog 00000004:00080000:2.0:1777497699.101006:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x622:0x0], index 1: 0 00010000:00010000:2.0:1777497699.101416:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691dc58 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101431:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691dc58 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101441:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691dc58 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101489:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101496:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101502:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101508:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101513:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497699.101518:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101524:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101536:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff923f847c8b00) 00010000:00010000:2.0:1777497699.101539:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497699.101544:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101549:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5be00/0x3e357265691dc4a lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497699.101563:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000080c312cb reply state 0000000036a86c33 transno 81604378763 ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101573:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101586:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff923f847c8a00) 00010000:00010000:2.0:1777497699.101589:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497699.101591:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497699.101627:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5b600/0x3e357265691dc43 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c41d expref: 9 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101640:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691dc58 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c41d expref: 8 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497699.101647:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497699.101649:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497699.101651:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff000, rc 0) 00000100:00100000:2.0:1777497699.101764:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:71360:x1863837546351872:12345-192.168.202.4@tcp:101:touch.0 Request processed in 2018us (2189us total) trans 81604378763 rc 0/0 00000100:00100000:2.0:1777497699.101771:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1390 00000100:00100000:1.0:1777497699.110086:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.111129:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352128 00000100:00100000:0.0:1777497699.111799:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352128 00000100:00100000:0.0:1777497699.111869:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1391 00000100:00100000:0.0:1777497699.111879:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:71360:x1863837546352128:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497699.111957:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497699.111986:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7ff000/0x3e357265691dc58 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c41d expref: 9 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.112018:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924090680f00) 00010000:00010000:0.0:1777497699.112029:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497699.112841:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.112862:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.112872:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497699.112988:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000f80002f3 reply state 000000007394a1b1 transno 81604378764 ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.113000:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.113007:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924091207700) 00010000:00010000:0.0:1777497699.113009:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497699.113013:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497699.114856:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:71360:x1863837546352128:12345-192.168.202.4@tcp:36:touch.0 Request processed in 2967us (4771us total) trans 81604378764 rc 0/0 00000100:00100000:0.0:1777497699.114866:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1391 00000100:00100000:0.0:1777497699.119056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497699.119473:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352256 00000100:00100000:3.0:1777497699.119484:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352256 00000100:00100000:3.0:1777497699.119698:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1392 00000100:00100000:3.0:1777497699.119708:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+10:71360:x1863837546352256:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497699.119731:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497699.119750:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691dc6d lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c424 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.119806:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691dc6d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c424 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.119821:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5bc00/0x3e357265691dc6d lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c424 expref: 11 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.119837:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924091207700) 00010000:00010000:3.0:1777497699.119840:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1777497699.119844:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5bc00, rc 0) 00000100:00100000:3.0:1777497699.119896:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:71360:x1863837546352256:12345-192.168.202.4@tcp:101:touch.0 Request processed in 190us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497699.119903:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1392 00000100:00100000:1.0:1777497699.134905:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.135024:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352384 00000100:00100000:0.0:1777497699.135035:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352384 00000100:00080000:1.0:1777497699.135325:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497699.135361:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5892 00000100:00100000:0.0:1777497699.135374:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546352384:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497699.135756:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546352384:12345-192.168.202.4@tcp:2:touch.0 Request processed in 384us (861us total) trans 4294969453 rc 0/0 00000100:00100000:0.0:1777497699.135765:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5892 00000100:00100000:2.0:1777497699.147057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497699.147130:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352640 00000100:00100000:2.0:1777497699.147739:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352640 00000100:00100000:2.0:1777497699.147808:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 245 00000100:00100000:2.0:1777497699.147818:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:71360:x1863837546352640:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497699.148125:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+12:71360:x1863837546352640:12345-192.168.202.4@tcp:35:touch.0 Request processed in 307us (1076us total) trans 81604378765 rc 0/0 00000100:00100000:2.0:1777497699.148134:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 245 00000100:00100000:1.0:1777497699.200549:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497699.200825:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352768 00000100:00100000:3.0:1777497699.200835:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352768 00000100:00100000:3.0:1777497699.200901:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1393 00000100:00100000:3.0:1777497699.200911:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:71361:x1863837546352768:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497699.200931:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497699.200951:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691dc74 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c42b expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201020:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201044:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201057:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201072:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201078:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201084:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201221:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201229:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201235:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497699.201256:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201268:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201274:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201289:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201294:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201300:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497699.201304:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201311:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201323:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff924090680000) 00010000:00010000:3.0:1777497699.201326:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497699.201331:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201337:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b600/0x3e357265691dc7b lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201349:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201354:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201360:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201366:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497699.201375:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201381:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201389:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff923f847c8700) 00010000:00010000:3.0:1777497699.201391:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497699.201394:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201400:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5be00/0x3e357265691dc82 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201433:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b000/0x3e357265691dc74 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c42b expref: 12 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201445:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c42b expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.201452:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff92408cba5400) 00010000:00010000:3.0:1777497699.201454:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497699.201456:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ba00, rc 0) 00010000:00000080:3.0:1777497699.201464:0:63728:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240af501500 x1863837546352768/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:455/0 lens 576/584 e 0 to 0 dl 1777497710 ref 1 fl Interpret:/600/0 rc 0/0 job:'touch.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497699.201538:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:71361:x1863837546352768:12345-192.168.202.4@tcp:101:touch.0 Request processed in 629us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497699.201546:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1393 00000100:00100000:0.0:1777497699.206774:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.206813:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546352896 00000100:00100000:0.0:1777497699.206822:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546352896 00000100:00100000:0.0:1777497699.206873:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1394 00000100:00100000:0.0:1777497699.206883:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+12:71361:x1863837546352896:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497699.206905:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497699.206928:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef200/0x3e357265691dc90 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c432 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.206987:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eee600/0x3e357265691dc97 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.207000:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eee600/0x3e357265691dc97 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.207012:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eee600/0x3e357265691dc97 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497699.207057:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1777497699.207061:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1777497699.207121:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef200/0x3e357265691dc90 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c432 expref: 14 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.207137:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eee600/0x3e357265691dc97 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c432 expref: 13 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497699.207803:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:0.0:1777497699.208448:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924091207400) 00010000:00010000:0.0:1777497699.208451:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1777497699.208455:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee600, rc 0) 00000100:00100000:0.0:1777497699.208515:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+13:71361:x1863837546352896:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1633us (1749us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.208523:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1394 00000100:00100000:0.0:1777497699.208562:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546353024 00000100:00100000:0.0:1777497699.208568:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546353024 00000100:00100000:0.0:1777497699.208607:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 725 00000100:00100000:0.0:1777497699.208615:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546353024:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497699.208626:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497699.208644:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5ba00/0x3e357265691dc89 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c42b expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.208658:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff92408cba5400) 00010000:00010000:0.0:1777497699.208662:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497699.208694:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d146155b-4321-4b14-9284-f644ed9631fb+10:2412:x1863837546353024:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 80us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.208701:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 725 00000100:00100000:0.0:1777497699.212716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497699.212801:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546353280 00000100:00100000:3.0:1777497699.212812:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546353280 00000100:00100000:3.0:1777497699.212898:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1395 00000100:00100000:3.0:1777497699.212909:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+13:71361:x1863837546353280:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497699.212931:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497699.212951:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691dc9e lrc: 2/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c439 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213059:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 3/0,1 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213073:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213085:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 3/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213404:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213414:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213420:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497699.213757:0:65418:0:(osp_object.c:1657:osp_create()) lustre-OST0001-osc-MDT0001: Wrote last used FID: [0x2c0000400:0x623:0x0], index 1: 0 00010000:00010000:3.0:1777497699.213901:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150b200/0x3e357265691dcb3 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213911:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150b200/0x3e357265691dcb3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213926:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92408150b200/0x3e357265691dcb3 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213963:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213971:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 4/0,1 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213976:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 3/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213982:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213988:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497699.213992:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 4/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.213999:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 5/0,0 mode: CW/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214011:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924091207400) 00010000:00010000:3.0:1777497699.214014:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497699.214017:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 3/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214024:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dca5 lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497699.214038:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1bb875e reply state 00000000363ff33d transno 81604378766 ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214055:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214061:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff923f847c8700) 00010000:00010000:3.0:1777497699.214063:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497699.214066:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777497699.214377:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ac00/0x3e357265691dc9e lrc: 0/0,0 mode: --/CW res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c439 expref: 16 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214394:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150b200/0x3e357265691dcb3 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c439 expref: 15 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.214402:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8e00) 00010000:00010000:3.0:1777497699.214405:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497699.214407:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b200, rc 0) 00000100:00100000:3.0:1777497699.214514:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+16:71361:x1863837546353280:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1607us (1808us total) trans 81604378766 rc 0/0 00000100:00100000:3.0:1777497699.214523:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1395 00000100:00100000:2.0:1777497699.220257:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497699.220384:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546353536 00000100:00100000:3.0:1777497699.220393:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546353536 00000100:00100000:3.0:1777497699.220432:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1396 00000100:00100000:3.0:1777497699.220439:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+16:71361:x1863837546353536:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497699.220488:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497699.220508:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92408150b200/0x3e357265691dcb3 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c439 expref: 16 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.220588:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8e00) 00010000:00010000:3.0:1777497699.220608:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497699.220656:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: --/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.220669:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.220695:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497699.220792:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000095437fa reply state 00000000382fe227 transno 81604378767 ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: PW/PW res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.220801:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497699.220806:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8100) 00010000:00010000:3.0:1777497699.220807:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497699.220809:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497699.220890:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+17:71361:x1863837546353536:12345-192.168.202.4@tcp:36:touch.0 Request processed in 451us (641us total) trans 81604378767 rc 0/0 00000100:00100000:3.0:1777497699.220895:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1396 00000100:00100000:1.0:1777497699.225824:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.225999:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546353664 00000100:00100000:0.0:1777497699.226009:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546353664 00000100:00100000:0.0:1777497699.226067:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1397 00000100:00100000:0.0:1777497699.226075:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+17:71361:x1863837546353664:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497699.226117:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497699.226320:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef000/0x3e357265691dcc8 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c440 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.226370:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef000/0x3e357265691dcc8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c440 expref: 18 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.226380:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef000/0x3e357265691dcc8 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c440 expref: 18 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497699.226393:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8100) 00010000:00010000:0.0:1777497699.226396:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497699.226398:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef000, rc 0) 00000100:00100000:0.0:1777497699.226445:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+18:71361:x1863837546353664:12345-192.168.202.4@tcp:101:touch.0 Request processed in 371us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.226450:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1397 00000100:00100000:0.0:1777497699.235704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497699.235899:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546353792 00000100:00100000:2.0:1777497699.235911:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546353792 00000100:00100000:2.0:1777497699.236048:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5893 00000100:00100000:2.0:1777497699.236058:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546353792:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1777497699.236311:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546353792:12345-192.168.202.4@tcp:2:touch.0 Request processed in 254us (619us total) trans 4294969454 rc 0/0 00000100:00100000:2.0:1777497699.236320:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5893 00000100:00100000:2.0:1777497699.244058:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497699.244345:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354048 00000100:00100000:0.0:1777497699.244356:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354048 00000100:00100000:0.0:1777497699.244416:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:0.0:1777497699.244427:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+18:71361:x1863837546354048:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1777497699.244753:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+19:71361:x1863837546354048:12345-192.168.202.4@tcp:35:touch.0 Request processed in 327us (714us total) trans 81604378768 rc 0/0 00000100:00100000:0.0:1777497699.244761:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 246 00000100:00100000:3.0:1777497699.362412:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497699.362436:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565015424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497699.362504:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497699.362615:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015424 00000100:00100000:0.0:1777497699.362623:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015424 00000100:00100000:0.0:1777497699.362714:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1777497699.362725:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565015424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497699.362768:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497699.362817:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565015424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497699.362823:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1777497699.362867:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565015424:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497699.363217:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497699.364640:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497699.364657:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565015552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497699.364725:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497699.364971:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015552 00000100:00100000:2.0:1777497699.364979:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015552 00000100:00100000:2.0:1777497699.365053:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:2.0:1777497699.365061:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565015552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497699.365089:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497699.365160:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565015552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497699.365166:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1777497699.365329:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565015552:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497699.365700:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497699.493779:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497700.514288:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497700.898458:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565015808:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898524:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898554:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565016320:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898580:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898597:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565016832:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898628:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898654:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1777497700.898659:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565015680:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898694:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898718:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565016192:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898736:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898750:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565016704:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898769:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898782:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565017216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898799:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898834:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565015936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898855:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898871:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565016448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898890:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898904:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565016960:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898920:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898936:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1777497700.898941:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565016064:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898959:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.898977:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565016576:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.898996:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.899010:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565017088:0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899026:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497700.899057:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015808 00000100:00100000:1.0:1777497700.899064:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015808 00000100:00100000:1.0:1777497700.899133:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016192 00000100:00100000:1.0:1777497700.899137:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016192 00000100:00100000:1.0:1777497700.899152:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016704 00000100:00100000:1.0:1777497700.899154:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016704 00000100:00100000:1.0:1777497700.899163:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017216 00000100:00100000:1.0:1777497700.899165:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017216 00000100:00100000:1.0:1777497700.899173:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015936 00000100:00100000:1.0:1777497700.899175:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015936 00000100:00100000:1.0:1777497700.899185:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016064 00000100:00100000:1.0:1777497700.899187:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016064 00000100:00100000:1.0:1777497700.899200:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1777497700.899207:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565015808:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497700.899230:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c182680 x1863837565015808/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497700.899277:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565015808:12345-0@lo:400:kworker.0 Request processed in 70us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899284:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:1.0:1777497700.899303:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1777497700.899310:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899337:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565016192:12345-0@lo:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899343:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1777497700.899354:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1777497700.899359:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565016704:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497700.899369:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82f47b80 x1863837565016704/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497700.899396:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565016704:12345-0@lo:400:kworker.0 Request processed in 37us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899401:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:1.0:1777497700.899412:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1777497700.899417:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565017216:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497700.899426:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82f47100 x1863837565017216/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497700.899450:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565017216:12345-0@lo:400:kworker.0 Request processed in 34us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899456:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:1.0:1777497700.899467:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1777497700.899472:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565015936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899509:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565015936:12345-0@lo:400:kworker.0 Request processed in 37us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899515:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1777497700.899527:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1777497700.899533:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565016064:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497700.899542:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82f46d80 x1863837565016064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497700.899564:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565016064:12345-0@lo:400:kworker.0 Request processed in 33us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899570:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1777497700.899591:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016320 00000100:00100000:1.0:1777497700.899595:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016320 00000100:00100000:1.0:1777497700.899616:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016832 00000100:00100000:1.0:1777497700.899619:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016832 00000100:00100000:1.0:1777497700.899634:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4052 00000100:00100000:1.0:1777497700.899639:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565016320:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497700.899651:0:23359:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c182a00 x1863837565016320/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:456/0 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497700.899688:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565016320:12345-0@lo:400:kworker.0 Request processed in 49us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899694:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4052 00000100:00100000:1.0:1777497700.899704:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1777497700.899709:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565016832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899731:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565016832:12345-0@lo:400:kworker.0 Request processed in 23us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899747:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4053 00000100:00100000:1.0:1777497700.899769:0:88679:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565015680 00000100:00100000:1.0:1777497700.899772:0:88679:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565015680 00000100:00100000:1.0:1777497700.899793:0:88679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1777497700.899798:0:88679:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565015680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899824:0:88679:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240ae493050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565015680:12345-0@lo:400:kworker.0 Request processed in 26us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899829:0:88679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1777497700.899865:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016448 00000100:00100000:1.0:1777497700.899868:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016448 00000100:00100000:1.0:1777497700.899891:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016960 00000100:00100000:1.0:1777497700.899893:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016960 00000100:00100000:1.0:1777497700.899909:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565016576 00000100:00100000:1.0:1777497700.899911:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565016576 00000100:00100000:1.0:1777497700.899925:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017088 00000100:00100000:1.0:1777497700.899927:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017088 00000100:00100000:1.0:1777497700.899946:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1777497700.899952:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565016448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.899979:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565016448:12345-0@lo:400:kworker.0 Request processed in 27us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.899984:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2632 00000100:00100000:1.0:1777497700.899995:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1777497700.900000:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565016960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.900023:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565016960:12345-0@lo:400:kworker.0 Request processed in 24us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.900028:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2633 00000100:00100000:1.0:1777497700.900038:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2634 00000100:00100000:1.0:1777497700.900050:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.900077:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565016576:12345-0@lo:400:kworker.0 Request processed in 28us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.900081:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2634 00000100:00100000:2.0:1777497700.900556:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497700.900570:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565017344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497700.900609:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497700.900654:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017344 00000100:00100000:2.0:1777497700.900658:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017344 00000100:00100000:1.0:1777497700.901005:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2635 00000100:00100000:1.0:1777497700.901028:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565017088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497700.901065:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565017088:12345-0@lo:400:kworker.0 Request processed in 52us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497700.901071:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2635 00000100:00100000:2.0:1777497700.901213:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1777497700.901221:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565017344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497700.901247:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497700.901283:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565017344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497700.901289:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4054 00000100:00100000:2.0:1777497700.901421:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565017344:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1777497700.901473:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497700.901478:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497700.901482:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497700.901484:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497700.901510:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565017472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497700.901535:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497700.901574:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af59bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565016064:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901587:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565016576:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901597:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565017088:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901609:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565015936:0@lo:400:kworker.0 00000100:00100000:3.0:1777497700.901743:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017472 00000100:00100000:3.0:1777497700.901748:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017472 00000100:00100000:3.0:1777497700.901776:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4055 00000100:00100000:3.0:1777497700.901782:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565017472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497700.901802:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445158912 avail 1298919424 00010000:00000080:3.0:1777497700.901820:0:80394:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b0e00 x1863837565017472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:456/0 lens 224/368 e 0 to 0 dl 1777497711 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497700.901849:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565017472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497700.901855:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4055 00000100:00100000:2.0:1777497700.901910:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565016448:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901925:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565016960:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901958:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5692300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565017472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497700.901982:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565015680:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.901992:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af599500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565016192:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.902002:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565016704:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.902011:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565017216:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.902030:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565015808:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.902040:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565016320:0@lo:400:kworker.0 00000100:00100000:2.0:1777497700.902060:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565016832:0@lo:400:kworker.0 00000020:01000004:3.0:1777497701.318055:0:89949:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1777497701.318138:0:89949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.318301:0:89949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.318313:0:89949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.318320:0:89949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.318343:0:89949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1777497701.318349:0:89949:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1777497701.318374:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777497701.318378:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1777497701.318383:0:89949:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1777497701.318408:0:89949:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1777497701.318462:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497701.318469:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318477:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497701.318481:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318490:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497701.318497:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497701.318503:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497701.318506:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1777497701.318508:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1777497701.318535:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318565:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497701.318594:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318601:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691d9cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9d4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318613:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.318615:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.318616:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497701.318625:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497701.318645:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565017728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497701.318721:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497701.318776:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017728 00000100:00100000:1.0:1777497701.318784:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017728 00000100:00100000:1.0:1777497701.318832:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1777497701.318843:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565017728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497701.318857:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497701.318872:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a200/0x3e357265691d9d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d9cd expref: 23 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.318885:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497701.318922:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3659:x1863837565017728:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497701.318929:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:1.0:1777497701.318969:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565017728:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497701.319301:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565017600:0@lo:39:umount.0 00000100:00100000:0.0:1777497701.319340:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497701.319410:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017600 00000100:00100000:1.0:1777497701.319423:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017600 00000100:00100000:1.0:1777497701.319460:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:1.0:1777497701.319467:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837565017600:12345-0@lo:39:umount.0 00000020:00000080:1.0:1777497701.319491:0:73210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d638 00000100:00080000:1.0:1777497701.319506:0:73210:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6f800 : changing import state from FULL to CLOSED 00010000:00000080:1.0:1777497701.319540:0:73210:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5692300 x1863837565017600/t0(0) o39->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:457/0 lens 224/224 e 0 to 0 dl 1777497712 ref 1 fl Interpret:/200/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497701.319575:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+1:3656:x1863837565017600:12345-0@lo:39:umount.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497701.319581:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000020:00000080:1.0:1777497701.319588:0:73210:0:(genops.c:906:class_export_put()) final put ffff9240bcc69800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1777497701.319637:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcc69800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497701.319707:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc6f800 for lustre-MDT0000 00000100:00080000:1.0:1777497701.319735:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1777497701.319744:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565017600:0@lo:39:umount.0 00010000:00010000:3.0:1777497701.320316:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497701.320329:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1777497701.320332:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1777497701.320336:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1777497701.322215:0:89949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322246:0:89949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322254:0:89949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322261:0:89949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322282:0:89949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497701.322289:0:89949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322296:0:89949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322302:0:89949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322309:0:89949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322321:0:89949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497701.322328:0:89949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322335:0:89949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322350:0:89949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322356:0:89949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322370:0:89949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1777497701.322375:0:89949:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322382:0:89949:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322388:0:89949:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322395:0:89949:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497701.322404:0:89949:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1777497701.322407:0:89949:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1777497701.322437:0:89949:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1777497701.322442:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='FA') 00000020:00000080:3.0:1777497701.322446:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:3.0:1777497701.322451:0:89949:0:(obd_config.c:932:class_cleanup()) Failing over lustre-MDT0000 00010000:00010000:1.0:1777497701.322867:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1777497701.322875:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.322882:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497701.322885:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.322894:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497701.322901:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497701.322919:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497701.322922:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1777497701.322924:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:1.0:1777497701.322959:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.322966:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497701.322987:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.322994:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef800/0x3e357265691d9db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d9e2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323008:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497701.323011:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323017:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497701.323019:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323025:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497701.323031:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497701.323036:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497701.323038:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1777497701.323040:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1777497701.323060:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323065:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497701.323071:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323077:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd9200/0x3e357265691d53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d543 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323085:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497701.323088:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323114:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497701.323117:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323124:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497701.323130:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497701.323136:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1777497701.323138:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1777497701.323140:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1777497701.323152:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323170:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497701.323186:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323198:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902b400/0x3e357265691d50b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d512 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323208:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497701.323212:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323217:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497701.323220:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323226:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497701.323231:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497701.323237:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497701.323239:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1777497701.323241:0:83956:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1777497701.323252:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323258:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497701.323263:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323269:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89735000/0x3e357265691d424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691d432 expref: -99 pid: 88673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323288:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.323290:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.323291:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497701.323312:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565018240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497701.323374:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497701.323424:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497701.323430:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565018112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497701.323450:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497701.323480:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565018240 00000100:00100000:1.0:1777497701.323486:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565018240 00000100:00100000:1.0:1777497701.323527:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565018112 00000100:00100000:1.0:1777497701.323530:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565018112 00000100:00100000:1.0:1777497701.323552:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1777497701.323559:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837565018240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497701.323570:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497701.323584:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902ae00/0x3e357265691d432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d424 expref: 23 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323596:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497701.323627:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3660:x1863837565018240:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497701.323634:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:1.0:1777497701.323650:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1777497701.323655:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3660:x1863837565018112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497701.323676:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497701.323684:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734400/0x3e357265691d512 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d50b expref: 21 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.323698:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497701.323720:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565018112:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497701.323726:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00100000:1.0:1777497701.323769:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565018112:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497701.323777:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565018240:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497701.329965:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:3.0:1777497701.330761:0:89949:0:(mdt_handler.c:8168:mdt_iocontrol()) lustre-MDT0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00000020:00000080:3.0:1777497701.330977:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 5/11 00000020:00080000:3.0:1777497701.330988:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f88a89800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497701.330995:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f81a04800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497701.331012:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff9240a3af8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497701.331018:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f8dd19800 d146155b-4321-4b14-9284-f644ed9631fb 192.168.202.4@tcp 9 (0 0 4) 0 0 0 0: 0000000000000000 115964117002 stale:0 00000020:00080000:3.0:1777497701.331022:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff923f8dd1c800 lustre-MDT0001-mdtlov_UUID 0@lo 6 (0 0 1) 0 0 0 0: 0000000000000000 115964117000 stale:0 00000020:00080000:3.0:1777497701.331027:0:89949:0:(genops.c:1574:class_disconnect_exports()) OBD device 6 (ffff9240a6bf3380) has exports, disconnecting them 00000020:00080000:3.0:1777497701.331032:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f88a89800), last request at 1777497670 00000020:00000080:3.0:1777497701.331039:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d631 00000100:00080000:3.0:1777497701.331047:0:89949:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497701.331077:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f88a89800): rc 0 00000020:00000080:3.0:1777497701.331080:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f88a89800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1777497701.331126:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f81a04800), last request at 1777497700 00000020:00000080:3.0:1777497701.331130:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d62a 00000100:00080000:3.0:1777497701.331134:0:89949:0:(import.c:65:import_set_state_nolock()) ffff923f81a04000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497701.331143:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f81a04800): rc 0 00000020:00000080:3.0:1777497701.331145:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f81a04800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1777497701.331148:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9240a3af8800), last request at 1777497700 00000020:00000080:3.0:1777497701.331151:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d623 00010000:00010000:0.0:1777497701.331251:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497701.331416:0:89949:0:(import.c:65:import_set_state_nolock()) ffff92408a0a0800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497701.331434:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240a3af8800): rc 0 00000020:00000080:3.0:1777497701.331436:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240a3af8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1777497701.331442:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.202.4@tcp (ffff923f8dd19800), last request at 1777497699 00000020:00000080:3.0:1777497701.331451:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d48d 00000020:00010000:3.0:1777497701.331463:0:89949:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f8dd19800: total 3 00000100:00080000:3.0:1777497701.331467:0:89949:0:(import.c:65:import_set_state_nolock()) ffff923f81a02000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497701.331504:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff923f8dd19800): rc 0 00000020:00080000:3.0:1777497701.331509:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff923f8dd1c800), last request at 1777497665 00000020:00000080:3.0:1777497701.331512:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d486 00000020:00010000:3.0:1777497701.331524:0:89949:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f8dd1c800: total 3 00000100:00080000:3.0:1777497701.331528:0:89949:0:(import.c:65:import_set_state_nolock()) ffff9240bcc6c000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1777497701.331534:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f8dd1c800): rc 0 00000004:00000080:3.0:1777497701.331540:0:89949:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb9ef01c77ae0 00000100:00080000:3.0:1777497701.331559:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497701.331562:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000020:00000080:1.0:1777497701.332383:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a89800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497701.332448:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a04800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497701.332469:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1777497701.332486:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc6e800 for lustre-MDT0000 00000020:00000080:1.0:1777497701.332491:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81a04000 for lustre-MDT0000 00000020:00000080:1.0:1777497701.332494:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92408a0a0800 for lustre-MDT0000 00000020:00010000:1.0:1777497701.332507:0:83956:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f8dd19800: total 0 00010000:00010000:1.0:1777497701.332556:0:83956:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f8dd19800, canceled 0 locks, left on hash table 4. 00010000:00010000:1.0:1777497701.332593:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5b200/0x3e357265691db86 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3e5 expref: 5 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.332621:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240baa5a400/0x3e357265691db47 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3d0 expref: 4 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.332638:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fec00/0x3e357265691db2b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c3c9 expref: 3 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.332654:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffe00/0x3e357265691dc12 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c408 expref: 2 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497701.332693:0:83956:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f8dd19800, canceled 4 locks, left on hash table 0. 00000020:00010000:0.0:1777497701.334301:0:16604:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f8dd1c800: total 0 00010000:00010000:0.0:1777497701.334371:0:16604:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f8dd1c800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1777497701.334405:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691d654 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d64d expref: 2 pid: 8406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497701.334448:0:16604:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f8dd1c800, canceled 1 locks, left on hash table 0. 00000100:00080000:3.0:1777497701.336463:0:89949:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1777497701.336505:0:89949:0:(import.c:65:import_set_state_nolock()) ffff923f81b71800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1777497701.351086:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.351117:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497701.351138:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565017856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497701.351211:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497701.351261:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497701.351267:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565017984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497701.351288:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497701.357889:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1777497701.357897:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 3 00000004:00080000:3.0:1777497701.359849:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777497701.359915:0:89949:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1777497701.359953:0:89949:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1777497701.359970:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1777497701.359973:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 3 00000004:00080000:3.0:1777497701.359992:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00080000:3.0:1777497701.360049:0:89949:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1777497701.360057:0:89949:0:(import.c:65:import_set_state_nolock()) ffff923f86084000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1777497701.360124:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a6bf3380) has no exports 00000020:00080000:3.0:1777497701.360415:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff9240a6bf3380) has no exports 00000100:00100000:2.0:1777497701.370028:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:0:1863837565018752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497701.373453:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:0:1863837565018880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497701.373510:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017856 00000100:00100000:2.0:1777497701.373517:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017856 00000100:00100000:2.0:1777497701.373568:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565017984 00000100:00100000:2.0:1777497701.373571:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565017984 00000100:00100000:2.0:1777497701.373593:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1777497701.373601:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3657:x1863837565017856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497701.373614:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497701.373632:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896cae00/0x3e357265691d9e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d9db expref: 21 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.373647:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497701.373724:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3657:x1863837565017856:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (22512us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497701.373731:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:2.0:1777497701.373780:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1777497701.373786:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3657:x1863837565017984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497701.373808:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497701.373817:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89735600/0x3e357265691d543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d53c expref: 19 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.373827:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497701.373849:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3657:x1863837565017984:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (22559us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497701.373855:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1777497701.373886:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565017984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497701.373894:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565017856:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497701.373916:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018368:0@lo:39:umount.0 00000100:00100000:2.0:1777497701.373949:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497701.373973:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018496:0@lo:9:umount.0 00000100:00100000:2.0:1777497701.373993:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497701.374010:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018624:0@lo:9:umount.0 00000100:00100000:2.0:1777497701.374029:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497701.374056:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565018368 00000100:00100000:2.0:1777497701.374059:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565018368 00000100:00100000:2.0:1777497701.374117:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1777497701.374124:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565018368:12345-0@lo:39:umount.0 00000020:00000080:2.0:1777497701.374148:0:8407:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4be 00000100:00080000:2.0:1777497701.374239:0:8407:0:(import.c:65:import_set_state_nolock()) ffff923f839d0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497701.374259:0:8407:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 19, last_transno is 81604378768 00000100:00100000:2.0:1777497701.374396:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+3:3656:x1863837565018368:12345-0@lo:39:umount.0 Request processed in 272us (446us total) trans 81604378769 rc 0/0 00000100:00100000:2.0:1777497701.374414:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4056 00000100:00100000:2.0:1777497701.374433:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565018496 00000100:00100000:2.0:1777497701.374437:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565018496 00000100:00100000:2.0:1777497701.374459:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565018624 00000100:00100000:2.0:1777497701.374462:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565018624 00000100:00100000:2.0:1777497701.374480:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5894 00000100:00100000:2.0:1777497701.374486:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565018496:12345-0@lo:9:umount.0 00000020:00000080:2.0:1777497701.374501:0:25491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4e8 00000100:00080000:2.0:1777497701.374507:0:25491:0:(import.c:65:import_set_state_nolock()) ffff923f82ab6000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497701.374541:0:25491:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969458 00000100:00100000:2.0:1777497701.374625:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837565018496:12345-0@lo:9:umount.0 Request processed in 139us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497701.374631:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5894 00000100:00100000:2.0:1777497701.374642:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5895 00000100:00100000:2.0:1777497701.374648:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565018624:12345-0@lo:9:umount.0 00000020:00000080:2.0:1777497701.374670:0:25491:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4f6 00000100:00080000:2.0:1777497701.374677:0:25491:0:(import.c:65:import_set_state_nolock()) ffff923f88a8f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497701.374692:0:25491:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:2.0:1777497701.374756:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+2:3656:x1863837565018624:12345-0@lo:9:umount.0 Request processed in 108us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497701.374763:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5895 00010000:00010000:2.0:1777497701.374779:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.374787:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497701.374809:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81b71800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497701.374816:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018368:0@lo:39:umount.0 00000100:00080000:2.0:1777497701.374826:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497701.374841:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497701.374842:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497701.374845:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018496:0@lo:9:umount.0 00000100:00080000:2.0:1777497701.374857:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f86084000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1777497701.374863:0:3656:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000004:00080000:2.0:1777497701.374865:0:3656:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:2.0:1777497701.374868:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565018624:0@lo:9:umount.0 00000020:00000080:1.0:1777497701.384079:0:83956:0:(genops.c:906:class_export_put()) final put ffff923f8dd19800/d146155b-4321-4b14-9284-f644ed9631fb 00010000:00010000:1.0:1777497701.385451:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.385458:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497701.385460:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777497701.390551:0:16604:0:(genops.c:906:class_export_put()) final put ffff923f8dd1c800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:1.0:1777497701.390901:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497701.391609:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8dd19800/d146155b-4321-4b14-9284-f644ed9631fb for lustre-MDT0000 00000020:00000080:2.0:1777497701.391675:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81a02000 for lustre-MDT0000 00010000:00010000:0.0:1777497701.391784:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497701.391786:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497701.391789:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497701.391817:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8dd1c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497701.391840:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bcc6c000 for lustre-MDT0000 00000020:00000080:3.0:1777497701.435652:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4a2 00000020:00000080:3.0:1777497701.435676:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f8274d800/lustre-QMT0000_UUID 00000020:01000000:3.0:1777497701.435732:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1777497701.435829:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497701.435839:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497701.435844:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 8 (ffff9240a62e8000) has no exports 00000020:00000080:0.0:1777497701.436385:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d49b 00000020:00000080:0.0:1777497701.436391:0:89949:0:(genops.c:906:class_export_put()) final put ffff924086e27000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1777497701.436440:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8274d800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1777497701.436522:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e27000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497701.436587:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497701.436609:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1777497701.436613:0:89949:0:(genops.c:906:class_export_put()) final put ffff92409c5db800/lustre-QMT0000_UUID 00000020:00000080:0.0:1777497701.436615:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff92409c5db800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1777497701.436623:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1777497701.436776:0:89949:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a6bb24e0 - data ffff9240a30e7d80/ffff923f86e3c800 00000020:01000000:0.0:1777497701.436909:0:89949:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240a6bb2180 - data ffff9240a31e7e58/ffff92409c274c00 00000100:00080000:0.0:1777497701.483119:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1777497701.483127:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1777497701.483142:0:89949:0:(client.c:3139:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9240a3adc700 x1863837565018368/t81604378769(81604378769) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497711 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497701.483167:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1777497701.484750:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777497701.484756:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 4 00000004:00080000:0.0:1777497701.484813:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497701.484817:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1777497701.485040:0:88692:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1777497701.485045:0:88692:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6c:0x0] index 1 count 1 00000040:00080000:2.0:1777497701.485056:0:88692:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 27 count 2 00000100:00080000:0.0:1777497701.485907:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777497701.485912:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 4 00000004:00080000:0.0:1777497701.485961:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497701.485964:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1777497701.486284:0:88694:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1777497701.486289:0:88694:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6e:0x0] index 1 count 1 00000040:00080000:2.0:1777497701.486297:0:88694:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 27 count 2 00000020:00000080:0.0:1777497701.487456:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d44e 00000020:00000080:0.0:1777497701.487466:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240911d5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1777497701.491035:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d463 00000020:00000080:0.0:1777497701.491048:0:89949:0:(genops.c:906:class_export_put()) final put ffff92409f69d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497701.491180:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1777497701.492204:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1777497701.492214:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497701.492223:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497701.492228:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff9240a6bf19c0) has no exports 00000004:01000000:0.0:1777497701.492459:0:89949:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1777497701.492469:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4ef 00000020:00000080:0.0:1777497701.492474:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240b539c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497701.493867:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f69d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:3.0:1777497701.495186:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b539c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1777497701.495223:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1777497701.495242:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497701.495252:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1777497701.495257:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9240aecd99c0) has no exports 00000020:00000080:0.0:1777497701.495266:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4e1 00000020:00000080:0.0:1777497701.495273:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f86081800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1777497701.495980:0:89949:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1777497701.495984:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1777497701.495988:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969452 gen 5 00000004:00080000:0.0:1777497701.495993:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497701.495995:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497701.498738:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f86081800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497701.499158:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f86084000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1777497701.499241:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497701.499254:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497701.499259:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240bb709000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497701.499263:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb709000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1777497701.499270:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1777497701.499361:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4d3 00000020:00000080:0.0:1777497701.499368:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240ae4b7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1777497701.499412:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1777497701.499417:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497701.499422:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1777497701.499426:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff9240aecdb380) has no exports 00000020:00000080:0.0:1777497701.499432:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4cc 00000020:00000080:0.0:1777497701.499436:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240bb70b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497701.499452:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1777497701.499986:0:89949:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1777497701.499990:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1777497701.499994:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969457 gen 5 00000004:00080000:0.0:1777497701.500000:0:89949:0:(osp_dev.c:1629:osp_import_event()) got inactive 00000100:00100000:0.0:1777497701.500003:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497701.500201:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb70b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1777497701.500303:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497701.500309:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1777497701.500322:0:89949:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1777497701.500333:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4b7 00000020:00000080:0.0:1777497701.500339:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240911d0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497701.500358:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb6f7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1777497701.500363:0:82203:0:(genops.c:906:class_export_put()) final put ffff9240911d5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497701.500365:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1777497701.500370:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1777497701.500455:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1777497701.500459:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497701.500464:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1777497701.500467:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff9240911fcd40) has no exports 00000020:00000080:0.0:1777497701.500472:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d4b0 00000020:00000080:0.0:1777497701.500475:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f81b74000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1777497701.500602:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777497701.501012:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81b74000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1777497701.516154:0:89949:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1777497701.516161:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1777497701.516165:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777497701.516173:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497701.516225:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.516253:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497701.516282:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.516285:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497701.516290:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f81b73000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497701.516295:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81b73000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1777497701.516308:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1777497701.516426:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d46a 00000020:00000080:2.0:1777497701.516432:0:89949:0:(genops.c:906:class_export_put()) final put ffff92409f69a000/lustre-MDD0000_UUID 00000020:01000000:2.0:1777497701.516437:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1777497701.516441:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497701.516445:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497701.516452:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff9240a6bf0000) has no exports 00000020:00000080:2.0:1777497701.516468:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.516471:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1777497701.516476:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d471 00000020:00000080:2.0:1777497701.516479:0:89949:0:(genops.c:906:class_export_put()) final put ffff92409f698800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1777497701.516485:0:89949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a3af2000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1777497701.516488:0:89949:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a3af2000 3 00000020:01000004:2.0:1777497701.516491:0:89949:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a3af2000 from lustre-MDT0000 00000020:00000080:2.0:1777497701.516506:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.516508:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1777497701.516511:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240911d0000/lustre-MDT0000_UUID 00000020:00000080:2.0:1777497701.516512:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d0000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1777497701.516520:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1777497701.516550:0:89949:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1777497701.516553:0:89949:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1777497701.516555:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1777497701.516557:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497701.516559:0:89949:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1777497701.516567:0:89949:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff923f82c7e800 34a4158d-137e-4629-9769-4a4bd53f7f61 192.168.202.4@tcp 8 (0 0 4) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497701.516573:0:89949:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff9240ae4b2800 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 0@lo 17 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497701.516576:0:89949:0:(genops.c:1574:class_disconnect_exports()) OBD device 3 (ffff924083168000) has exports, disconnecting them 00000020:00080000:2.0:1777497701.516580:0:89949:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 192.168.202.4@tcp (ffff923f82c7e800), last request at 1777497666 00000020:00000080:2.0:1777497701.516598:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d5d6 00000020:00010000:2.0:1777497701.516602:0:89949:0:(genops.c:1942:obd_stale_export_put()) Put export ffff923f82c7e800: total 2 00000100:00080000:2.0:1777497701.516605:0:89949:0:(import.c:65:import_set_state_nolock()) ffff923f82c78000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497701.516796:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff923f82c7e800): rc 0 00000020:00080000:2.0:1777497701.516806:0:89949:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9240ae4b2800), last request at 1777497664 00000020:00010000:2.0:1777497701.516846:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff923f82c7e800: total 2 00010000:00010000:2.0:1777497701.516870:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff923f82c7e800, canceled 0 locks, left on hash table 4. 00010000:00010000:2.0:1777497701.516898:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8400/0x3e357265691d615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c336 expref: 5 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.516912:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9400/0x3e357265691d607 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c328 expref: 4 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.516923:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b800/0x3e357265691da52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c39f expref: 3 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.516934:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eefc00/0x3e357265691da2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c398 expref: 2 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.516942:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff923f82c7e800, canceled 4 locks, left on hash table 0. 00000020:00000080:2.0:1777497701.516958:0:6502:0:(genops.c:906:class_export_put()) final put ffff923f82c7e800/34a4158d-137e-4629-9769-4a4bd53f7f61 00010000:00010000:2.0:1777497701.516963:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.516964:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.516966:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497701.516977:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d41d 00000020:00010000:2.0:1777497701.516980:0:89949:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9240ae4b2800: total 3 00000100:00080000:2.0:1777497701.516982:0:89949:0:(import.c:65:import_set_state_nolock()) ffff9240ae4b3800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1777497701.516992:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240ae4b2800): rc 0 00000020:00080000:2.0:1777497701.516996:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff924083168000) has no exports 00000020:00010000:2.0:1777497701.517001:0:8412:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9240ae4b2800: total 3 00010000:00010000:2.0:1777497701.517003:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.517021:0:8412:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9240ae4b2800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1777497701.517035:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd9000/0x3e357265691d57b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d574 expref: 14 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517060:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924087d38a00/0x3e357265691d589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d582 expref: 13 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517070:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5b400/0x3e357265691d9f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d9e9 expref: 12 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517079:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a800/0x3e357265691d5e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d5dd expref: 11 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517088:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef400/0x3e357265691d9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d9f7 expref: 10 pid: 88680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517118:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff400/0x3e357265691da3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691da36 expref: 9 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517129:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8e00/0x3e357265691d5b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d5ac expref: 8 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517142:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a000/0x3e357265691d5f2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d5eb expref: 7 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517153:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691da0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691da05 expref: 6 pid: 88684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517162:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7fe600/0x3e357265691da4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691da44 expref: 5 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517172:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff200/0x3e357265691da1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691da13 expref: 4 pid: 88679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517193:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a800/0x3e357265691da28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691da21 expref: 3 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517204:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8000/0x3e357265691d55f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691d558 expref: 2 pid: 88681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497701.517214:0:8412:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9240ae4b2800, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1777497701.517227:0:8412:0:(genops.c:906:class_export_put()) final put ffff9240ae4b2800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 00010000:00010000:2.0:1777497701.517231:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.517233:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497701.517235:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497701.517297:0:88680:0:(service.c:3164:ptlrpc_main()) ll_mgs_0001: service thread [ffff923f8417ae00:88680] 1 exiting: rc = 0 00000100:00100000:3.0:1777497701.517466:0:88681:0:(service.c:3164:ptlrpc_main()) ll_mgs_0002: service thread [ffff923f8417b000:88681] 2 exiting: rc = 0 00000020:00000080:3.0:1777497701.517514:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81b71800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1777497701.517519:0:82203:0:(genops.c:906:class_export_put()) final put ffff9240911d3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497701.517535:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1777497701.517543:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497701.517598:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f69a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1777497701.517602:0:82203:0:(genops.c:906:class_export_put()) final put ffff9240911d1000/lustre-MDD0000_UUID 00000020:00000080:3.0:1777497701.517604:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240911d1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1777497701.517778:0:82203:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1777497701.517819:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff92409f698800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1777497701.517824:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82c7e800/34a4158d-137e-4629-9769-4a4bd53f7f61 for MGS 00000020:00000080:3.0:1777497701.517853:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240ae4b2800/9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6 for MGS 00000020:00000080:3.0:1777497701.517865:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82c78000 for MGS 00000020:00000080:3.0:1777497701.517869:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240ae4b3800 for MGS 00000100:00100000:1.0:1777497701.518604:0:88679:0:(service.c:3164:ptlrpc_main()) ll_mgs_0000: service thread [ffff923f84335600:88679] 0 exiting: rc = 1 00000100:00100000:0.0:1777497701.542227:0:88684:0:(service.c:3164:ptlrpc_main()) ll_mgs_0003: service thread [ffff92409c678800:88684] 3 exiting: rc = 0 00000100:00100000:3.0:1777497701.543002:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543012:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543031:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543037:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543044:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543049:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543054:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543059:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543065:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543085:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543091:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543114:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543120:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543125:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543130:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543135:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543140:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543146:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543150:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543155:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543160:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543165:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543170:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543175:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543180:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543186:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543191:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543196:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543201:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543206:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543211:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543216:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543222:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543227:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543232:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543239:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543244:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543250:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543256:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543261:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543266:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543270:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543275:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543280:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543294:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543299:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543305:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543310:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543315:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543320:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543326:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543331:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543336:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543341:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543346:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543352:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543357:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543362:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543378:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543385:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543391:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543397:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543403:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1777497701.543409:0:89949:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:2.0:1777497701.544204:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1777497701.545685:0:89949:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff923f84c51060 - data ffff9240b6194870/ffff9240bc7cdc00 00000020:01000000:3.0:1777497701.545805:0:89949:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240bb7f6300 - data ffff9240b607a798/ffff9240b54b7c00 00000020:00000080:3.0:1777497701.546605:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d416 00000020:00000080:3.0:1777497701.546777:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240b543a000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1777497701.546836:0:89949:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240a3af2000 from MGS, refs=2 00000020:01000004:3.0:1777497701.546840:0:89949:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a3af2000 2 00000020:01000004:3.0:1777497701.546843:0:89949:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240a3af2000 from MGS 00000020:00000080:3.0:1777497701.546874:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497701.546882:0:89949:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1777497701.546885:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f88a18000/MGS 00000020:00000080:3.0:1777497701.546888:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a18000/MGS for MGS 00000020:01000000:3.0:1777497701.546897:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1777497701.546963:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1777497701.546966:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497701.546983:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1777497701.546990:0:89949:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9240bb681800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1777497701.546995:0:89949:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9240911f8000) has exports, disconnecting them 00000020:00080000:3.0:1777497701.547000:0:89949:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9240bb681800), last request at 1777497665 00000020:00000080:3.0:1777497701.547004:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d52e 00000020:00080000:3.0:1777497701.547013:0:89949:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240bb681800): rc 0 00000020:00000080:3.0:1777497701.547016:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240bb681800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777497701.547124:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240b543a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497701.552875:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb681800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1777497701.554163:0:89949:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1777497701.554170:0:89949:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497701.554174:0:89949:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777497701.554183:0:89949:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1777497701.554221:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb6f6800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1777497701.554342:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.554366:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1777497701.554371:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240bb684800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1777497701.554375:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb684800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1777497701.554380:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1777497701.554463:0:89949:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240a3af2000 1 00000020:00000080:2.0:1777497701.554469:0:89949:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d408 00000020:00000080:2.0:1777497701.554474:0:89949:0:(genops.c:906:class_export_put()) final put ffff9240a3af0000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1777497701.554490:0:89949:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1777497701.554505:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497701.554509:0:89949:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1777497701.554513:0:89949:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9240a62e99c0) has no exports 00000020:00000080:0.0:1777497701.554528:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a3af0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1777497701.751910:0:89949:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497701.751923:0:89949:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1777497701.751930:0:89949:0:(genops.c:906:class_export_put()) final put ffff923f8dd1a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1777497701.751934:0:89949:0:(genops.c:865:class_export_destroy()) destroying export ffff923f8dd1a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1777497701.751947:0:89949:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1777497701.752239:0:89949:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9240a3af3000 00000020:02000400:2.0:1777497701.752308:0:89949:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1777497702.206421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497702.206496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:0.0:1777497702.206524:0:3650:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546354176 offset 0 length 224: 4 00000100:00100000:0.0:1777497702.206544:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497702.209003:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354560 00000100:00100000:3.0:1777497702.209017:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354560 00000100:00100000:3.0:1777497702.209088:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2636 00000100:00100000:3.0:1777497702.209124:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546354560:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497702.209205:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546354560:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 84us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497702.209214:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2636 00000100:00080000:3.0:1777497702.209237:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497702.214197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497702.214547:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354304 00000100:00100000:1.0:1777497702.214557:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354304 00000100:00100000:1.0:1777497702.214615:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354432 00000100:00100000:1.0:1777497702.214619:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354432 00000100:00100000:1.0:1777497702.214672:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1359 00000100:00100000:1.0:1777497702.214680:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+19:2414:x1863837546354432:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497702.214759:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+19:2414:x1863837546354432:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 79us (8213us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497702.214766:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1359 00000100:00100000:1.0:1777497702.217181:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1399 00000100:00100000:1.0:1777497702.217191:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2414:x1863837546354304:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:1.0:1777497702.217203:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:1.0:1777497702.217264:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2414:x1863837546354304:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (10853us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497702.217272:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1399 00000100:00100000:2.0:1777497702.219851:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354688 00000100:00100000:2.0:1777497702.219867:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354688 00000100:00100000:2.0:1777497702.219934:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2637 00000100:00100000:2.0:1777497702.219947:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546354688:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:1.0:1777497702.220219:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497702.220234:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497702.220310:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546354688:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 366us (6119us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497702.220320:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2637 00000100:00100000:0.0:1777497702.222932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497702.229217:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546354816 00000100:00100000:1.0:1777497702.229232:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546354816 00000100:00100000:1.0:1777497702.229333:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1400 00000100:00100000:1.0:1777497702.229342:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546354816:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 00010000:00020000:1.0:1777497702.229365:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497702.229440:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546354816:12345-192.168.202.4@tcp:38:ptlrpcd_01_00.0 Request processed in 98us (6518us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497702.229447:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1400 00010000:00010000:1.0:1777497702.562702:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497703.589608:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497704.482356:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497704.482377:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565019008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497704.482440:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497704.482484:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019008 00000100:00100000:0.0:1777497704.482491:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019008 00000100:00100000:0.0:1777497704.482547:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:0.0:1777497704.482555:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565019008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497704.482588:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497704.482599:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565019136:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497704.482622:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497704.482623:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565019008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497704.482641:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:0.0:1777497704.482662:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019136 00000100:00100000:0.0:1777497704.482665:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019136 00000100:00100000:2.0:1777497704.482669:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565019008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497704.482684:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1777497704.482689:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565019136:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497704.482703:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497704.482732:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565019136:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497704.482737:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1777497704.482874:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565019136:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497704.483060:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497704.483064:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1777497704.484887:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1777497704.484895:0:9460:0:(genops.c:906:class_export_put()) final put ffff923f88a8a800/lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1777497704.484924:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969454 is committed 00000020:00000080:2.0:1777497704.485526:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a8a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1777497704.485578:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a8f000 for lustre-OST0001 00000001:00100000:0.0:1777497704.491170:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497704.491187:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378769 is committed 00000020:00000080:0.0:1777497704.491193:0:72699:0:(genops.c:906:class_export_put()) final put ffff923f839d1000/lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1777497704.491214:0:72699:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0001: transno 81604378768 is committed 00000020:00000080:1.0:1777497704.491291:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff923f839d1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1777497704.491363:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f839d0800 for lustre-MDT0001 00010000:00010000:2.0:1777497704.491840:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491852:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491877:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491882:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497704.491886:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491893:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491909:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff923f847c8a00) 00010000:00010000:2.0:1777497704.491912:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497704.491917:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491922:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240baa5ae00/0x3e357265691dc51 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491947:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491953:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491958:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491962:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497704.491965:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491980:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491987:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924091207700) 00010000:00010000:2.0:1777497704.491989:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497704.491992:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.491997:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691dc66 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492008:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492013:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492019:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492024:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497704.492027:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492033:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492040:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff923f847c8700) 00010000:00010000:2.0:1777497704.492042:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497704.492045:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492055:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92408150ae00/0x3e357265691dcac lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492070:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,1 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492076:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 2/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492082:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492086:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497704.492089:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 3/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492140:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 4/0,0 mode: TXN/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492148:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8100) 00010000:00010000:2.0:1777497704.492151:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497704.492153:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 2/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.492159:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92408150a200/0x3e357265691dcc1 lrc: 0/0,0 mode: --/TXN res: [0x2400090a5:0x5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497704.612351:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497705.635727:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497706.018427:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565019520:0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.018496:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018517:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565019392:0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.018529:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565020032:0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.018567:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018574:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018596:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565019904:0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.018597:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1777497706.018607:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565019648:0@lo:400:kworker.0 00000100:00100000:2.0:1777497706.018636:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497706.018648:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018663:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1777497706.018671:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565019264:0@lo:400:kworker.0 00000400:00000100:2.0:1777497706.018691:0:3658:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837565019264 offset 0 length 224: 4 00000100:00100000:2.0:1777497706.018711:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565019776:0@lo:400:kworker.0 00000100:00100000:2.0:1777497706.018730:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497706.018746:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565020160:0@lo:400:kworker.0 00000100:00100000:2.0:1777497706.018748:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565020288:0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.018787:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018790:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.018829:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019904 00000100:00100000:2.0:1777497706.018836:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019904 00000100:00100000:2.0:1777497706.018871:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4057 00000100:00100000:2.0:1777497706.018879:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1863837565019904:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1777497706.018887:0:23359:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1777497706.018925:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3658:x1863837565019904:12345-0@lo:400:kworker.0 Request processed in 46us (289us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497706.018933:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4057 00000100:00080000:3.0:1777497706.018963:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497706.018969:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:1.0:1777497706.019032:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019520 00000100:00100000:1.0:1777497706.019036:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019520 00000100:00100000:1.0:1777497706.019115:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019392 00000100:00100000:1.0:1777497706.019118:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019392 00000100:00100000:1.0:1777497706.019130:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019648 00000100:00100000:1.0:1777497706.019133:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019648 00000100:02000400:3.0:1777497706.019139:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1777497706.019144:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00080000:3.0:1777497706.019146:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497706.019152:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3799 00000100:00100000:1.0:1777497706.019155:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565019520:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1777497706.019162:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497706.019187:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5698000 x1863837565020416/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497706.019208:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565019520:12345-0@lo:400:kworker.0 Request processed in 57us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497706.019209:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565019904:0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019221:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1777497706.019244:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565019776 00000100:00100000:1.0:1777497706.019248:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565019776 00000100:00100000:3.0:1777497706.019253:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020288 00000100:00100000:3.0:1777497706.019258:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020288 00000100:00100000:1.0:1777497706.019267:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1777497706.019274:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565019776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497706.019283:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1777497706.019288:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1863837565019392:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497706.019294:0:63727:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497706.019311:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565019776:12345-0@lo:400:kworker.0 Request processed in 38us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497706.019317:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1777497706.019331:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1777497706.019335:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1863837565019648:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497706.019339:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497706.019360:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3659:x1863837565019648:12345-0@lo:400:kworker.0 Request processed in 24us (713us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497706.019364:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1777497706.019375:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1777497706.019378:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837565020288:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1777497706.019382:0:63729:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1777497706.019402:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1863837565020288:12345-0@lo:400:kworker.0 Request processed in 22us (618us total) trans 0 rc -107/-107 00000100:00100000:1.0:1777497706.019407:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1777497706.019425:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020032 00000100:00100000:1.0:1777497706.019428:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020032 00000100:00100000:1.0:1777497706.019451:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020160 00000100:00100000:1.0:1777497706.019454:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020160 00000100:00100000:1.0:1777497706.019475:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1777497706.019482:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019510:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565020032:12345-0@lo:400:kworker.0 Request processed in 29us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497706.019515:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2638 00000100:00100000:1.0:1777497706.019532:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2639 00000100:00100000:1.0:1777497706.019537:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019563:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565020160:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497706.019568:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2639 00000100:00080000:1.0:1777497706.019595:0:3659:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497706.019598:0:3659:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497706.019601:0:3659:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497706.019605:0:3659:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497706.019608:0:3659:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3799 00000100:00080000:1.0:1777497706.019621:0:3659:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497706.019636:0:3659:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f44000 x1863837565020544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497706.019647:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565019648:0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019664:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565020160:0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019674:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565019520:0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019682:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565020032:0@lo:400:kworker.0 00000100:00100000:1.0:1777497706.019718:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565019776:0@lo:400:kworker.0 00000100:00080000:1.0:1777497706.019726:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497706.019729:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497706.019732:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497706.019734:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497706.019743:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3799 00000100:00080000:1.0:1777497706.019747:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497706.019760:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f46680 x1863837565020672/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497706.019770:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565020288:0@lo:400:kworker.0 00000100:00100000:2.0:1777497706.020026:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565020416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497706.020056:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.020090:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565020544:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1777497706.020132:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.020149:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565020672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497706.020168:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497706.020198:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020544 00000100:00100000:2.0:1777497706.020208:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020544 00000100:00100000:2.0:1777497706.020227:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020672 00000100:00100000:2.0:1777497706.020229:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020672 00000100:00100000:2.0:1777497706.020237:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1777497706.020241:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020544:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1777497706.020258:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497706.020287:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020544:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 44us (154us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497706.020293:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:2.0:1777497706.020303:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1777497706.020306:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020672:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1777497706.020314:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497706.020334:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020672:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 26us (165us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497706.020340:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:2.0:1777497706.020354:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497706.020359:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497706.020361:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497706.020377:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497706.020382:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497706.020385:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565020544:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1777497706.020392:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497706.020395:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497706.020397:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565020672:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1777497706.020547:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020416 00000100:00100000:1.0:1777497706.020552:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020416 00000100:00100000:1.0:1777497706.020582:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4058 00000100:00100000:1.0:1777497706.020587:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565020416:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1777497706.020597:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497706.020636:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565020416:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 48us (580us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497706.020643:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4058 00000100:00080000:1.0:1777497706.020664:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497706.020668:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497706.020671:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565020416:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1777497706.023271:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1863837565019392:12345-0@lo:400:kworker.0 Request processed in 3974us (4691us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497706.023284:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00080000:1.0:1777497706.028496:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1777497706.028503:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1777497706.028508:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1777497706.028513:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497706.028517:0:3658:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3799 00000100:00080000:1.0:1777497706.028524:0:3658:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497706.028561:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82f46680 x1863837565020800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497706.028624:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565019392:0@lo:400:kworker.0 00000100:00100000:2.0:1777497706.028782:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565020800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497706.028849:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497706.029179:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020800 00000100:00100000:1.0:1777497706.029187:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020800 00000100:00100000:1.0:1777497706.029233:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1777497706.029240:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1777497706.029260:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497706.029308:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565020800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 67us (458us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497706.029316:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00080000:3.0:1777497706.029325:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497706.029333:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497706.029336:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565020800:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:2.0:1777497706.658671:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497707.325527:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000400:00000100:2.0:1777497707.325656:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546354944 offset 0 length 224: 4 00000100:00100000:2.0:1777497707.325748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497707.327263:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355328 00000100:00100000:3.0:1777497707.327280:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355328 00000100:00100000:3.0:1777497707.327385:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2640 00000100:00100000:3.0:1777497707.327399:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546355328:12345-192.168.202.4@tcp:400:kworker.0 00000100:00080000:2.0:1777497707.327541:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497707.327845:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546355328:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 448us (2094us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497707.327854:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2640 00000100:00100000:0.0:1777497707.329248:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497707.330342:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355200 00000100:00100000:1.0:1777497707.330361:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355200 00000100:00100000:1.0:1777497707.330459:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355072 00000100:00100000:1.0:1777497707.330463:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355072 00000100:00100000:1.0:1777497707.330493:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1362 00000100:00100000:1.0:1777497707.330506:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546355200:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497707.330615:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1407 00000100:00100000:0.0:1777497707.330627:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546355072:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497707.330653:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497707.330717:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546355072:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 91us (1477us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497707.330725:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1407 00000100:00080000:0.0:1777497707.330784:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497707.333171:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546355200:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2652us (7644us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497707.333187:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1362 00000100:00100000:0.0:1777497707.335044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497707.335297:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355456 00000100:00100000:1.0:1777497707.335307:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355456 00000100:00100000:1.0:1777497707.338369:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2641 00000100:00100000:1.0:1777497707.338386:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546355456:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497707.340907:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546355456:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 2518us (5862us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497707.340920:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2641 00000100:00080000:0.0:1777497707.346218:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1777497707.568813:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1777497707.568824:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f82ab1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1777497707.569722:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1777497707.569810:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82ab6000 for lustre-OST0000 00010000:00010000:1.0:1777497707.683004:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497708.708293:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497709.602614:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565020928:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497709.602710:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497709.602714:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497709.602732:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565021056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497709.602796:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565020928 00000100:00100000:3.0:1777497709.602805:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565020928 00000100:00100000:3.0:1777497709.602873:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:3.0:1777497709.602888:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565020928:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1777497709.602924:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1777497709.602928:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497709.602985:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565020928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497709.602992:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1777497709.603088:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565020928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497709.603199:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497709.603320:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021056 00000100:00100000:3.0:1777497709.603326:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021056 00000100:00100000:3.0:1777497709.603369:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1777497709.603376:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565021056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497709.603396:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497709.603432:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565021056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497709.603438:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000100:00100000:3.0:1777497709.603478:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565021056:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497709.603597:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497709.733610:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497710.754588:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497711.146682:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497711.146691:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497711.146697:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497711.146707:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3835 00000100:00080000:2.0:1777497711.146715:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1777497711.146723:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497711.146751:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2ee680 x1863837565021312/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497711.146809:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497711.146813:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497711.146815:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497711.146819:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3835 00000100:00080000:2.0:1777497711.146821:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1777497711.146845:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497711.146858:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2ed500 x1863837565021568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497711.146876:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497711.146880:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497711.146881:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497711.146885:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3835 00000100:00080000:2.0:1777497711.146888:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1777497711.146892:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497711.146906:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2efb80 x1863837565021824/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497711.146929:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497711.146933:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497711.146934:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497711.146938:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3835 00000100:00080000:2.0:1777497711.146941:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1777497711.146945:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497711.146956:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f84364a80 x1863837565022208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497711.147010:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565021696:0@lo:400:kworker.0 00000100:00100000:2.0:1777497711.147127:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497711.147180:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497711.147186:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565021440:0@lo:400:kworker.0 00000100:00100000:2.0:1777497711.147210:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497711.147260:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021696 00000100:00100000:2.0:1777497711.147270:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021696 00000100:00100000:2.0:1777497711.147338:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021440 00000100:00100000:2.0:1777497711.147341:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021440 00000100:00100000:2.0:1777497711.147370:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:2.0:1777497711.147379:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565021696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.147724:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565021952:0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.147770:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497711.147801:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1777497711.147808:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565021184:0@lo:400:kworker.0 00000400:00000100:0.0:1777497711.147828:0:3659:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837565021184 offset 0 length 224: 4 00000100:00100000:0.0:1777497711.147852:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565022080:0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.147874:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497711.147932:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1777497711.147944:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565021440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.148027:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565021440:12345-0@lo:400:kworker.0 Request processed in 87us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497711.148036:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:0.0:1777497711.148085:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021952 00000100:00100000:0.0:1777497711.148090:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021952 00000100:00100000:0.0:1777497711.148154:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022080 00000100:00100000:0.0:1777497711.148157:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022080 00000100:00100000:0.0:1777497711.148181:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1777497711.148187:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565021952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.148224:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565021952:12345-0@lo:400:kworker.0 Request processed in 37us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497711.148229:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2642 00000100:00100000:0.0:1777497711.148243:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1777497711.148249:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565022080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.148275:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565022080:12345-0@lo:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497711.148295:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2643 00000100:00100000:0.0:1777497711.148343:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565022080:0@lo:400:kworker.0 00000100:00100000:0.0:1777497711.148355:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565021952:0@lo:400:kworker.0 00000100:00100000:3.0:1777497711.148855:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565021440:0@lo:400:kworker.0 00000100:00100000:1.0:1777497711.148954:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565021312:0@lo:38:kworker.0 00000100:00100000:1.0:1777497711.149016:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497711.149050:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565021568:0@lo:38:kworker.0 00000100:00100000:1.0:1777497711.149073:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497711.149126:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565021824:0@lo:38:kworker.0 00000100:00100000:1.0:1777497711.149153:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497711.149173:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565022208:0@lo:38:kworker.0 00000100:00100000:1.0:1777497711.149195:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497711.149232:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497711.149236:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497711.149240:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497711.149254:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021312 00000100:00100000:1.0:1777497711.149258:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021312 00000100:00100000:1.0:1777497711.149282:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021568 00000100:00100000:1.0:1777497711.149285:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021568 00000100:00100000:1.0:1777497711.149292:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022208 00000100:00100000:1.0:1777497711.149294:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022208 00000100:00100000:1.0:1777497711.149304:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1777497711.149310:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565021312:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497711.149336:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497711.149374:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565021312:12345-0@lo:38:kworker.0 Request processed in 63us (359us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497711.149389:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1777497711.149406:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1777497711.149409:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565021568:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497711.149435:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497711.149458:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565021568:12345-0@lo:38:kworker.0 Request processed in 48us (385us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497711.149464:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:1.0:1777497711.149477:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:1.0:1777497711.149480:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565022208:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497711.149488:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497711.149508:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565022208:12345-0@lo:38:kworker.0 Request processed in 26us (312us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497711.149513:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00080000:1.0:1777497711.149554:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497711.149560:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497711.149563:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565021312:0@lo:38:kworker.0 00000100:00080000:1.0:1777497711.149582:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497711.149586:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497711.149588:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565021568:0@lo:38:kworker.0 00000100:00080000:1.0:1777497711.149594:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497711.149597:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497711.149599:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565022208:0@lo:38:kworker.0 00000100:00100000:1.0:1777497711.149637:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565021824 00000100:00100000:1.0:1777497711.149640:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565021824 00000100:00100000:1.0:1777497711.149663:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4059 00000100:00100000:1.0:1777497711.149667:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565021824:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497711.149689:0:23359:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497711.149723:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565021824:12345-0@lo:38:kworker.0 Request processed in 55us (569us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497711.149730:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4059 00000100:00080000:1.0:1777497711.149756:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497711.149760:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497711.149762:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565021824:0@lo:38:kworker.0 00000100:00100000:2.0:1777497711.151528:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565021696:12345-0@lo:400:kworker.0 Request processed in 4143us (4395us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497711.151647:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1777497711.155957:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565021696:0@lo:400:kworker.0 00010000:00010000:2.0:1777497711.781255:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497712.446213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497712.446272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497712.446391:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355712 00000100:00100000:3.0:1777497712.446400:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355840 00000100:00100000:1.0:1777497712.446403:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355712 00000100:00100000:3.0:1777497712.446419:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355840 00000100:00100000:1.0:1777497712.446471:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1411 00000100:00100000:1.0:1777497712.446479:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546355712:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:1.0:1777497712.446509:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497712.446602:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:2411:x1863837546355712:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 112us (389us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497712.446610:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1411 00000100:00100000:3.0:1777497712.447023:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1365 00000100:00100000:3.0:1777497712.447036:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546355840:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497712.447192:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546355840:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 159us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497712.447199:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1365 00000100:00080000:2.0:1777497712.447886:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000400:00000100:0.0:1777497712.451213:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546355584 offset 0 length 224: 4 00000100:00100000:0.0:1777497712.451862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497712.452044:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497712.452839:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546355968 00000100:00100000:2.0:1777497712.452854:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546355968 00000100:00100000:2.0:1777497712.453014:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356096 00000100:00100000:2.0:1777497712.453019:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356096 00000100:00080000:3.0:1777497712.453084:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497712.453089:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497712.453275:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2644 00000100:00100000:1.0:1777497712.453290:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546356096:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497712.453733:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546356096:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 444us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497712.453743:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2644 00000100:00100000:1.0:1777497712.453771:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5896 00000100:00100000:1.0:1777497712.453780:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546355968:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:1.0:1777497712.453805:0:8396:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691d677 00000100:00080000:1.0:1777497712.453817:0:8396:0:(import.c:65:import_set_state_nolock()) ffff923f82ab5800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1777497712.453880:0:8396:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294969458 00010000:00010000:3.0:1777497712.454198:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497712.456301:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+2:2411:x1863837546355968:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 2509us (4429us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497712.456316:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5896 00010000:00010000:0.0:1777497712.803534:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497713.828169:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497714.723271:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497714.723302:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565022336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497714.723399:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497714.723458:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022336 00000100:00100000:0.0:1777497714.723468:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022336 00000100:00100000:0.0:1777497714.723557:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1777497714.723568:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565022336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497714.723609:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497714.723660:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565022336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497714.723668:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00080000:0.0:1777497714.723693:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497714.723737:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565022336:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497714.728923:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565022464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497714.729031:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497714.729435:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022464 00000100:00100000:1.0:1777497714.729446:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022464 00000100:00100000:1.0:1777497714.729552:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:1.0:1777497714.729564:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565022464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497714.729606:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497714.729669:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565022464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497714.729677:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00080000:3.0:1777497714.729849:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497714.740914:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565022464:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497714.850411:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497715.875626:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497716.263035:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497716.263041:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497716.263045:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497716.263052:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3840 00000100:00080000:3.0:1777497716.263058:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497716.263064:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497716.263084:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5699c00 x1863837565022720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497716.263127:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497716.263130:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497716.263132:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497716.263135:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3840 00000100:00080000:3.0:1777497716.263138:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497716.263141:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497716.263152:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5699880 x1863837565022976/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497716.263175:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497716.263178:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497716.263187:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497716.263191:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3840 00000100:00080000:3.0:1777497716.263194:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497716.263197:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497716.263211:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2eea00 x1863837565023232/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497716.263231:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497716.263234:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497716.263236:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497716.263240:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3840 00000100:00080000:3.0:1777497716.263242:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1777497716.263245:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497716.263257:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bc2ee680 x1863837565023616/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497716.263287:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565022848:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263346:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263383:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1777497716.263389:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565022592:0@lo:400:kworker.0 00000400:00000100:3.0:1777497716.263409:0:3660:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837565022592 offset 0 length 224: 4 00000100:00100000:3.0:1777497716.263430:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565023488:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263480:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565022720:0@lo:38:kworker.0 00000100:00100000:3.0:1777497716.263501:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263529:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565022976:0@lo:38:kworker.0 00000100:00100000:3.0:1777497716.263558:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263576:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565023232:0@lo:38:kworker.0 00000100:00100000:3.0:1777497716.263599:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263615:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565023616:0@lo:38:kworker.0 00000100:00100000:3.0:1777497716.263633:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263659:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565023104:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263693:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263711:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497716.263716:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565023360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263737:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497716.263769:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022848 00000100:00100000:3.0:1777497716.263775:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022848 00000100:00100000:3.0:1777497716.263823:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022720 00000100:00100000:3.0:1777497716.263826:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022720 00000100:00100000:3.0:1777497716.263834:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565022976 00000100:00100000:3.0:1777497716.263836:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565022976 00000100:00100000:3.0:1777497716.263842:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023616 00000100:00100000:3.0:1777497716.263844:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023616 00000100:00100000:3.0:1777497716.263850:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023104 00000100:00100000:3.0:1777497716.263852:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023104 00000100:00100000:3.0:1777497716.263868:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:3.0:1777497716.263875:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263924:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565022848:12345-0@lo:400:kworker.0 Request processed in 50us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497716.263931:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:3.0:1777497716.263946:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1777497716.263951:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565023104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.263989:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565023104:12345-0@lo:400:kworker.0 Request processed in 38us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497716.263995:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:3.0:1777497716.264006:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1777497716.264009:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565022720:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497716.264025:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497716.264049:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565022720:12345-0@lo:38:kworker.0 Request processed in 38us (547us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497716.264053:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:3.0:1777497716.264062:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1777497716.264065:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565022976:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497716.264073:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497716.264091:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565022976:12345-0@lo:38:kworker.0 Request processed in 24us (533us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497716.264116:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1777497716.264126:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1777497716.264129:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565023616:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497716.264137:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497716.264159:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565023616:12345-0@lo:38:kworker.0 Request processed in 28us (525us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497716.264165:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:3.0:1777497716.264182:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023488 00000100:00100000:3.0:1777497716.264186:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023488 00000100:00100000:3.0:1777497716.264212:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023360 00000100:00100000:3.0:1777497716.264215:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023360 00000100:00100000:3.0:1777497716.264244:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1777497716.264250:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565023488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.264280:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565023488:12345-0@lo:400:kworker.0 Request processed in 30us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497716.264285:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2645 00000100:00100000:3.0:1777497716.264296:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2646 00000100:00100000:3.0:1777497716.264301:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565023360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.264326:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565023360:12345-0@lo:400:kworker.0 Request processed in 25us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497716.264331:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2646 00000100:00100000:3.0:1777497716.264353:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023232 00000100:00100000:3.0:1777497716.264356:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023232 00000100:00100000:3.0:1777497716.264383:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4060 00000100:00100000:3.0:1777497716.264387:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565023232:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497716.264396:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497716.264419:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565023232:12345-0@lo:38:kworker.0 Request processed in 31us (819us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497716.264423:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4060 00000100:00080000:3.0:1777497716.264444:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1777497716.264448:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497716.264450:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497716.264486:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565023360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.264498:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565023104:0@lo:400:kworker.0 00000100:00080000:3.0:1777497716.264543:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497716.264547:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497716.264551:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565022720:0@lo:38:kworker.0 00000100:00080000:3.0:1777497716.264567:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497716.264570:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497716.264573:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565022976:0@lo:38:kworker.0 00000100:00080000:3.0:1777497716.264581:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497716.264584:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497716.264586:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565023232:0@lo:38:kworker.0 00000100:00080000:3.0:1777497716.264592:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497716.264595:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497716.264597:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565023616:0@lo:38:kworker.0 00000100:00100000:3.0:1777497716.264625:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565023488:0@lo:400:kworker.0 00000100:00100000:3.0:1777497716.264635:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5698000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565022848:0@lo:400:kworker.0 00010000:00010000:3.0:1777497716.898345:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1777497717.572252:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546356224 offset 0 length 224: 4 00000100:00100000:1.0:1777497717.572292:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497717.572319:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356608 00000100:00100000:1.0:1777497717.572329:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356608 00000100:00100000:1.0:1777497717.572379:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2647 00000100:00100000:1.0:1777497717.572388:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546356608:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497717.572447:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546356608:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 61us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497717.572455:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2647 00000100:00100000:1.0:1777497717.572502:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497717.572624:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:3.0:1777497717.577835:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497717.577876:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356480 00000100:00100000:3.0:1777497717.577887:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356480 00000100:00100000:3.0:1777497717.577979:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356352 00000100:00100000:3.0:1777497717.577983:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356352 00000100:00100000:3.0:1777497717.578012:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1368 00000100:00100000:3.0:1777497717.578023:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2414:x1863837546356480:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497717.578141:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2414:x1863837546356480:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 114us (5632us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497717.578149:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1368 00000100:00100000:3.0:1777497717.578172:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1415 00000100:00100000:3.0:1777497717.578176:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546356352:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:3.0:1777497717.578207:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497717.578236:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546356352:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 58us (5612us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497717.578243:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1415 00000100:00080000:2.0:1777497717.578694:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1777497717.922219:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1777497718.598223:0:3651:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-192.168.202.4@tcp portal 26 match 1863837546356736 offset 0 length 520: 4 00000100:00100000:0.0:1777497718.598267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497718.598315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497718.598342:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497718.598369:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356864 00000100:00100000:0.0:1777497718.598378:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356864 00000100:00100000:0.0:1777497718.598411:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546356992 00000100:00100000:0.0:1777497718.598413:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546356992 00000100:00100000:0.0:1777497718.598449:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1369 00000100:00100000:0.0:1777497718.598460:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546356992:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497718.598545:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546356992:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 87us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497718.598553:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1369 00000100:00100000:0.0:1777497718.598570:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1416 00000100:00100000:0.0:1777497718.598574:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546356864:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497718.598594:0:65418:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497718.598637:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2411:x1863837546356864:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 61us (370us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497718.598643:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1416 00000100:00100000:1.0:1777497718.599270:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357120 00000100:00100000:1.0:1777497718.599276:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357120 00000100:00100000:1.0:1777497718.599332:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2648 00000100:00100000:1.0:1777497718.599339:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546357120:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497718.599395:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546357120:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 57us (1079us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497718.599401:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2648 00000001:00100000:0.0:1777497718.824392:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:0.0:1777497718.824401:0:8391:0:(genops.c:906:class_export_put()) final put ffff923f82ab0800/d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:3.0:1777497718.824477:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f82ab0800/d146155b-4321-4b14-9284-f644ed9631fb for lustre-OST0000 00000020:00000080:3.0:1777497718.824537:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f82ab5800 for lustre-OST0000 00010000:00010000:2.0:1777497718.947301:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497719.843029:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497719.843051:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565023744:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497719.843132:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497719.843175:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023744 00000100:00100000:2.0:1777497719.843182:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023744 00000100:00100000:2.0:1777497719.843235:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1777497719.843245:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565023744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497719.843284:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8648768 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497719.843324:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565023744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497719.843331:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00080000:2.0:1777497719.843351:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497719.843388:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565023744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497719.844327:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565023872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497719.844366:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497719.844451:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565023872 00000100:00100000:2.0:1777497719.844457:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565023872 00000100:00100000:2.0:1777497719.844511:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1777497719.844520:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565023872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497719.844539:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497719.844576:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565023872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497719.844582:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:2.0:1777497719.844618:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565023872:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1777497719.844690:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497719.980770:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497721.000197:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1777497721.393448:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497721.393455:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497721.393459:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497721.393477:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3845 00000100:00080000:2.0:1777497721.393484:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497721.393491:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497721.393516:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fdc00 x1863837565024128/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497721.393583:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497721.393586:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497721.393589:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497721.393592:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3845 00000100:00080000:2.0:1777497721.393594:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497721.393598:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497721.393610:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839ff800 x1863837565024384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497721.393625:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497721.393628:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497721.393630:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497721.393633:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3845 00000100:00080000:2.0:1777497721.393636:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497721.393639:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497721.393649:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fc000 x1863837565024640/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497721.393667:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497721.393671:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497721.393672:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497721.393675:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3845 00000100:00080000:2.0:1777497721.393678:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1777497721.393680:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497721.393690:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924086d92d80 x1863837565025024/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497721.393732:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565024768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.393797:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497721.394161:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565024000:0@lo:400:kworker.0 00000400:00000100:1.0:1777497721.394189:0:3658:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837565024000 offset 0 length 224: 4 00000100:00100000:1.0:1777497721.394214:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565024896:0@lo:400:kworker.0 00000100:00100000:1.0:1777497721.394236:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497721.394274:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024768 00000100:00100000:1.0:1777497721.394282:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024768 00000100:00100000:1.0:1777497721.394330:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024896 00000100:00100000:1.0:1777497721.394334:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024896 00000100:00100000:1.0:1777497721.394358:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1777497721.394368:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497721.394415:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565024768:12345-0@lo:400:kworker.0 Request processed in 49us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497721.394422:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2649 00000100:00100000:1.0:1777497721.394441:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2650 00000100:00100000:1.0:1777497721.394447:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565024896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497721.394488:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565024896:12345-0@lo:400:kworker.0 Request processed in 42us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497721.394494:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2650 00000100:00080000:1.0:1777497721.394509:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497721.394513:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497721.394544:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565024896:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.394628:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565024768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.394648:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565024128:0@lo:38:kworker.0 00000100:00100000:2.0:1777497721.394683:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.394712:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565024384:0@lo:38:kworker.0 00000100:00100000:2.0:1777497721.394732:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.394751:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565024640:0@lo:38:kworker.0 00000100:00100000:2.0:1777497721.394776:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.394794:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565025024:0@lo:38:kworker.0 00000100:00100000:2.0:1777497721.394817:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.395162:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565024256:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.395191:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.395212:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497721.395220:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565024512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.395240:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497721.395275:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024128 00000100:00100000:2.0:1777497721.395279:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024128 00000100:00100000:2.0:1777497721.395300:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024384 00000100:00100000:2.0:1777497721.395302:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024384 00000100:00100000:2.0:1777497721.395309:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025024 00000100:00100000:2.0:1777497721.395311:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025024 00000100:00100000:2.0:1777497721.395317:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024256 00000100:00100000:2.0:1777497721.395319:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024256 00000100:00100000:2.0:1777497721.395343:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024512 00000100:00100000:2.0:1777497721.395356:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024512 00000100:00100000:2.0:1777497721.395376:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1777497721.395382:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565024256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.395419:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565024256:12345-0@lo:400:kworker.0 Request processed in 37us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497721.395425:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1777497721.395437:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1777497721.395444:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565024512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.395479:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565024512:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497721.395485:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:2.0:1777497721.395496:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:2.0:1777497721.395499:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565024128:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497721.395516:0:73210:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497721.395546:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f81b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565024128:12345-0@lo:38:kworker.0 Request processed in 44us (862us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497721.395551:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1777497721.407690:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1777497721.407718:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f81b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565024384:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497721.407747:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497721.407827:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f81b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565024384:12345-0@lo:38:kworker.0 Request processed in 111us (13092us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497721.407835:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1777497721.407868:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:1.0:1777497721.407873:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565025024:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1777497721.407884:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497721.407909:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565025024:12345-0@lo:38:kworker.0 Request processed in 35us (13091us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497721.407914:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00080000:2.0:1777497721.409704:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497721.414710:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565024512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497721.414741:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565024256:0@lo:400:kworker.0 00000100:00080000:2.0:1777497721.414790:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497721.414796:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497721.414799:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565024128:0@lo:38:kworker.0 00000100:00080000:2.0:1777497721.414809:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497721.414813:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497721.414823:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565024384:0@lo:38:kworker.0 00000100:00080000:2.0:1777497721.414850:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497721.414854:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497721.414857:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565025024:0@lo:38:kworker.0 00000100:00100000:3.0:1777497721.421488:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565024640 00000100:00100000:3.0:1777497721.421505:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565024640 00000100:00100000:3.0:1777497721.421560:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4061 00000100:00100000:3.0:1777497721.421570:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565024640:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497721.421595:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497721.421678:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565024640:12345-0@lo:38:kworker.0 Request processed in 108us (26899us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497721.421684:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4061 00000100:00080000:3.0:1777497721.421734:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497721.421740:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497721.421744:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565024640:0@lo:38:kworker.0 00010000:00010000:1.0:1777497722.018648:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1777497722.402436:0:3658:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497706/real 1777497706] req@ffff9240b50b2300 x1863837565019264/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497722 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497722.402472:0:3658:0:(client.c:2523:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9240b50b2300 x1863837565019264/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497722.402482:0:3658:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1777497722.402486:0:3658:0:(import.c:185:ptlrpc_set_import_discon()) MGC192.168.202.104@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1777497722.402489:0:3658:0:(import.c:191:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.104@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1777497722.402491:0:3658:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1777497722.402495:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240b50b2300 x1863837565019264/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 1 dl 1777497722 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497722.402504:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240bc2ef480 x1863837565021184/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497727 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497722.402524:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff9240b5699180 x1863837565022592/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497732 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497722.402537:0:3658:0:(client.c:3579:ptlrpc_abort_inflight()) @@@ inflight req@ffff923f8410ca80 x1863837565024000/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497737 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1777497722.402546:0:3658:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1777497722.402549:0:3658:0:(pinger.c:192:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1777497722.402550:0:3658:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1777497722.402552:0:3658:0:(import.c:416:ptlrpc_pinger_force()) MGS: waking up pinger s:DISCONN 00000100:00100000:2.0:1777497722.402573:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8410ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565024000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.402579:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565019264:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.402631:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5699180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565022592:0@lo:400:kworker.0 00000100:00080000:2.0:1777497722.402646:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497722.402650:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1777497722.402654:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497722.402658:0:82203:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3794 00000100:00080000:2.0:1777497722.402665:0:82203:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497722.402691:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d41500 x1863837565025152/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497722.402716:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497722.402720:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497722.402722:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497722.402726:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3850 00000100:00080000:2.0:1777497722.402728:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497722.402732:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497722.402745:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d43100 x1863837565025280/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497722.402765:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497722.402769:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497722.402770:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497722.402773:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3850 00000100:00080000:2.0:1777497722.402775:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497722.402779:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497722.402790:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d40000 x1863837565025536/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497722.402817:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497722.402821:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497722.402823:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497722.402826:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3850 00000100:00080000:2.0:1777497722.402829:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497722.402832:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497722.402844:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d41180 x1863837565025792/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497722.402868:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497722.402871:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1777497722.402873:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497722.402876:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3850 00000100:00080000:2.0:1777497722.402878:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1777497722.402882:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497722.402891:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d42680 x1863837565026176/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497722.402914:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565025920:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.402970:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497722.402999:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497722.403005:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565026048:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403024:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497722.403053:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025920 00000100:00100000:2.0:1777497722.403061:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025920 00000100:00100000:2.0:1777497722.403127:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026048 00000100:00100000:2.0:1777497722.403136:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026048 00000100:00100000:2.0:1777497722.403161:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1777497722.403169:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565025920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403215:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565025920:12345-0@lo:400:kworker.0 Request processed in 47us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497722.403222:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2651 00000100:00100000:2.0:1777497722.403238:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1777497722.403244:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565026048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403269:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565026048:12345-0@lo:400:kworker.0 Request processed in 26us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497722.403275:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2652 00000100:00100000:2.0:1777497722.403303:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565025664:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403327:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497722.403346:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497722.403350:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565025408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403369:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497722.403393:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025664 00000100:00100000:2.0:1777497722.403397:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025664 00000100:00100000:2.0:1777497722.403422:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025408 00000100:00100000:2.0:1777497722.403424:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025408 00000100:00100000:2.0:1777497722.403438:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1777497722.403444:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565025664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403486:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565025664:12345-0@lo:400:kworker.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497722.403492:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1777497722.403504:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1777497722.403509:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565025408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403541:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565025408:12345-0@lo:400:kworker.0 Request processed in 33us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497722.403547:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:2.0:1777497722.403590:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565025408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403600:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565025664:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403624:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565026048:0@lo:400:kworker.0 00000100:00100000:2.0:1777497722.403633:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565025920:0@lo:400:kworker.0 00000100:00100000:1.0:1777497722.403716:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565021184:0@lo:400:kworker.0 00000100:00100000:3.0:1777497722.404369:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837565025152:0@lo:250:kworker.0 00000400:00000100:3.0:1777497722.404400:0:3656:0:(lib-move.c:4517:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1863837565025152 offset 0 length 520: 4 00000100:00100000:3.0:1777497722.404428:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565025280:0@lo:38:kworker.0 00000100:00100000:3.0:1777497722.404451:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497722.404619:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565025536:0@lo:38:kworker.0 00000100:00100000:3.0:1777497722.404641:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497722.404661:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565025792:0@lo:38:kworker.0 00000100:00100000:3.0:1777497722.404699:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497722.404717:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565026176:0@lo:38:kworker.0 00000100:00100000:3.0:1777497722.404737:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497722.404769:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025280 00000100:00100000:3.0:1777497722.404775:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025280 00000100:00100000:3.0:1777497722.404799:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025536 00000100:00100000:3.0:1777497722.404801:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025536 00000100:00100000:3.0:1777497722.404812:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026176 00000100:00100000:3.0:1777497722.404814:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026176 00000100:00100000:3.0:1777497722.404827:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1777497722.404833:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565025280:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497722.404852:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497722.404887:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565025280:12345-0@lo:38:kworker.0 Request processed in 53us (435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497722.404894:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1777497722.404908:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1777497722.404912:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565025536:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497722.404922:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497722.404944:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565025536:12345-0@lo:38:kworker.0 Request processed in 31us (302us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497722.404949:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:3.0:1777497722.404960:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1777497722.404964:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565026176:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497722.404972:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497722.404993:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565026176:12345-0@lo:38:kworker.0 Request processed in 27us (255us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497722.405006:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:3.0:1777497722.405025:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565025792 00000100:00100000:3.0:1777497722.405028:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565025792 00000100:00100000:3.0:1777497722.405047:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4062 00000100:00100000:3.0:1777497722.405051:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565025792:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497722.405060:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497722.405086:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565025792:12345-0@lo:38:kworker.0 Request processed in 33us (387us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497722.405091:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4062 00000100:00080000:3.0:1777497722.405152:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497722.405157:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497722.405161:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565025280:0@lo:38:kworker.0 00000100:00080000:3.0:1777497722.405169:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497722.405172:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497722.405175:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565025536:0@lo:38:kworker.0 00000100:00080000:3.0:1777497722.405182:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497722.405185:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497722.405187:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565025792:0@lo:38:kworker.0 00000100:00080000:3.0:1777497722.405194:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497722.405197:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497722.405199:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565026176:0@lo:38:kworker.0 00010000:00010000:0.0:1777497723.047602:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497723.709893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497723.709932:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497723.709973:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497723.710044:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357248 00000100:00100000:2.0:1777497723.710054:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357248 00000100:00100000:2.0:1777497723.710118:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357376 00000100:00100000:2.0:1777497723.710121:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357376 00000100:00100000:2.0:1777497723.710164:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1374 00000100:00100000:2.0:1777497723.710174:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2414:x1863837546357376:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497723.710238:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2414:x1863837546357376:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 67us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497723.710244:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1374 00000100:00100000:2.0:1777497723.710259:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1423 00000100:00100000:2.0:1777497723.710262:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546357248:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:2.0:1777497723.710281:0:64885:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497723.710306:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2411:x1863837546357248:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 42us (423us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497723.710311:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1423 00000100:00100000:2.0:1777497723.710327:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357504 00000100:00100000:2.0:1777497723.710337:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357504 00000100:00100000:2.0:1777497723.710368:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5897 00000100:00100000:2.0:1777497723.710374:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546357504:12345-192.168.202.4@tcp:9:kworker.0 00000020:00000080:2.0:1777497723.710392:0:23437:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691dbb0 00000100:00080000:2.0:1777497723.710399:0:23437:0:(import.c:65:import_set_state_nolock()) ffff9240bb784000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1777497723.710437:0:23437:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294969454 00000100:00100000:2.0:1777497723.710564:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+2:2411:x1863837546357504:12345-192.168.202.4@tcp:9:kworker.0 Request processed in 190us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497723.710570:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5897 00000100:00080000:2.0:1777497723.710585:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497723.710589:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1777497723.710713:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497724.067300:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497724.965468:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497724.965500:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565026304:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497724.965600:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497724.965670:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026304 00000100:00100000:2.0:1777497724.965680:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026304 00000100:00100000:2.0:1777497724.965762:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:2.0:1777497724.965777:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565026304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497724.965819:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497724.965872:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565026304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 100us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497724.965879:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00080000:2.0:1777497724.965904:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497724.965951:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565026304:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497724.967549:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497724.967572:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565026432:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497724.967658:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497724.972251:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026432 00000100:00100000:0.0:1777497724.972282:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026432 00000100:00100000:0.0:1777497724.972401:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1777497724.972416:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565026432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497724.972493:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497724.972632:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565026432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 220us (4973us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497724.972640:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1777497724.972712:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565026432:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497724.973749:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497725.091692:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1777497725.563762:0:90568:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1777497725.563767:0:90568:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1777497725.563769:0:90568:0:(obd_mount.c:920:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1777497725.563881:0:90568:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff92409c468800 00000020:01000004:3.0:1777497725.563897:0:90568:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1777497725.563912:0:90568:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1777497725.563926:0:90568:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9240a62ecd40) 00000020:00000080:3.0:1777497725.563942:0:90568:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1777497725.733136:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1777497725.734080:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1777497725.744523:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.747060:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.747468:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.748008:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.748286:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.748728:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.749757:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.750174:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1777497725.750530:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.750975:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.751813:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.752056:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.753256:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.755075:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1777497725.755321:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1777497725.755551:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1777497725.756009:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.756420:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.756932:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.757163:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.757371:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.758005:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.758307:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.758543:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.759021:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.759320:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.759878:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.760168:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.760464:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.760803:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.761156:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.761365:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.761925:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.762285:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.762834:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.763127:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.763482:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.763906:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.765404:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.766642:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.768879:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.770056:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.770921:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1777497725.771255:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1777497725.771552:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1777497725.776006:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.780754:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.782580:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.782831:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x50:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.782867:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x51:0x0] (8/32) registered 00100000:10000000:0.0:1777497725.782890:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x52:0x0] (8/32) registered 00100000:10000000:2.0:1777497725.787743:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1777497725.793305:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1777497725.793857:0:90568:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1777497725.796257:0:90568:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1777497725.796508:0:90568:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1777497725.796517:0:90568:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000080:3.0:1777497725.796528:0:90568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dcd6 00000020:01000004:3.0:1777497725.796536:0:90568:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1777497725.796549:0:90568:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1777497725.796554:0:90568:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92409c468800 from MGS 00000020:01000004:3.0:1777497725.796557:0:90568:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1777497725.796566:0:90568:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9240a62eb380) 00000020:00000080:3.0:1777497725.796577:0:90568:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mgs with refcount 2 00000020:01000004:3.0:1777497725.796635:0:90568:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92409c468800 from MGS, refs=2 00080000:01000000:3.0:1777497725.796640:0:90568:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000080:3.0:1777497725.796645:0:90568:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dce4 00010000:00010000:3.0:1777497725.796761:0:90568:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-MGS-3 is initialized 00000040:01000000:3.0:1777497725.805558:0:90568:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1777497725.806782:0:90572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1777497725.806829:0:90568:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1777497725.806868:0:90568:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1777497725.807969:0:90568:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1777497725.808265:0:90568:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1777497725.808439:0:90568:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1777497725.808446:0:90568:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1777497725.809363:0:90568:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1777497725.809372:0:90568:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1777497725.810271:0:90568:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1777497725.810280:0:90568:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1777497725.810852:0:90568:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1777497725.810876:0:90568:0:(obd_mount.c:383:lustre_start_mgc()) New MGS with live MGC 00000020:01000004:2.0:1777497725.810877:0:90568:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 2 10000000:01000000:2.0:1777497725.810880:0:90568:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 2/d0:i1:r0:or0:CONNECTING 00000100:00080000:2.0:1777497725.810886:0:90568:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 72, was 0): CONNECTING 00000100:00100000:2.0:1777497725.810891:0:90568:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00010000:00010000:1.0:1777497726.115175:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497727.138865:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497727.523158:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497727.523165:0:38121:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1777497727.523168:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497727.523172:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497727.523177:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497727.523186:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3851 00000100:00080000:1.0:1777497727.523192:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497727.523215:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497727.523256:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839ff800 x1863837565026560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497727.523319:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497727.523323:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497727.523325:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497727.523328:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3851 00000100:00080000:1.0:1777497727.523331:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497727.523334:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497727.523357:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fd180 x1863837565026816/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497727.523373:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497727.523376:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497727.523378:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497727.523381:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3851 00000100:00080000:1.0:1777497727.523384:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497727.523387:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497727.523400:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f839fd880 x1863837565027072/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497727.523441:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497727.523444:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497727.523446:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497727.523449:0:38121:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3851 00000100:00080000:1.0:1777497727.523452:0:38121:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497727.523461:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497727.523475:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a3adc700 x1863837565027456/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497727.523581:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565026688:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.523649:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497727.523706:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497727.523712:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565026944:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.523734:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497727.523766:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565027200:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.523798:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497727.523826:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497727.523833:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565027328:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.523861:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497727.523892:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026688 00000100:00100000:0.0:1777497727.523901:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026688 00000100:00100000:0.0:1777497727.523951:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026944 00000100:00100000:0.0:1777497727.523954:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026944 00000100:00100000:0.0:1777497727.523978:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1777497727.523987:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.524042:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565026688:12345-0@lo:400:kworker.0 Request processed in 55us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497727.524049:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:0.0:1777497727.524068:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1777497727.524074:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565026944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.524152:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565026944:12345-0@lo:400:kworker.0 Request processed in 79us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497727.524158:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1777497727.524202:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565026944:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.524213:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565026688:0@lo:400:kworker.0 00000100:00100000:3.0:1777497727.526966:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027200 00000100:00100000:3.0:1777497727.526980:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027200 00000100:00100000:3.0:1777497727.527167:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027328 00000100:00100000:3.0:1777497727.527171:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027328 00000100:00100000:3.0:1777497727.527202:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1777497727.527213:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565027200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497727.527311:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565027200:12345-0@lo:400:kworker.0 Request processed in 100us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497727.527331:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2653 00000100:00100000:3.0:1777497727.527349:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2654 00000100:00100000:3.0:1777497727.527355:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497727.527383:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565027328:12345-0@lo:400:kworker.0 Request processed in 29us (3521us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497727.527388:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2654 00000100:00100000:2.0:1777497727.527934:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565026560:0@lo:38:kworker.0 00000100:00100000:2.0:1777497727.527982:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497727.528015:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565026816:0@lo:38:kworker.0 00000100:00100000:2.0:1777497727.528036:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497727.528054:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565027072:0@lo:38:kworker.0 00000100:00100000:2.0:1777497727.528080:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497727.528127:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565027456:0@lo:38:kworker.0 00000100:00100000:2.0:1777497727.528150:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497727.528195:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497727.528208:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497727.528212:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497727.528226:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027072 00000100:00100000:2.0:1777497727.528231:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027072 00000100:00100000:2.0:1777497727.528258:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4063 00000100:00100000:2.0:1777497727.528263:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565027072:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1777497727.528286:0:8407:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1777497727.528323:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565027072:12345-0@lo:38:kworker.0 Request processed in 59us (241us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497727.528329:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4063 00000100:00080000:2.0:1777497727.528408:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497727.528424:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497727.528428:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565027072:0@lo:38:kworker.0 00000100:00100000:3.0:1777497727.528806:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026560 00000100:00100000:3.0:1777497727.528812:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026560 00000100:00100000:3.0:1777497727.528847:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565026816 00000100:00100000:3.0:1777497727.528850:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565026816 00000100:00100000:3.0:1777497727.528863:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027456 00000100:00100000:3.0:1777497727.528866:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027456 00000100:00100000:3.0:1777497727.528877:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1777497727.528882:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565026560:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497727.528896:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497727.528935:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565026560:12345-0@lo:38:kworker.0 Request processed in 52us (953us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497727.528940:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1777497727.528951:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1777497727.528955:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565026816:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497727.528963:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497727.528980:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565026816:12345-0@lo:38:kworker.0 Request processed in 24us (943us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497727.528985:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1777497727.528995:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1777497727.528998:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565027456:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497727.529017:0:63729:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497727.529041:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3656:x1863837565027456:12345-0@lo:38:kworker.0 Request processed in 41us (890us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497727.529047:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:0.0:1777497727.530763:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565027328:0@lo:400:kworker.0 00000100:00100000:0.0:1777497727.530786:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565027200:0@lo:400:kworker.0 00000100:00080000:2.0:1777497727.531512:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497727.531523:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497727.531528:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565026560:0@lo:38:kworker.0 00000100:00080000:2.0:1777497727.531542:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497727.531546:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497727.531564:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565026816:0@lo:38:kworker.0 00000100:00080000:2.0:1777497727.531581:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497727.531584:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1777497727.531587:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565027456:0@lo:38:kworker.0 00010000:00010000:2.0:1777497728.164704:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497728.837376:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497728.837664:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357888 00000100:00100000:3.0:1777497728.837679:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357888 00000100:00100000:3.0:1777497728.837864:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1377 00000100:00100000:3.0:1777497728.837879:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546357888:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497728.838013:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546357888:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 138us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497728.838022:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1377 00000100:00080000:2.0:1777497728.840318:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497728.845434:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497728.845570:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497728.846066:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357632 00000100:00100000:1.0:1777497728.846082:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357632 00000100:00100000:1.0:1777497728.846321:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:1.0:1777497728.846332:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2411:x1863837546357632:12345-192.168.202.4@tcp:250:kworker.0 00010000:00080000:1.0:1777497728.846382:0:90573:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp t0 exp 0000000000000000 cur 3858 last 0 00000020:00000080:1.0:1777497728.846432:0:90573:0:(genops.c:1406:class_connect()) connect: client 34a4158d-137e-4629-9769-4a4bd53f7f61, cookie 0x3e357265691dceb 00000100:00080000:1.0:1777497728.846844:0:90573:0:(import.c:65:import_set_state_nolock()) ffff9240bb782800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497728.846945:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+4:2411:x1863837546357632:12345-192.168.202.4@tcp:250:kworker.0 Request processed in 614us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497728.846954:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 0 00000100:00100000:0.0:1777497728.848035:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546357760 00000100:00100000:0.0:1777497728.848049:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546357760 00000100:00100000:0.0:1777497728.848142:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1427 00000100:00100000:0.0:1777497728.848151:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546357760:12345-192.168.202.4@tcp:38:kworker.0 00010000:00020000:0.0:1777497728.848183:0:63728:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497728.848251:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2411:x1863837546357760:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 100us (2680us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497728.848259:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1427 00010000:00010000:2.0:1777497729.197959:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1777497729.584302:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:0.0:1777497729.584315:0:9460:0:(genops.c:906:class_export_put()) final put ffff9240bb785000/d146155b-4321-4b14-9284-f644ed9631fb 00000020:00000080:3.0:1777497729.584683:0:82203:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bb785000/d146155b-4321-4b14-9284-f644ed9631fb for lustre-OST0001 00000020:00000080:3.0:1777497729.584845:0:82203:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240bb784000 for lustre-OST0001 00000100:00100000:1.0:1777497730.083174:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565027584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497730.083282:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497730.083651:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027584 00000100:00100000:0.0:1777497730.083664:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027584 00000100:00100000:0.0:1777497730.083743:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:0.0:1777497730.083756:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565027584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497730.083799:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497730.083860:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565027584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497730.083887:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:0.0:1777497730.083966:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565027584:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497730.084119:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497730.086228:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497730.096248:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565027712:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497730.099042:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497730.105972:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027712 00000100:00100000:0.0:1777497730.105993:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027712 00000100:00100000:0.0:1777497730.106205:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:0.0:1777497730.106221:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565027712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497730.106267:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497730.106409:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565027712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 193us (8501us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497730.106416:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00080000:1.0:1777497730.106500:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497730.107898:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565027712:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1777497730.211890:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497730.755065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497730.755866:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358016 00000100:00100000:3.0:1777497730.755882:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358016 00000100:00100000:3.0:1777497730.755966:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:3.0:1777497730.755977:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+4:70262:x1863837546358016:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497730.755999:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497730.756024:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c447 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497730.756060:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 5 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497730.756073:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 5 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497730.756147:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b200, rc 0) 00000100:00100000:3.0:1777497730.756697:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546358016:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 718us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497730.756719:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1 00000100:00100000:0.0:1777497730.763644:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497730.763947:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358144 00000100:00100000:1.0:1777497730.763963:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358144 00000100:00100000:1.0:1777497730.764032:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:1.0:1777497730.764043:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546358144:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 00000100:00100000:1.0:1777497730.764170:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546358144:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 128us (540us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497730.764193:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2 00000100:00100000:2.0:1777497730.790074:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497730.791063:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358272 00000100:00100000:1.0:1777497730.791077:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358272 00000100:00100000:1.0:1777497730.791173:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:1.0:1777497730.791183:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+5:70262:x1863837546358272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497730.791205:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497730.791238:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c44e expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497730.791271:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 6 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497730.791281:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 6 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497730.791290:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cbc00, rc 0) 00000100:00100000:1.0:1777497730.791378:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70262:x1863837546358272:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 195us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497730.791395:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 3 00000100:00100000:2.0:1777497730.800858:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497730.801312:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358400 00000100:00100000:3.0:1777497730.801327:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358400 00000100:00100000:3.0:1777497730.802242:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:3.0:1777497730.802259:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+6:70262:x1863837546358400:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 10000000:01000000:3.0:1777497730.806144:0:90578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1777497730.806311:0:90575:0:(mgs_nids.c:664:mgs_nidtbl_init_fs()) IR: current version is 120 20000000:01000000:1.0:1777497730.811613:0:90579:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1777497730.811625:0:90579:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1777497730.811628:0:90579:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1777497730.811631:0:90579:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1777497730.811660:0:90579:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 20000000:01000000:2.0:1777497730.812310:0:90575:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1777497730.813339:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546358400:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 11073us (12486us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497730.813368:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 4 00000100:00100000:0.0:1777497730.819284:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497730.819646:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358528 00000100:00100000:2.0:1777497730.819660:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358528 00000100:00100000:2.0:1777497730.819749:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:2.0:1777497730.819760:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546358528:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497730.819987:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546358528:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 228us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497730.819996:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5 00000100:00100000:1.0:1777497730.831290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497730.831788:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358656 00000100:00100000:2.0:1777497730.831804:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358656 00000100:00100000:2.0:1777497730.831883:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:2.0:1777497730.831895:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546358656:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497730.831927:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497730.831956:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fe000/0x3e357265691dd00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c455 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.831991:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fe000/0x3e357265691dd00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c455 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.832003:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fe000/0x3e357265691dd00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c455 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.832030:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe000, rc 0) 00000100:00100000:2.0:1777497730.832137:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546358656:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 244us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497730.832144:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6 00000100:00100000:3.0:1777497730.844248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497730.846828:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358784 00000100:00100000:1.0:1777497730.846851:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358784 00000100:00100000:1.0:1777497730.846980:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:1.0:1777497730.846993:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546358784:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497730.847286:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546358784:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 294us (3048us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497730.847295:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 7 00000100:00100000:0.0:1777497730.855018:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497730.855251:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546358912 00000100:00100000:1.0:1777497730.855266:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546358912 00000100:00100000:1.0:1777497730.855349:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:1.0:1777497730.855368:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546358912:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497730.855610:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546358912:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 245us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497730.855619:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 8 00000100:00100000:3.0:1777497730.876611:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497730.877293:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359040 00000100:00100000:2.0:1777497730.877308:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359040 00000100:00100000:2.0:1777497730.877551:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1777497730.877564:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546359040:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497730.877586:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497730.877611:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c45c expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.877652:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.877665:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497730.877677:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fea00, rc 0) 00000100:00100000:2.0:1777497730.878159:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359040:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 595us (1560us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497730.878168:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 9 00000100:00100000:2.0:1777497730.893397:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497730.893865:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359168 00000100:00100000:3.0:1777497730.893882:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359168 00000100:00100000:3.0:1777497730.893959:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 10 00000100:00100000:3.0:1777497730.893971:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359168:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497730.894166:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359168:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 197us (799us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497730.894175:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 10 00010000:00010000:1.0:1777497731.234894:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497732.260830:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497732.642549:0:3656:0:(client.c:2479:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1777497722/real 1777497722] req@ffff923f82d41500 x1863837565025152/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497732 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497732.642591:0:3656:0:(client.c:2510:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff923f82d41500 x1863837565025152/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1777497732 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497732.642618:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497732.642646:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1777497732.642664:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837565025152:0@lo:250:kworker.0 10000000:01000000:2.0:1777497732.642836:0:90568:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00010000:00010000:2.0:1777497732.642861:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.642913:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.642922:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1777497732.642950:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.642962:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691d5eb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d5f2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.642984:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.642990:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.642995:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.642999:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643003:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691d9e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d9f0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643011:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643016:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643021:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643024:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643027:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691d9f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d9fe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643049:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643055:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643060:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643064:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643067:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5a000/0x3e357265691da05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691da0c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643076:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643082:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643087:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643089:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643157:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240baa5aa00/0x3e357265691da13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691da1a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643169:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643175:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643180:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643191:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643195:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffa00/0x3e357265691da21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691da28 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643204:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643210:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643215:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643219:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643222:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691da36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691da3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643230:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643236:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643241:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643244:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643247:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef600/0x3e357265691da44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691da4b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643258:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643265:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643279:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643283:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643288:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f82fd8800/0x3e357265691d558 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d55f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643302:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643308:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643312:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497732.643315:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643318:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691d574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d57b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643329:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643335:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643340:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497732.643344:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643347:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902a600/0x3e357265691d582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d589 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643357:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643388:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643394:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497732.643398:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643402:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691d5ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d5b3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.643412:0:90568:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110e400000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497732.643418:0:90568:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x110f400000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.643423:0:90568:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1777497732.643427:0:90568:0:(ldlm_request.c:1407:ldlm_cli_cancel_local()) not sending request (at caller's instruction) 00010000:00010000:2.0:1777497732.643429:0:90568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924087d39a00/0x3e357265691d5dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x590f400000000 nid: local remote: 0x3e357265691d5e4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1777497732.643449:0:90568:0:(import.c:213:ptlrpc_set_import_discon()) mgc: import ffff92408395a800 already not connected (conn 72, was 0): DISCONN 00000100:00080000:2.0:1777497732.643456:0:90568:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497732.643462:0:90568:0:(import.c:509:import_select_connection()) MGC192.168.202.104@tcp: connect to NID 0@lo last attempt 3851 00000100:00080000:2.0:1777497732.643469:0:90568:0:(import.c:588:import_select_connection()) MGC192.168.202.104@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1777497732.643477:0:90568:0:(import.c:623:import_select_connection()) MGC192.168.202.104@tcp: import ffff92408395a800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:2.0:1777497732.644683:0:90568:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f82d42a00 x1863837565027840/t0(0) o250->MGC192.168.202.104@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1777497732.644714:0:90568:0:(recover.c:338:ptlrpc_recover_import()) MGS: recovery started, waiting 20 seconds 00000100:00100000:3.0:1777497732.644830:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837565027840:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1777497732.644944:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497732.645326:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level CONNECTING/4 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497732.645332:0:82203:0:(pinger.c:247:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1777497732.645335:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497732.645341:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497732.645344:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497732.645350:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1777497732.645355:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497732.645375:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.645400:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f840db480 x1863837565027968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497732.645439:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497732.645457:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497732.645459:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497732.645472:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1777497732.645475:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497732.645479:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.645498:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8f100 x1863837565028224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497732.645513:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497732.645517:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497732.645519:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497732.645522:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1777497732.645525:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497732.645528:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.645537:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240bcc8e300 x1863837565028480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497732.645573:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1777497732.645576:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1777497732.645578:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1777497732.645582:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3856 00000100:00080000:1.0:1777497732.645584:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1777497732.645587:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.645595:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de1500 x1863837565028864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497732.645621:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565028352:0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.645673:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.645702:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497732.645707:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565028096:0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.645726:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.645747:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565028736:0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.645770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.645787:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497732.645791:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565028608:0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.645808:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.645839:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028736 00000100:00100000:1.0:1777497732.645848:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028736 00000100:00100000:1.0:1777497732.645914:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028608 00000100:00100000:1.0:1777497732.645917:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028608 00000100:00100000:1.0:1777497732.645938:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1777497732.645948:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565028736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.645999:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565028736:12345-0@lo:400:kworker.0 Request processed in 53us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.646006:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2655 00000100:00100000:1.0:1777497732.646021:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2656 00000100:00100000:1.0:1777497732.646026:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565028608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.646046:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565028608:12345-0@lo:400:kworker.0 Request processed in 20us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.646052:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2656 00000100:00080000:1.0:1777497732.646066:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497732.646070:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497732.646132:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565028608:0@lo:400:kworker.0 00000100:00100000:1.0:1777497732.646142:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565028736:0@lo:400:kworker.0 00000100:00100000:3.0:1777497732.646605:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565027968:0@lo:38:kworker.0 00000100:00100000:3.0:1777497732.646642:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.646671:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565028224:0@lo:38:kworker.0 00000100:00100000:3.0:1777497732.646701:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.646717:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565028480:0@lo:38:kworker.0 00000100:00100000:3.0:1777497732.646738:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.646752:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565028864:0@lo:38:kworker.0 00000100:00100000:3.0:1777497732.646768:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.646795:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028352 00000100:00100000:3.0:1777497732.646800:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028352 00000100:00100000:3.0:1777497732.646837:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028096 00000100:00100000:3.0:1777497732.646839:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028096 00000100:00100000:3.0:1777497732.646850:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027968 00000100:00100000:3.0:1777497732.646852:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027968 00000100:00100000:3.0:1777497732.646861:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028224 00000100:00100000:3.0:1777497732.646862:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028224 00000100:00100000:3.0:1777497732.646868:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028864 00000100:00100000:3.0:1777497732.646870:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028864 00000100:00100000:3.0:1777497732.646892:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1777497732.646898:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565028352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497732.646938:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565028352:12345-0@lo:400:kworker.0 Request processed in 40us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.646943:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1777497732.646957:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1777497732.646962:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565028096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497732.646983:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565028096:12345-0@lo:400:kworker.0 Request processed in 21us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.646988:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:3.0:1777497732.646997:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1777497732.647000:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565027968:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497732.647029:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497732.647056:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565027968:12345-0@lo:38:kworker.0 Request processed in 54us (414us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497732.647063:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:3.0:1777497732.647073:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1777497732.647076:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565028224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497732.647085:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497732.647136:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565028224:12345-0@lo:38:kworker.0 Request processed in 58us (434us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497732.647141:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1777497732.647150:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1777497732.647154:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565028864:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497732.647162:0:63727:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497732.647178:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3656:x1863837565028864:12345-0@lo:38:kworker.0 Request processed in 23us (409us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497732.647183:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1777497732.647201:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028480 00000100:00100000:3.0:1777497732.647204:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028480 00000100:00100000:3.0:1777497732.647222:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4064 00000100:00100000:3.0:1777497732.647226:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565028480:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1777497732.647235:0:80394:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1777497732.647254:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565028480:12345-0@lo:38:kworker.0 Request processed in 27us (515us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497732.647259:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4064 00000100:00080000:3.0:1777497732.647280:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497732.647312:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565028096:0@lo:400:kworker.0 00000100:00100000:3.0:1777497732.647324:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565028352:0@lo:400:kworker.0 00000100:00080000:3.0:1777497732.647353:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497732.647358:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497732.647377:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565027968:0@lo:38:kworker.0 00000100:00080000:3.0:1777497732.647385:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497732.647389:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497732.647392:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565028224:0@lo:38:kworker.0 00000100:00080000:3.0:1777497732.647398:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497732.647401:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497732.647404:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565028480:0@lo:38:kworker.0 00000100:00080000:3.0:1777497732.647410:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497732.647413:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1777497732.647415:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565028864:0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.647894:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565027840 00000100:00100000:2.0:1777497732.647910:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565027840 00000100:00100000:2.0:1777497732.647943:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1777497732.647948:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:3656:x1863837565027840:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1777497732.647967:0:90575:0:(ldlm_lib.c:1431:target_handle_connect()) MGS: connection from 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo t0 exp 0000000000000000 cur 3861 last 0 00000020:00000080:2.0:1777497732.647999:0:90575:0:(genops.c:1406:class_connect()) connect: client 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6, cookie 0x3e357265691dd0e 00000100:00080000:2.0:1777497732.648159:0:90575:0:(import.c:65:import_set_state_nolock()) ffff9240a6375000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497732.648221:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:3656:x1863837565027840:12345-0@lo:250:mount.lustre.0 Request processed in 273us (3279us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.648228:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1777497732.649248:0:3656:0:(client.c:3101:ptlrpc_free_committed()) MGC192.168.202.104@tcp: committing for last_committed 0 gen 28 00000100:00080000:1.0:1777497732.649263:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) MGC192.168.202.104@tcp: connect to target with instance 0 00000100:00080000:1.0:1777497732.649272:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) MGC192.168.202.104@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1777497732.649278:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1777497732.649283:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1777497732.649286:0:3656:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1777497732.649327:0:3656:0:(pinger.c:185:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1777497732.649340:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3656:1863837565027840:0@lo:250:mount.lustre.0 00000020:01000000:3.0:1777497732.649672:0:82203:0:(tgt_mount.c:1581:tgt_import_update()) NID #0: 192.168.202.104@tcp 10000000:01000000:3.0:1777497732.649697:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0000 about 1 new NIDs 00000020:01000004:3.0:1777497732.649701:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497732.649703:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497732.649705:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497732.649706:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497732.649707:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497732.649709:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497732.649711:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497732.649713:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497732.649715:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497732.649764:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0000: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497732.649773:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-OST0001 about 1 new NIDs 00000020:01000004:3.0:1777497732.649775:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497732.649782:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497732.649784:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497732.649785:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497732.649786:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497732.649787:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497732.649788:0:82203:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497732.649790:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497732.649790:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497732.649806:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-OST0001: notify about 1 NIDs, rc = 0 10000000:01000000:3.0:1777497732.649811:0:82203:0:(mgc_request_server.c:464:mgc_set_info_async_server()) NID notify for lustre-MDT0001 about 1 new NIDs 00000020:01000004:3.0:1777497732.649813:0:82203:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: req 00000020:01000004:3.0:1777497732.649814:0:82203:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1777497732.649815:0:82203:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497732.649816:0:82203:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497732.649817:0:82203:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497732.649818:0:82203:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497732.649819:0:82203:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1777497732.649821:0:82203:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497732.649822:0:82203:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:01000000:3.0:1777497732.649848:0:82203:0:(tgt_mount.c:1592:tgt_import_update()) lustre-MDT0001: notify about 1 NIDs, rc = 0 00000100:00100000:3.0:1777497732.649973:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565029248:0@lo:253:kworker.0 00000100:00100000:3.0:1777497732.650068:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.650129:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565028992:0@lo:253:kworker.0 00000100:00100000:3.0:1777497732.650154:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565029120:0@lo:253:kworker.0 00000100:00100000:0.0:1777497732.650170:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.650184:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.650212:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029248 00000100:00100000:3.0:1777497732.650219:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029248 00000100:00100000:0.0:1777497732.650221:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565028992 00000100:00100000:0.0:1777497732.650230:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565028992 00000100:00100000:3.0:1777497732.650254:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029120 00000100:00100000:3.0:1777497732.650256:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029120 00000100:00100000:0.0:1777497732.650260:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1777497732.650267:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777497732.650267:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3657:x1863837565029248:12345-0@lo:253:kworker.0 00000100:00100000:3.0:1777497732.650272:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:3659:x1863837565028992:12345-0@lo:253:kworker.0 20000000:01000000:3.0:1777497732.650305:0:90574:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1777497732.650305:0:90575:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00080000:2.0:1777497732.650745:0:90568:0:(recover.c:349:ptlrpc_recover_import()) MGS: recovery finished FULL, rc = 0 00000020:01000004:2.0:1777497732.650760:0:90568:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1777497732.650805:0:90568:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1777497732.650813:0:90568:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1777497732.650967:0:90568:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 00000020:01000004:2.0:1777497732.651008:0:90568:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1777497732.651012:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1777497732.651014:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.651015:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.651016:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.651017:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.651019:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.651020:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.651022:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.651023:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.651024:0:90568:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497732.651028:0:90568:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1777497732.651030:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497732.651031:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.651032:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.651033:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.651034:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.651035:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.651036:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.651037:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.651042:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.651043:0:90568:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497732.651062:0:90568:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1777497732.651076:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029376:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777497732.651166:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.651194:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4aa80 going to sleep for 11 seconds 20000000:01000000:3.0:1777497732.658340:0:90574:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1777497732.665810:0:90573:0:(service.c:3443:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:1.0:1777497732.665841:0:90573:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:1.0:1777497732.667901:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029376 00000100:00100000:1.0:1777497732.667917:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029376 00000100:00100000:2.0:1777497732.668238:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1777497732.668254:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3660:x1863837565029120:12345-0@lo:253:kworker.0 20000000:01000000:2.0:1777497732.668298:0:90580:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1777497732.672216:0:90574:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497732.672246:0:90574:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1777497732.672895:0:90575:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777497732.675058:0:90578:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1777497732.675072:0:90578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1777497732.675149:0:90578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.675175:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.675185:0:90578:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.675245:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.675262:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 8 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497732.675280:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565029504:192.168.202.4@tcp:104: 00000100:00100000:3.0:1777497732.675405:0:90578:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d49a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497732.675540:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3659:x1863837565028992:12345-0@lo:253:kworker.0 Request processed in 25263us (25365us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.675552:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1777497732.675619:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1777497732.675633:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:90568:x1863837565029376:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777497732.675684:0:90574:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1777497732.675689:0:90574:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1777497732.675692:0:90574:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 20000000:01000000:0.0:1777497732.675700:0:90574:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000020:01000004:1.0:1777497732.681788:0:3659:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:1.0:1777497732.681798:0:3659:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1777497732.681800:0:3659:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497732.681802:0:3659:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497732.681803:0:3659:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497732.681807:0:3659:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497732.681809:0:3659:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1777497732.681811:0:3659:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497732.681813:0:3659:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1777497732.681822:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565028992:0@lo:253:kworker.0 00000100:00100000:1.0:1777497732.682975:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:90568:x1863837565029376:12345-0@lo:253:mount.lustre.0 Request processed in 7339us (31800us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.682992:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1777497732.683152:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029376:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497732.683171:0:90568:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497732.683174:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497732.683176:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.683177:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.683179:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.683180:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.683182:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.683183:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.683184:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.683186:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.683187:0:90568:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1777497732.683217:0:90568:0:(tgt_mount.c:101:server_register_mount()) register mount ffff92409c468800 from lustre-MDT0000 10000000:01000000:2.0:1777497732.683262:0:90568:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1777497732.683265:0:90568:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1777497732.683277:0:90568:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff92409c468800 10000000:01000000:2.0:1777497732.683286:0:90568:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1777497732.683293:0:90568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff92409c468800 10000000:01000000:2.0:1777497732.683296:0:90568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1777497732.683300:0:90568:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff92409c468800 from 1 10000000:01000000:2.0:1777497732.683303:0:90568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1777497732.683374:0:90568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.683406:0:90568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.683418:0:90568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.683445:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497732.683500:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.683547:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4ac00 going to sleep for 11 seconds 20000000:01000000:0.0:1777497732.683887:0:90575:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1777497732.683893:0:90575:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1777497732.684088:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029632 00000100:00100000:1.0:1777497732.684146:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029632 00000100:00100000:1.0:1777497732.684200:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777497732.684210:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:90568:x1863837565029632:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497732.684227:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497732.684246:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896cac00/0x3e357265691dd23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691dd1c expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684285:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896cac00/0x3e357265691dd23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dd1c expref: 7 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684297:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896cac00/0x3e357265691dd23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dd1c expref: 7 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684307:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896cac00, rc 0) 00000100:00100000:1.0:1777497732.684373:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90568:x1863837565029632:12345-0@lo:101:mount.lustre.0 Request processed in 154us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.684379:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1777497732.684421:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497732.684436:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd23 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684446:0:90568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dd23 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497732.684754:0:90568:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1777497732.684766:0:90568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd23 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684774:0:90568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff800/0x3e357265691dd1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd23 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497732.684782:0:90568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1777497732.684788:0:90568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1777497732.684793:0:90568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff92409c468800 10000000:01000000:1.0:1777497732.684803:0:90568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1777497732.684806:0:90568:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1777497732.684809:0:90568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497732.684833:0:90568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684841:0:90568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684849:0:90568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497732.684866:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1777497732.684898:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.684909:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.684933:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029760 00000100:00100000:1.0:1777497732.684938:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029760 00000100:00100000:1.0:1777497732.684956:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777497732.684962:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90568:x1863837565029760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497732.684971:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497732.684979:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691dd2a expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.684993:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dd2a expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.685001:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dd2a expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.685008:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896ca800, rc 0) 00000100:00100000:1.0:1777497732.685043:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565029760:12345-0@lo:101:mount.lustre.0 Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.685049:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1777497732.685079:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1777497732.685089:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.685121:0:90568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497732.685183:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497732.685208:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.685216:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.685233:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565029888 00000100:00100000:1.0:1777497732.685237:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565029888 00000100:00100000:1.0:1777497732.685253:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777497732.685259:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565029888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497732.685425:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565029888:12345-0@lo:501:mount.lustre.0 Request processed in 165us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.685431:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1777497732.685465:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565029888:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497732.685494:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565030016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497732.686009:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:3657:x1863837565029248:12345-0@lo:253:kworker.0 Request processed in 35741us (35940us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.686018:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 20000000:01000000:2.0:1777497732.687041:0:90580:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:01000004:0.0:1777497732.688202:0:3657:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:0.0:1777497732.688207:0:3657:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1777497732.688209:0:3657:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:0.0:1777497732.688211:0:3657:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:0.0:1777497732.688212:0:3657:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:0.0:1777497732.688215:0:3657:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:0.0:1777497732.688217:0:3657:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1777497732.688219:0:3657:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1777497732.688221:0:3657:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:0.0:1777497732.688229:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565029248:0@lo:253:kworker.0 00000100:00100000:2.0:1777497732.689090:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497732.689209:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565029504:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497732.689243:0:90578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497732.689559:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.689606:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c1a9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497732.690183:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030016 00000100:00100000:3.0:1777497732.690193:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030016 00000100:00100000:3.0:1777497732.690268:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1777497732.690279:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565030016:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1777497732.690514:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565030016:12345-0@lo:503:mount.lustre.0 Request processed in 237us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.690529:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1777497732.690875:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565030016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497732.691222:0:90581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565030144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.691276:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.691307:0:90581:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.693525:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030144 00000100:00100000:1.0:1777497732.693545:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030144 00000100:00100000:1.0:1777497732.693673:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497732.693686:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90581:x1863837565030144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.695520:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90581:x1863837565030144:12345-0@lo:502:llog_process_th.0 Request processed in 1820us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.695535:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1777497732.696273:0:90581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82d42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565030144:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497732.696337:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.696353:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.696356:0:90581:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777497732.696371:0:90581:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1777497732.696375:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497732.696393:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9240911fb380) 00000020:00000080:1.0:1777497732.696422:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type lod with refcount 2 00000020:00000080:1.0:1777497732.696429:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1777497732.696793:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #2 00000020:00000080:1.0:1777497732.696803:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dd3f 00000020:00000080:1.0:1777497732.697081:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1777497732.697087:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.697092:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.697150:0:90581:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1777497732.697154:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.697159:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.697160:0:90581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1777497732.697164:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497732.697175:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9240911f8000) 00000020:00000080:1.0:1777497732.697192:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdt with refcount 2 00000020:00000080:1.0:1777497732.697196:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1777497732.697198:0:90581:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1777497732.697202:0:90581:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1777497732.697209:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1777497732.697266:0:90581:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92409c468800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1777497732.697282:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9240911fcd40) 00000020:00000080:1.0:1777497732.697292:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type mdd with refcount 2 00000004:01000000:1.0:1777497732.697373:0:90581:0:(lod_dev.c:2289:lod_obd_connect()) connect #0 00000020:00000080:1.0:1777497732.697395:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691dd54 00000100:00100000:0.0:1777497732.699241:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359296 00000100:00100000:0.0:1777497732.699259:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359296 00010000:00010000:0.0:1777497732.699311:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1777497732.699669:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1777497732.699684:0:90581:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1777497732.699695:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3e357265691dd5b 00080000:01000000:1.0:1777497732.699705:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #3 00000020:00000080:1.0:1777497732.699710:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dd62 00000100:00100000:0.0:1777497732.701651:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2573 00000100:00100000:0.0:1777497732.701678:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546359296:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497732.701702:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497732.701714:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701733:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701754:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150b200/0x3e357265691dcf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c447 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701778:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701788:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497732.701808:0:6500:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026738010s 00010000:00010000:0.0:1777497732.701814:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701821:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701829:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701836:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701850:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497732.701856:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701864:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701893:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.701925:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497732.702005:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2415:x1863837546359296:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 340us (12921us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.702013:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2573 20000000:01000000:3.0:1777497732.702250:0:90580:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777497732.702257:0:90580:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1777497732.703957:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:3660:x1863837565029120:12345-0@lo:253:kworker.0 Request processed in 35700us (53762us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.703970:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:01000004:3.0:1777497732.704043:0:3660:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_nid_notify: rep 00000020:01000004:3.0:1777497732.704047:0:3660:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1777497732.704048:0:3660:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497732.704049:0:3660:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497732.704050:0:3660:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497732.704051:0:3660:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497732.704053:0:3660:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497732.704055:0:3660:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497732.704057:0:3660:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:3.0:1777497732.704061:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bc2efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565029120:0@lo:253:kworker.0 00010000:00010000:0.0:1777497732.713712:0:90578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713732:0:90578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713738:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150b000/0x3e357265691dd15 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497732.713757:0:90578:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497732.713761:0:90578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497732.713776:0:90578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713790:0:90578:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1777497732.713809:0:90578:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026738010s 00010000:00010000:0.0:1777497732.713813:0:90578:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713818:0:90578:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713823:0:90578:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713829:0:90578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713833:0:90578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497732.713837:0:90578:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713842:0:90578:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713855:0:90578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713859:0:90578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.713863:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee400/0x3e357265691dd69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.839476:0:90581:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-4 is initialized 00000001:00080000:0.0:1777497732.839645:0:90581:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 111669149699 srv lr: 115964116992 lx: 0 gen 21 00000001:00080000:0.0:1777497732.839688:0:90581:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: d146155b-4321-4b14-9284-f644ed9631fb idx: 2 lr: 0 srv lr: 115964116992 lx: 0 gen 23 00000001:00000004:0.0:1777497732.839714:0:90581:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 115964116992 00000001:00080000:0.0:1777497732.839808:0:90581:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000001:00080000:0.0:1777497732.839860:0:90581:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff92409c7b13c0: xid 1863837565011840, transno 115964117000, client gen 21, slot idx 0 00000001:00080000:0.0:1777497732.839870:0:90581:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff9240a69fff00: xid 1863837546345216, transno 115964116998, client gen 23, slot idx 1 00000001:00080000:0.0:1777497732.839876:0:90581:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff923f82c523c0: xid 1863837546344832, transno 115964116997, client gen 23, slot idx 2 00000001:00080000:0.0:1777497732.839881:0:90581:0:(tgt_lastrcvd.c:2296:tgt_reply_data_init()) lustre-MDT0000: restore reply ffff923f82c52540: xid 1863837565010048, transno 115964116999, client gen 21, slot idx 3 00000020:00000080:0.0:1777497732.840610:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9240aecd99c0) 00000020:00000080:0.0:1777497732.840631:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type qmt with refcount 2 00080000:01000000:0.0:1777497732.840705:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #4 00000020:00000080:0.0:1777497732.840711:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dd85 00000020:00000080:0.0:1777497732.843016:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1777497732.855990:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3e357265691dd8c 00000020:00000080:2.0:1777497732.857641:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1777497732.857655:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497732.857662:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.857664:0:90581:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1777497732.857668:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497732.857671:0:90581:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1777497732.857673:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497732.857674:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497732.857686:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497732.857689:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.857691:0:90581:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497732.857693:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497732.857699:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.857700:0:90581:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1777497732.857705:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1777497732.857753:0:90581:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1777497732.857771:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497732.857774:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.857775:0:90581:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1777497732.857778:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497732.857781:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.857782:0:90581:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1777497732.857784:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1777497732.857790:0:90581:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:00000080:2.0:1777497732.857814:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1777497732.857830:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9240831699c0) 00000020:00000080:2.0:1777497732.857850:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1777497732.857855:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1777497732.857913:0:90581:0:(osp_dev.c:1199:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1777497732.857919:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #5 00000020:00000080:2.0:1777497732.857926:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691dd9a 00010000:00080000:2.0:1777497732.857961:0:90581:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240a3af8000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1777497732.866707:0:90581:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-9 is initialized 00000020:00000080:3.0:1777497732.870715:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1777497732.870730:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1777497732.870769:0:90581:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1777497732.870790:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691dda1 00000100:00080000:3.0:1777497732.870800:0:90581:0:(import.c:509:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1777497732.870806:0:90581:0:(import.c:623:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9240a3af8000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497732.870843:0:90581:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f840d9f80 x1863837565030272/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1777497732.870877:0:90581:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1777497732.870937:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497732.870942:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497732.870944:0:90581:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1777497732.870947:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1777497732.870961:0:90581:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1777497732.870963:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777497732.870965:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1777497732.870967:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1777497732.870969:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497732.870971:0:90581:0:(obd_config.c:1561:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1777497732.870974:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777497732.870979:0:90581:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1777497732.870982:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497732.870984:0:90581:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1777497732.870987:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1777497732.870991:0:90581:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:3.0:1777497732.871013:0:90581:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1777497732.871015:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497732.871028:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9240a62e99c0) 00000020:00000080:3.0:1777497732.871045:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1777497732.871050:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1777497732.871147:0:90581:0:(osp_dev.c:1199:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1777497732.871153:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #6 00000020:00000080:3.0:1777497732.871159:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ddaf 00010000:00080000:3.0:1777497732.871191:0:90581:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240aef6a000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.104@tcp at head 00000100:00100000:2.0:1777497732.871476:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565030272:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1777497732.871551:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.871616:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030272 00000100:00100000:2.0:1777497732.871625:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030272 00000100:00100000:2.0:1777497732.871660:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4065 00000100:00100000:2.0:1777497732.871667:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565030272:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1777497732.871695:0:8407:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3862 last 0 00000020:00000080:2.0:1777497732.871731:0:8407:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ddb6 00000004:00100000:2.0:1777497732.871744:0:8407:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1777497732.871849:0:8407:0:(import.c:65:import_set_state_nolock()) ffff924098a6b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497732.871902:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837565030272:12345-0@lo:38:llog_process_th.0 Request processed in 233us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.871909:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4065 00000100:00100000:2.0:1777497732.871949:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497732.871957:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 19 00000100:00080000:2.0:1777497732.871965:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1777497732.871970:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1777497732.871972:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240a3af8000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1777497732.871979:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565030272:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1777497732.872285:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497732.872290:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497732.872293:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497732.872298:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 3861 00000100:00080000:0.0:1777497732.872301:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497732.872305:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497732.872338:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240af503100 x1863837565030400/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497732.872385:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497732.872389:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497732.872391:0:82203:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497732.872393:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 3861 00000100:00080000:0.0:1777497732.872405:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497732.872408:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497732.872419:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408788bb80 x1863837565030656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497732.872444:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497732.872447:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497732.872449:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497732.872452:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 3861 00000100:00080000:0.0:1777497732.872454:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497732.872457:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497732.872467:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924087889500 x1863837565030912/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1777497732.872496:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497732.872499:0:82203:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1777497732.872501:0:82203:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497732.872503:0:82203:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 3861 00000100:00080000:0.0:1777497732.872506:0:82203:0:(import.c:588:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1777497732.872509:0:82203:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:0.0:1777497732.872519:0:82203:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408788b800 x1863837565031296/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1777497732.872547:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565031168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872583:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.872606:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497732.872612:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565030528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872646:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.872676:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565031040:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872698:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.872713:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497732.872718:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565030784:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872736:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.872762:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031168 00000100:00100000:0.0:1777497732.872768:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031168 00000100:00100000:0.0:1777497732.872794:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031040 00000100:00100000:0.0:1777497732.872797:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031040 00000100:00100000:0.0:1777497732.872814:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1777497732.872820:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565031168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872859:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565031168:12345-0@lo:400:kworker.0 Request processed in 39us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.872864:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2657 00000100:00100000:0.0:1777497732.872876:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1777497732.872882:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565031040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.872909:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565031040:12345-0@lo:400:kworker.0 Request processed in 27us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.872914:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2658 00000100:00100000:0.0:1777497732.872934:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030528 00000100:00100000:0.0:1777497732.872937:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030528 00000100:00100000:0.0:1777497732.872956:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030784 00000100:00100000:0.0:1777497732.872959:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030784 00000100:00100000:0.0:1777497732.872973:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1777497732.872980:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565030528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873009:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565030528:12345-0@lo:400:kworker.0 Request processed in 29us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.873020:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1777497732.873031:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1777497732.873036:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565030784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873059:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565030784:12345-0@lo:400:kworker.0 Request processed in 24us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.873064:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:0.0:1777497732.873113:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565030528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873124:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565031168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873151:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565030784:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873160:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565031040:0@lo:400:kworker.0 00000100:00100000:0.0:1777497732.873196:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497732.873202:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565031424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497732.873229:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.873255:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031424 00000100:00100000:0.0:1777497732.873259:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031424 00000100:00100000:0.0:1777497732.873280:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1777497732.873286:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565031424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497732.873310:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:0.0:1777497732.873339:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565031424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.873345:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4066 00000100:00100000:0.0:1777497732.873387:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565031424:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497732.873869:0:90581:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-10 is initialized 00000100:00100000:2.0:1777497732.874296:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565030400:0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874351:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.874387:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565030656:0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874408:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.874427:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565030912:0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874447:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.874461:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565031296:0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874480:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.874525:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030400 00000100:00100000:2.0:1777497732.874531:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030400 00000100:00100000:2.0:1777497732.874552:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030656 00000100:00100000:2.0:1777497732.874555:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030656 00000100:00100000:2.0:1777497732.874566:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031296 00000100:00100000:2.0:1777497732.874568:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031296 00000100:00100000:2.0:1777497732.874588:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1777497732.874594:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565030400:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874639:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565030400:12345-0@lo:38:kworker.0 Request processed in 45us (288us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497732.874646:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1777497732.874660:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1777497732.874664:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565030656:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874701:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565030656:12345-0@lo:38:kworker.0 Request processed in 35us (291us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497732.874707:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:2.0:1777497732.874718:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1777497732.874722:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565031296:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874746:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565031296:12345-0@lo:38:kworker.0 Request processed in 23us (265us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497732.874752:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1777497732.874776:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565030912 00000100:00100000:2.0:1777497732.874780:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565030912 00000100:00100000:2.0:1777497732.874797:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4067 00000100:00100000:2.0:1777497732.874801:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565030912:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1777497732.874826:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565030912:12345-0@lo:38:kworker.0 Request processed in 24us (379us total) trans 0 rc -11/-11 00000100:00100000:2.0:1777497732.874832:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4067 00000100:00080000:2.0:1777497732.874865:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497732.874869:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777497732.874873:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565030400:0@lo:38:kworker.0 00000100:00080000:2.0:1777497732.874882:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497732.874885:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777497732.874894:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565030656:0@lo:38:kworker.0 00000100:00080000:2.0:1777497732.874905:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497732.874908:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777497732.874911:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565030912:0@lo:38:kworker.0 00000100:00080000:2.0:1777497732.874918:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1777497732.874922:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1777497732.874924:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565031296:0@lo:38:kworker.0 00000040:01000000:3.0:1777497732.877778:0:90581:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1777497732.877817:0:90581:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1777497732.878730:0:90581:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 26, last_idx 27 00000040:00080000:3.0:1777497732.879617:0:90581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497732.879643:0:90581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].28, 64 off9984 00000040:00080000:3.0:1777497732.879778:0:90581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x70:0x0].1, 64 off8256 00000040:00080000:3.0:1777497732.880269:0:90587:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:3.0:1777497732.880273:0:90587:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1777497732.880401:0:90587:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x2:0x0] first idx 27, last_idx 28 00000040:00080000:3.0:1777497732.880415:0:90587:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x6c:0x0] at index 27 of catalog [0x1:0x2:0x0] 00000040:00080000:3.0:1777497732.880531:0:90587:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:3.0:1777497732.880534:0:90587:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x70:0x0] at index 28 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1777497732.881838:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497732.881853:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777497732.881896:0:90581:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1777497732.881917:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ddbd 00000100:00080000:1.0:1777497732.881928:0:90581:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497732.881934:0:90581:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.881971:0:90581:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de2300 x1863837565031552/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497732.882037:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565031552:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497732.882142:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.882260:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031552 00000100:00100000:3.0:1777497732.882268:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031552 00000100:00100000:3.0:1777497732.882305:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5898 00000100:00100000:3.0:1777497732.882312:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3656:x1863837565031552:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1777497732.882349:0:25496:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3862 last 0 00000020:00000080:3.0:1777497732.882385:0:25496:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ddc4 00002000:00100000:3.0:1777497732.882397:0:25496:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9240aef6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1777497732.882400:0:25496:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1777497732.882403:0:25496:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1777497732.882472:0:25496:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1777497732.882493:0:25496:0:(import.c:65:import_set_state_nolock()) ffff9240aef68800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1777497732.882696:0:90581:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1777497732.882762:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.882767:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.882769:0:90581:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1777497732.882772:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1777497732.882774:0:90581:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1777497732.882775:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497732.882777:0:90581:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1777497732.882778:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1777497732.882780:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.882782:0:90581:0:(obd_config.c:1561:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1777497732.882784:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1777497732.882789:0:90581:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1777497732.882791:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.882793:0:90581:0:(obd_config.c:1561:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1777497732.882796:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1777497732.882799:0:90581:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.202.104@tcp to nid 0x20000c0a8ca68 (192.168.202.104@tcp) 00000020:01000000:1.0:1777497732.882819:0:90581:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1777497732.882834:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1777497732.882847:0:90581:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff923f82aacd40) 00000020:00000080:1.0:1777497732.882865:0:90581:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osp with refcount 2 00000020:00000080:1.0:1777497732.882871:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1777497732.882937:0:90581:0:(osp_dev.c:1199:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1777497732.882942:0:90581:0:(osd_handler.c:8910:osd_obd_connect()) connect #7 00000020:00000080:1.0:1777497732.882947:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3e357265691ddd2 00010000:00080000:1.0:1777497732.882970:0:90581:0:(ldlm_lib.c:102:import_set_conn()) imp ffff923f839d2800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497732.883161:0:90581:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-11 is initialized 00000040:01000000:1.0:1777497732.883222:0:90581:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1777497732.883237:0:90581:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1777497732.883704:0:90581:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 26, last_idx 27 00000040:00080000:1.0:1777497732.884699:0:90581:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497732.884724:0:90581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].28, 64 off9984 00000040:00080000:1.0:1777497732.884840:0:90581:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x72:0x0].1, 64 off8256 00000040:00080000:1.0:1777497732.885527:0:90589:0:(llog.c:800:llog_process_thread()) index: 27, lh_last_idx: 28 synced_idx: 0 lgh_last_idx: 28 00000040:00080000:1.0:1777497732.885533:0:90589:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497732.885645:0:90589:0:(llog_cat.c:1210:llog_cat_set_first_idx()) catlog [0x1:0x5:0x0] first idx 27, last_idx 28 00000040:00080000:1.0:1777497732.885659:0:90589:0:(llog_cat.c:1253:llog_cat_cleanup()) cancel plain log [0x1:0x6e:0x0] at index 27 of catalog [0x1:0x5:0x0] 00000040:00080000:1.0:1777497732.885753:0:90589:0:(llog.c:800:llog_process_thread()) index: 28, lh_last_idx: 28 synced_idx: 28 lgh_last_idx: 28 00000040:00080000:1.0:1777497732.885756:0:90589:0:(llog_cat.c:828:llog_cat_process_common()) processing log [0x1:0x72:0x0] at index 28 of catalog [0x1:0x5:0x0] 00000100:00100000:3.0:1777497732.885968:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837565031552:12345-0@lo:8:llog_process_th.0 Request processed in 3648us (3818us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.885978:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5898 00000100:00100000:2.0:1777497732.886491:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497732.886501:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777497732.886508:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777497732.886514:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1777497732.886517:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1777497732.886626:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565031680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497732.886684:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.886734:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031680 00000100:00100000:3.0:1777497732.886740:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031680 00000100:00100000:3.0:1777497732.886781:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1777497732.886789:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565031680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497732.886816:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497732.886852:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565031680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.886859:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00080000:3.0:1777497732.886885:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497732.886908:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565031680:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1777497732.886952:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777497732.886959:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565031552:0@lo:8:llog_process_th.0 00000004:00080000:0.0:1777497732.887133:0:90587:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1777497732.887195:0:90587:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3862228100113ns, next at 0ns, rc = 0 00080000:00080000:0.0:1777497732.887201:0:90587:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1777497732.888857:0:90569:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000020:00000080:1.0:1777497732.889374:0:90581:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1777497732.889386:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1777497732.889425:0:90581:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1777497732.889443:0:90581:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691ddd9 00000100:00080000:1.0:1777497732.889453:0:90581:0:(import.c:509:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497732.889459:0:90581:0:(import.c:623:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff923f839d2800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.889489:0:90581:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de1880 x1863837565031808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497732.889512:0:90581:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1777497732.889569:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.889573:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889575:0:90581:0:(obd_config.c:1561:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1777497732.889577:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.889581:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889582:0:90581:0:(obd_config.c:1561:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1777497732.889584:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1777497732.889586:0:90581:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1777497732.889588:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.889590:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889591:0:90581:0:(obd_config.c:1561:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1777497732.889593:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.889595:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889597:0:90581:0:(obd_config.c:1561:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1777497732.889600:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1777497732.889604:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.889606:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889607:0:90581:0:(obd_config.c:1561:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000020:01000000:1.0:1777497732.889609:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.889612:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.889613:0:90581:0:(obd_config.c:1561:class_process_config()) marker 40 (0x1) lustre-MDT0000-m new lustre.pool_134 00000020:00000080:1.0:1777497732.889616:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1777497732.889652:0:90581:0:(lod_pool.c:475:lod_pool_new()) pool_134 is pool #1 00000100:00100000:1.0:1777497732.889970:0:90581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565031936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.890033:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.890063:0:90581:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497732.890260:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031936 00000100:00100000:3.0:1777497732.890266:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031936 00000100:00100000:3.0:1777497732.890304:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1777497732.890320:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90581:x1863837565031936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497732.890425:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90581:x1863837565031936:12345-0@lo:502:llog_process_th.0 Request processed in 113us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.890432:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1777497732.890575:0:90581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565031936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497732.890598:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.890603:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.890604:0:90581:0:(obd_config.c:1561:class_process_config()) marker 40 (0x2) lustre-MDT0000-m new lustre.pool_134 00000020:01000000:1.0:1777497732.890607:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.890612:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.890618:0:90581:0:(obd_config.c:1561:class_process_config()) marker 43 (0x1) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:1.0:1777497732.890621:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1777497732.890630:0:90581:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to pool_134 as member 1 00000100:00100000:2.0:1777497732.890848:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565031808:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1777497732.890881:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.890959:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565031808 00000100:00100000:3.0:1777497732.890963:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565031808 00000100:00100000:3.0:1777497732.890985:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5899 00000100:00100000:3.0:1777497732.890989:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3656:x1863837565031808:12345-0@lo:8:llog_process_th.0 00010000:00080000:3.0:1777497732.891012:0:25486:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 3862 last 0 00000020:00000080:3.0:1777497732.891036:0:25486:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3e357265691dde0 00002000:00100000:3.0:1777497732.891047:0:25486:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff923f88a1d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1777497732.891051:0:25486:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1777497732.891054:0:25486:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1777497732.891138:0:25486:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1777497732.891159:0:25486:0:(import.c:65:import_set_state_nolock()) ffff923f88a1c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497732.891191:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3656:x1863837565031808:12345-0@lo:8:llog_process_th.0 Request processed in 201us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.891198:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5899 00000100:00100000:2.0:1777497732.891261:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1777497732.891267:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1777497732.891274:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1777497732.891278:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1777497732.891280:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f839d2800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1777497732.891298:0:3656:0:(osp_dev.c:1643:osp_import_event()) got connected 00000100:00100000:2.0:1777497732.891308:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565031808:0@lo:8:llog_process_th.0 00000004:00080000:1.0:1777497732.891462:0:90589:0:(osp_sync.c:1044:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1777497732.891518:0:90589:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3862232422390ns, next at 0ns, rc = 0 00080000:00080000:1.0:1777497732.891523:0:90589:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1777497732.892216:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497732.892257:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.892597:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032064 00000100:00100000:2.0:1777497732.892603:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032064 00000100:00100000:2.0:1777497732.892654:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1777497732.892662:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565032064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497732.892684:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497732.892721:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565032064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.892729:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1777497732.892767:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f840d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565032064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497732.892847:0:90581:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565032192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.892887:0:90581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.892908:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032192 00000100:00100000:2.0:1777497732.892911:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032192 00000100:00100000:2.0:1777497732.892933:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1777497732.892939:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90581:x1863837565032192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.893021:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90581:x1863837565032192:12345-0@lo:502:llog_process_th.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.893029:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000004:2.0:1777497732.893086:0:90591:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92409c468800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1777497732.893091:0:90591:0:(obd_mount.c:701:lustre_put_lsi()) put ffff92409c468800 4 00000100:00100000:2.0:1777497732.893130:0:90581:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.893143:0:90581:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90581:1863837565032192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1777497732.893164:0:90581:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497732.893170:0:90581:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497732.893172:0:90581:0:(obd_config.c:1561:class_process_config()) marker 43 (0x2) lustre-MDT0000-m add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1777497732.893181:0:90581:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000020:01000000:2.0:1777497732.894063:0:90568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-52 (rc=0) 10000000:01000000:2.0:1777497732.894089:0:90568:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1777497732.894137:0:90568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894149:0:90568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.894156:0:90568:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff92409c468800 from 1 10000000:01000000:2.0:1777497732.894159:0:90568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1777497732.894186:0:90568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894193:0:90568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894201:0:90568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.894217:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497732.894252:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.894278:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.894294:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032320 00000100:00100000:2.0:1777497732.894299:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032320 00000100:00100000:2.0:1777497732.894334:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1777497732.894342:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:90568:x1863837565032320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.894352:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497732.894375:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691dde7 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894405:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dde7 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894415:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dde7 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894423:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ffe00, rc 0) 00000100:00100000:2.0:1777497732.894453:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565032320:12345-0@lo:101:mount.lustre.0 Request processed in 113us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.894459:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1777497732.894499:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.894511:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.894519:0:90568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.895044:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032448:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1777497732.895076:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.895112:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.895128:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032448 00000100:00100000:2.0:1777497732.895132:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032448 00000100:00100000:2.0:1777497732.895155:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1777497732.895161:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565032448:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1777497732.895175:0:90573:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1777497732.895200:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1777497732.895208:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1777497732.895211:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1777497732.895213:0:90573:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:2.0:1777497732.895280:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565032448:12345-0@lo:256:mount.lustre.0 Request processed in 118us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.895287:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1777497732.895322:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032448:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1777497732.895965:0:90568:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777497732.895973:0:90568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.895984:0:90568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.895992:0:90568:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff92409c468800 from 1 10000000:01000000:2.0:1777497732.895995:0:90568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497732.896018:0:90568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896025:0:90568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896032:0:90568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.896045:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497732.896073:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.896121:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.896140:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032576 00000100:00100000:2.0:1777497732.896150:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032576 00000100:00100000:2.0:1777497732.896173:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1777497732.896179:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+8:90568:x1863837565032576:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.896187:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497732.896197:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fe600/0x3e357265691ddfc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ddf5 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896214:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fe600/0x3e357265691ddfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ddf5 expref: 9 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896223:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fe600/0x3e357265691ddfc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ddf5 expref: 9 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896229:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe600, rc 0) 00000100:00100000:2.0:1777497732.896257:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565032576:12345-0@lo:101:mount.lustre.0 Request processed in 78us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.896262:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1777497732.896297:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.896308:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddfc expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.896316:0:90568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ddfc expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497732.896496:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1777497732.896882:0:90569:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1777497732.897524:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497732.897590:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359424 00000100:00100000:3.0:1777497732.897597:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359424 00000100:00100000:3.0:1777497732.897638:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:3.0:1777497732.897647:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546359424:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497732.897657:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497732.897669:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c463 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.897702:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.897712:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.897721:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150ac00, rc 0) 00000100:00100000:3.0:1777497732.897771:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359424:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.897778:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 26 00000100:00100000:2.0:1777497732.898697:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032704:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1777497732.900559:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.900617:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.900672:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032704 00000100:00100000:1.0:1777497732.900681:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032704 00000100:00100000:1.0:1777497732.900739:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777497732.900749:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565032704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497732.900883:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565032704:12345-0@lo:501:mount.lustre.0 Request processed in 136us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.900891:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1777497732.900963:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1777497732.901012:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497732.901056:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.901070:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.901084:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032832 00000100:00100000:1.0:1777497732.901087:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032832 00000100:00100000:1.0:1777497732.901138:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777497732.901145:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565032832:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497732.901220:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565032832:12345-0@lo:503:mount.lustre.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.901226:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1777497732.901272:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565032832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1777497732.901505:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497732.901577:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359552 00000100:00100000:1.0:1777497732.901587:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359552 00000100:00100000:1.0:1777497732.901657:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:1.0:1777497732.901664:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359552:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497732.901694:0:90573:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777497732.901712:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497732.901716:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497732.901718:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497732.901721:0:90573:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 123 00000100:00100000:1.0:1777497732.902288:0:90592:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90592:1863837565032960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.902330:0:90592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.904606:0:90592:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497732.904961:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546359552:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 3292us (3452us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.904972:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 29 00000100:00100000:0.0:1777497732.905208:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565032960 00000100:00100000:0.0:1777497732.905218:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565032960 00000100:00100000:0.0:1777497732.905256:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1777497732.905264:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90592:x1863837565032960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497732.905819:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90592:x1863837565032960:12345-0@lo:502:llog_process_th.0 Request processed in 554us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.905827:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1777497732.908085:0:90592:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90592:1863837565032960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497732.908157:0:90592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.908168:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.908170:0:90592:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1777497732.908177:0:90592:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff92409c468800 00000020:00000080:1.0:1777497732.908179:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1777497732.908188:0:90592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.908190:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.908192:0:90592:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1777497732.908194:0:90592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1777497732.908196:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.908198:0:90592:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1777497732.908201:0:90592:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff92409c468800 00000020:00000080:1.0:1777497732.908203:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1777497732.908301:0:90592:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90592:1863837565033088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.908393:0:90592:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.908470:0:90592:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497732.912063:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033088 00000100:00100000:0.0:1777497732.912078:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033088 00000100:00100000:0.0:1777497732.912146:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1777497732.912156:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90592:x1863837565033088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497732.912333:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90592:x1863837565033088:12345-0@lo:502:llog_process_th.0 Request processed in 178us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497732.912341:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1777497732.912619:0:90592:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90592:1863837565033088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497732.912662:0:90592:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497732.912671:0:90592:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497732.912674:0:90592:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1777497732.912678:0:90592:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1777497732.917229:0:90568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:0.0:1777497732.917274:0:90568:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497732.918428:0:90568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddfc expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.918444:0:90568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ddfc expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497732.919502:0:90568:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1777497732.919508:0:90568:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff92409c468800 10000000:01000000:2.0:1777497732.919512:0:90568:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff92409c468800 10000000:01000000:2.0:1777497732.919521:0:90568:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1777497732.919528:0:90568:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff92409c468800 from 1 10000000:01000000:2.0:1777497732.919531:0:90568:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497732.919567:0:90568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919579:0:90568:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919591:0:90568:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.919614:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1777497732.919681:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.919733:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033216 00000100:00100000:2.0:1777497732.919740:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033216 00000100:00100000:2.0:1777497732.919783:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1777497732.919791:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:90568:x1863837565033216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.919804:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497732.919816:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de0a expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919838:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de0a expref: 10 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919848:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de0a expref: 10 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919856:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fee00, rc 0) 00000100:00100000:2.0:1777497732.919886:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565033216:12345-0@lo:101:mount.lustre.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.919898:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1777497732.919941:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.919961:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033216:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1777497732.919974:0:90568:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.919982:0:90568:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.920034:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497732.920055:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.920077:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.920133:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033344 00000100:00100000:2.0:1777497732.920137:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033344 00000100:00100000:2.0:1777497732.920162:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1777497732.920169:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565033344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497732.920272:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565033344:12345-0@lo:501:mount.lustre.0 Request processed in 103us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.920278:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1777497732.920311:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1777497732.920348:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033472:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497732.920395:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.920412:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033472 00000100:00100000:2.0:1777497732.920416:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033472 00000100:00100000:2.0:1777497732.920434:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1777497732.920440:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565033472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1777497732.920508:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565033472:12345-0@lo:503:mount.lustre.0 Request processed in 67us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.920513:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1777497732.920551:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.920563:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565033472:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1777497732.931745:0:90595:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.931830:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.931865:0:90595:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.931929:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033600 00000100:00100000:2.0:1777497732.931936:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033600 00000100:00100000:2.0:1777497732.931981:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1777497732.931990:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.932129:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033600:12345-0@lo:502:llog_process_th.0 Request processed in 139us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.932136:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1777497732.932511:0:90595:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033600:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1777497732.932571:0:90595:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1777497732.932587:0:90595:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff923f82aa8000) 00000020:00000080:1.0:1777497732.932611:0:90595:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1777497732.932911:0:90595:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92409c468800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497732.932916:0:90595:0:(tgt_mount.c:187:server_put_mount()) put mount ffff92409c468800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1777497732.932918:0:90595:0:(obd_mount.c:701:lustre_put_lsi()) put ffff92409c468800 4 00010000:00080000:1.0:1777497732.932946:0:90595:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9240bb6f5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.104@tcp at head 00010000:00010000:1.0:1777497732.941306:0:90595:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-12 is initialized 00000020:00000080:1.0:1777497732.942624:0:90595:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1777497732.943158:0:90595:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1777497732.943176:0:90595:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3e357265691de1f 00000100:00080000:1.0:1777497732.943187:0:90595:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1777497732.943194:0:90595:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240bb6f5800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497732.943230:0:90595:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6de1c00 x1863837565033728/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497732.943294:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565033728:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1777497732.943475:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.943570:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033728 00000100:00100000:0.0:1777497732.943577:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033728 00000100:00100000:0.0:1777497732.943629:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1777497732.943635:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565033728:12345-0@lo:38:llog_process_th.0 00000100:00080000:1.0:1777497732.943810:0:90595:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1777497732.944543:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3656:x1863837565033728:12345-0@lo:38:llog_process_th.0 Request processed in 905us (1066us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777497732.944553:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1777497732.944618:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1777497732.944624:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497732.944628:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1777497732.944631:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565033728:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1777497732.946038:0:90595:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.946520:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.946565:0:90595:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.946620:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033856 00000100:00100000:2.0:1777497732.946629:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033856 00000100:00100000:2.0:1777497732.946693:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1777497732.946703:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.946850:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033856:12345-0@lo:502:llog_process_th.0 Request processed in 150us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.946858:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1777497732.946952:0:90595:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.947002:0:90595:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497732.947031:0:90595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497732.947050:0:90595:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.947090:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565033984 00000100:00100000:2.0:1777497732.947109:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565033984 00000100:00100000:2.0:1777497732.947139:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1777497732.947146:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497732.947205:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90595:x1863837565033984:12345-0@lo:502:llog_process_th.0 Request processed in 60us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.947219:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1777497732.947295:0:90595:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90595:1863837565033984:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497732.947326:0:90595:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000020:01000000:2.0:1777497732.947578:0:90568:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-57 (rc=0) 10000000:01000000:2.0:1777497732.947599:0:90568:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497732.947620:0:90568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.947632:0:90568:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777497732.947686:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1777497732.947689:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.947690:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.947692:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.947693:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.947694:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.947696:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.947697:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.947699:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.947700:0:90568:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777497732.947704:0:90568:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1777497732.947706:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497732.947707:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.947708:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.947709:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.947710:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.947711:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.947712:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.947713:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.947714:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.947724:0:90568:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777497732.947738:0:90568:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1777497732.947747:0:90568:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565034112:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1777497732.947777:0:90568:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.947798:0:90568:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240855109c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.947816:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034112 00000100:00100000:2.0:1777497732.947820:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034112 00000100:00100000:2.0:1777497732.947841:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1777497732.947846:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565034112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1777497732.947866:0:90573:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1777497732.947880:0:90573:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1777497732.957470:0:90573:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1777497732.957517:0:90573:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1777497732.957946:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:90568:x1863837565034112:12345-0@lo:253:mount.lustre.0 Request processed in 10094us (10162us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.957959:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1777497732.958054:0:90568:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:90568:1863837565034112:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1777497732.958068:0:90568:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1777497732.958071:0:90568:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1777497732.958072:0:90568:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1777497732.958074:0:90568:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497732.958075:0:90568:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497732.958076:0:90568:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497732.958078:0:90568:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497732.958079:0:90568:0:(tgt_mount.c:1153:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1777497732.958081:0:90568:0:(tgt_mount.c:1157:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1777497732.958082:0:90568:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497732.958084:0:90568:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1777497732.958128:0:90568:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1777497732.959228:0:90578:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1777497732.959234:0:90578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1777497732.959434:0:90578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959453:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dde7 expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959464:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959471:0:90578:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959508:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959523:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 8 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497732.959536:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565034240:192.168.202.4@tcp:104: 00010000:00010000:0.0:1777497732.959655:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.959664:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497732.959697:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565034368:0@lo:104: 00000100:00100000:0.0:1777497732.959858:0:90578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.959892:0:90578:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8517d180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497732.959950:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034368 00000100:00100000:3.0:1777497732.959957:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034368 00000100:00100000:3.0:1777497732.960002:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1777497732.960010:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565034368:12345-0@lo:104: 00010000:00010000:3.0:1777497732.960031:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.960077:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1777497732.960082:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565034368:12345-0@lo:104: Request processed in 74us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.960086:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1777497732.961035:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565034368:0@lo:104: 00010000:00010000:0.0:1777497732.961427:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497732.961435:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.961445:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497732.961449:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.961458:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497732.961466:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497732.961473:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497732.961516:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.961523:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497732.961543:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.961550:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7fe200/0x3e357265691dde7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691ddee expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497732.961586:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497732.961588:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497732.961590:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497732.961603:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565034496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497732.961648:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497732.964245:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034496 00000100:00100000:3.0:1777497732.964259:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034496 00010000:00010000:3.0:1777497732.964295:0:10268:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 10 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497732.966057:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1777497732.966074:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:3657:x1863837565034496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497732.966112:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497732.966122:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 10 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.966136:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 10 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.966168:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ffe00/0x3e357265691ddee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691dde7 expref: 10 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497732.966184:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497732.966256:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:3657:x1863837565034496:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (4607us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497732.966263:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000100:00100000:3.0:1777497732.966310:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565034496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497732.968192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497732.968229:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359680 00000100:00100000:1.0:1777497732.968237:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359680 00010000:00010000:1.0:1777497732.968265:0:19127:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497732.968296:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2575 00000100:00100000:1.0:1777497732.968304:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546359680:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497732.968329:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497732.968334:0:19127:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968347:0:19127:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 9 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968375:0:19127:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968400:0:19127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497732.968418:0:19127:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026738010s 00010000:00010000:1.0:1777497732.968422:0:19127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968430:0:19127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968437:0:19127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968445:0:19127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968451:0:19127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497732.968455:0:19127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968462:0:19127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968471:0:19127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497732.968482:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497732.968531:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546359680:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 227us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497732.968539:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2575 00010000:00010000:2.0:1777497732.968734:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150ac00/0x3e357265691de03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c463 expref: 8 pid: 90575 timeout: 3962 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497732.968749:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565034240:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497732.968770:0:90578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.968778:0:90578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.968784:0:90578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497732.968801:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691de26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1777497732.970488:0:90568:0:(update_trans.c:1477:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 73014444062 00000040:01000000:3.0:1777497732.971568:0:90568:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1777497732.971918:0:90600:0:(update_trans.c:1520:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 73014444062 00000020:00080000:2.0:1777497732.971924:0:90600:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 73014444062 00000040:01000000:0.0:1777497732.972124:0:90601:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1777497732.972588:0:90601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1777497732.975857:0:90568:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1777497732.976067:0:90601:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x20000a810:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1777497732.976173:0:90601:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1777497732.976759:0:90602:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1777497732.976825:0:90602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497732.976861:0:90602:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83e62840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.976991:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034624 00000100:00100000:2.0:1777497732.976998:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034624 00000100:00100000:2.0:1777497732.977046:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4068 00000100:00100000:2.0:1777497732.977055:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977153:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 99us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.977161:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4068 00000100:00100000:2.0:1777497732.977205:0:90602:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034624:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1777497732.977236:0:90602:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1777497732.977264:0:90602:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977295:0:90602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.977327:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034752 00000100:00100000:2.0:1777497732.977330:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034752 00000100:00100000:2.0:1777497732.977352:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1777497732.977367:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034752:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977449:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034752:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 90us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.977455:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4069 00000100:00100000:2.0:1777497732.977487:0:90602:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.977500:0:90602:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034752:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977552:0:90602:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034880:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977574:0:90602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497732.977592:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565034880 00000100:00100000:2.0:1777497732.977595:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565034880 00000100:00100000:2.0:1777497732.977613:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1777497732.977619:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034880:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1777497732.977654:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:90602:x1863837565034880:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497732.977661:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4070 00000100:00100000:2.0:1777497732.977675:0:90602:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85326b40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497732.977685:0:90602:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd55c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:90602:1863837565034880:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1777497732.977805:0:90602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1777497732.982215:0:90568:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1777497732.982279:0:90568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1777497732.983597:0:90568:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1777497732.983620:0:90568:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1777497732.983705:0:90568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1777497732.983833:0:90602:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x2400090a4:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1777497732.983911:0:90602:0:(lod_dev.c:520:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1777497732.983915:0:90602:0:(lod_dev.c:544:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1777497732.985895:0:90568:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1777497732.986704:0:90568:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1777497732.986962:0:90568:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1777497732.987451:0:90568:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1777497732.988030:0:90568:0:(osd_handler.c:5575:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x53:0x0] (8/32) registered 00010000:00080000:1.0:1777497732.990973:0:90568:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-MDT0000, 2 recoverable clients, last_transno 115964117000 00010000:00080000:0.0:1777497732.991929:0:90603:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-MDT0000: started recovery thread pid 90603 00010000:02000000:0.0:1777497732.991948:0:90603:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-MDT0000: in recovery but waiting for the first client to connect 00010000:00080000:0.0:1777497732.991951:0:90603:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:0.0:1777497732.991953:0:90603:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 2 abort 0 expired 0 00000020:01000004:1.0:1777497732.992176:0:90568:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1777497732.992192:0:90568:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1777497732.992214:0:90568:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=47 00000080:00000004:1.0:1777497732.992230:0:90568:0:(super25.c:187:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1777497732.993193:0:90568:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497732.993471:0:90568:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497733.282851:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497733.953245:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497733.953292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497733.953394:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359808 00000100:00100000:0.0:1777497733.953406:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359808 00000100:00100000:0.0:1777497733.953459:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00100000:0.0:1777497733.953469:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2415:x1863837546359808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497733.957179:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360064 00000100:00100000:2.0:1777497733.957198:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360064 00000100:00100000:2.0:1777497733.957284:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1382 00000100:00100000:2.0:1777497733.957295:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546360064:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497733.965365:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2415:x1863837546359808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 11876us (12107us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497733.965380:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 39 00000100:00080000:3.0:1777497733.969006:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497733.969065:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497733.969279:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546360064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 11984us (15984us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497733.969293:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1382 00000100:00100000:2.0:1777497733.969420:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546359936 00000100:00100000:2.0:1777497733.969430:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546359936 00000100:00100000:2.0:1777497733.969479:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1435 00000100:00100000:2.0:1777497733.969485:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2411:x1863837546359936:12345-192.168.202.4@tcp:38:kworker.0 00010000:00080000:2.0:1777497733.969513:0:63729:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'd146155b-4321-4b14-9284-f644ed9631fb' at ffff9240a3af7800, cookie 0x3e357265691dd77 00010000:00080000:2.0:1777497733.969519:0:63729:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp recovering/t115964117001 exp ffff9240a3af7800 cur 3863 last 1777497732 00010000:02000400:2.0:1777497733.969527:0:63729:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-MDT0000: Will be in recovery for at least 1:00, or until 2 clients reconnect 00010000:00080000:2.0:1777497733.969533:0:63729:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 70 seconds 00000004:00100000:2.0:1777497733.969553:0:63729:0:(mdt_handler.c:7283:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1777497733.969685:0:63729:0:(import.c:65:import_set_state_nolock()) ffff924086e28800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497733.969736:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546359936:12345-192.168.202.4@tcp:38:kworker.0 Request processed in 250us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497733.969743:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1435 00000100:00100000:2.0:1777497733.975490:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497733.978665:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546349952 00000100:00100000:3.0:1777497733.978677:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546349952 00000100:00100000:3.0:1777497733.978749:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1436 00000100:00100000:3.0:1777497733.978760:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546349952:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00080000:3.0:1777497733.978780:0:63727:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 115964117001, current: 115964117001, replaying 00000100:00100000:3.0:1777497733.978792:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546349952:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 36us (3312us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497733.978806:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1436 00010000:00080000:0.0:1777497733.989064:0:90603:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 2 abort 0 expired 0 10000000:01000000:0.0:1777497734.055514:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497734.055520:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff92409c468800 from 124 10000000:01000000:0.0:1777497734.055526:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497734.055571:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.055583:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.055594:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.055622:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.055690:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.055959:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.056150:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035008 00000100:00100000:3.0:1777497734.056159:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035008 00000100:00100000:3.0:1777497734.056210:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1777497734.056218:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+9:6511:x1863837565035008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.056233:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.056247:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de2d expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.056271:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de2d expref: 10 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.056281:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de2d expref: 10 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.056290:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150bc00, rc 0) 00000100:00100000:3.0:1777497734.056335:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837565035008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.056341:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1777497734.056502:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.056517:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.056526:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.056578:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035136:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.056607:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.056634:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.056642:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035136 00000100:00100000:3.0:1777497734.056646:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035136 00000100:00100000:3.0:1777497734.056674:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1777497734.056681:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837565035136:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1777497734.056694:0:90580:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1777497734.056711:0:90580:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1777497734.056714:0:90580:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:3.0:1777497734.056797:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837565035136:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 116us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.056812:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1777497734.056875:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035136:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1777497734.056920:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1777497734.056927:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.056934:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497734.056943:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497734.056945:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 58 10000000:01000000:2.0:1777497734.056947:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497734.056966:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.056972:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.056984:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497734.056997:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.057021:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497734.057076:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.060261:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035264 00000100:00100000:3.0:1777497734.060273:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035264 00000100:00100000:3.0:1777497734.060322:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1777497734.060332:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+10:6511:x1863837565035264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.060356:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.060375:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de3b expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.060404:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de3b expref: 11 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.060415:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de3b expref: 11 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.060424:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b600, rc 0) 00000100:00100000:3.0:1777497734.060501:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.060507:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1777497734.060905:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.060924:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.060941:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.061026:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.061061:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.061136:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c480 going to sleep for 11 seconds 00000100:00100000:2.0:1777497734.061209:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035392 00000100:00100000:2.0:1777497734.061214:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035392 00000100:00100000:2.0:1777497734.061248:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1777497734.061256:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.061630:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.061641:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1777497734.061705:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.061822:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.061865:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.061889:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.063262:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035520 00000100:00100000:3.0:1777497734.063272:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035520 00000100:00100000:3.0:1777497734.063324:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1777497734.063333:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.063475:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.063482:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1777497734.063524:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497734.065032:0:90649:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:0.0:1777497734.073897:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:0.0:1777497734.073942:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497734.073953:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.073967:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497734.073993:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1777497734.073996:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 121 10000000:01000000:0.0:1777497734.073999:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1777497734.074037:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.074046:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.074065:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.074091:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.074171:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.074211:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.076227:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035648 00000100:00100000:3.0:1777497734.076246:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035648 00000100:00100000:3.0:1777497734.076311:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1777497734.076321:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+11:6511:x1863837565035648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.076339:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.076364:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de49 expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.076391:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de49 expref: 12 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.076402:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de49 expref: 12 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.076411:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150a400, rc 0) 00000100:00100000:3.0:1777497734.076485:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837565035648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (2315us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.076492:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1777497734.076505:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.076525:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.076536:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.076605:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.076638:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.076672:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497734.076844:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035776 00000100:00100000:1.0:1777497734.076849:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035776 00000100:00100000:1.0:1777497734.076873:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1777497734.076879:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837565035776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497734.076893:0:90574:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1777497734.076908:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497734.076911:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/4/3. 20000000:01000000:1.0:1777497734.076914:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/4/3. 20000000:01000000:1.0:1777497734.076917:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/4/3. 20000000:01000000:1.0:1777497734.076920:0:90574:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 124 00000100:00100000:1.0:1777497734.076985:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837565035776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497734.076991:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1777497734.077019:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1777497734.077086:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1777497734.077107:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.077116:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.077125:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1777497734.077132:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:1.0:1777497734.077135:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497734.077154:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.077161:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.077169:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.077182:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.077205:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.077217:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.077729:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565035904 00000100:00100000:3.0:1777497734.077735:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565035904 00000100:00100000:3.0:1777497734.077772:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1777497734.077779:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+12:6511:x1863837565035904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.077788:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.077800:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de57 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.077820:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de57 expref: 13 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.077830:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de57 expref: 13 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.077845:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150a000, rc 0) 00000100:00100000:3.0:1777497734.077889:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565035904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.077895:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1777497734.077912:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565035904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.077926:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.077934:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.078000:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.078026:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.078055:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036032 00000100:00100000:0.0:1777497734.078059:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036032 00000100:00100000:0.0:1777497734.078088:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497734.078111:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565036032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.078231:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565036032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497734.078237:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1777497734.078266:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497734.078276:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.078318:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.078363:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.078374:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c780 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.078776:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036160 00000100:00100000:3.0:1777497734.078782:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036160 00000100:00100000:3.0:1777497734.078856:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1777497734.078864:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565036160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.078969:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565036160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.078975:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1777497734.079035:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087888a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497734.084072:0:90651:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 64768 count 52 00000020:01000000:3.0:1777497734.084860:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-52 (rc=0) 10000000:01000000:3.0:1777497734.084896:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1777497734.084906:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.084919:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497734.084929:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-barrier 10000000:01000000:3.0:1777497734.084931:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-barrier-ffff9240b521d800 from 1 10000000:01000000:3.0:1777497734.084934:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1777497734.084971:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.084979:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.084999:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497734.085026:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.085085:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497734.085239:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497734.094678:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036288 00000100:00100000:0.0:1777497734.094768:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036288 00000100:00100000:0.0:1777497734.094829:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1777497734.094840:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+13:6511:x1863837565036288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.094861:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497734.094880:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef600/0x3e357265691de6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de65 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.094910:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef600/0x3e357265691de6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de65 expref: 14 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.094921:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef600/0x3e357265691de6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de65 expref: 14 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.094930:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef600, rc 0) 00000100:00100000:0.0:1777497734.095025:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837565036288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (9939us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497734.095033:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1777497734.095163:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497734.095181:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de6c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.095190:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de6c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.095207:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1777497734.095212:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de6c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.095219:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92408150ac00/0x3e357265691de65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de6c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.095227:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777497734.095230:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240b521d800 from 7 10000000:01000000:1.0:1777497734.095238:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777497734.095261:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.095268:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.095287:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.095410:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.095444:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.095520:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602be40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.098852:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036416 00000100:00100000:3.0:1777497734.098863:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036416 00000100:00100000:2.0:1777497734.104491:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1777497734.104507:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837565036416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497734.104525:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497734.104640:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff000/0x3e357265691de7a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de73 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.104670:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff000/0x3e357265691de7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de73 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.104682:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff000/0x3e357265691de7a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de73 expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.104705:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff000, rc 0) 00000100:00100000:3.0:1777497734.109331:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4820us (13876us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.109343:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1777497734.109478:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.109502:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.109514:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.109616:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.109653:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.109756:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.111160:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036544 00000100:00100000:3.0:1777497734.111171:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036544 00000100:00100000:2.0:1777497734.111518:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1777497734.111530:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.111695:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.111703:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1777497734.113201:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.113271:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.113524:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.113569:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.113602:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036672 00000100:00100000:3.0:1777497734.113609:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036672 00000100:00100000:3.0:1777497734.113659:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1777497734.113667:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.113778:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.113785:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1777497734.113830:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497734.125147:0:90654:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1777497734.125488:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1777497734.125523:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777497734.125534:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.125546:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.125557:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497734.125559:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 58 10000000:01000000:1.0:1777497734.125578:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497734.125614:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.125622:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.125634:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.125659:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.125731:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.125769:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497734.130079:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036800 00000100:00100000:1.0:1777497734.130150:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036800 00000100:00100000:1.0:1777497734.130245:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1777497734.130255:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565036800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497734.130273:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497734.130376:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de81 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.130405:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de81 expref: 16 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.130416:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de81 expref: 16 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.130424:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896ca400, rc 0) 00000100:00100000:1.0:1777497734.130509:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565036800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 255us (4777us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497734.130526:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1777497734.133768:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.133806:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.133820:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.133928:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.133991:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.134030:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.134317:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565036928 00000100:00100000:3.0:1777497734.134324:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565036928 00000100:00100000:3.0:1777497734.134384:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1777497734.134393:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565036928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.134534:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565036928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.134554:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1777497734.135054:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565036928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.135122:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.135165:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.135186:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497734.135249:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037056 00000100:00100000:1.0:1777497734.135254:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037056 00000100:00100000:1.0:1777497734.135386:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1777497734.135396:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565037056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.135479:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565037056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497734.135641:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.135788:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000040:00080000:2.0:1777497734.143926:0:90657:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:3.0:1777497734.144122:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:3.0:1777497734.144154:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497734.144165:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.144176:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497734.144186:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1777497734.144188:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1777497734.144192:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1777497734.144229:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.144237:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.144248:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497734.144273:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.144357:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497734.144396:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497734.144754:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037184 00000100:00100000:2.0:1777497734.144762:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037184 00000100:00100000:2.0:1777497734.144815:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1777497734.144824:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565037184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497734.144839:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497734.144851:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de8f expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.144875:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de8f expref: 17 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.144887:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de8f expref: 17 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.144895:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff600, rc 0) 00000100:00100000:2.0:1777497734.144931:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.144939:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1777497734.145254:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.145269:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.145290:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497734.145371:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.145399:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497734.145429:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497734.145472:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037312 00000100:00100000:2.0:1777497734.145482:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037312 00000100:00100000:2.0:1777497734.145526:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1777497734.145533:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.145648:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.145854:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.145882:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.145918:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497734.145932:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.145942:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037440 00000100:00100000:3.0:1777497734.145945:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037440 00000100:00100000:2.0:1777497734.145973:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1777497734.151806:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1777497734.151823:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.153751:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1926us (7824us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.153763:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1777497734.154717:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497734.160971:0:90658:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:2.0:1777497734.161474:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1777497734.161512:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1777497734.161523:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.161536:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497734.161546:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1777497734.161548:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f818b6800 from 7 10000000:01000000:2.0:1777497734.161552:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1777497734.161588:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.161596:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.161607:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497734.161632:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.161718:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497734.161752:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.162009:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037568 00000100:00100000:3.0:1777497734.162017:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037568 00000100:00100000:3.0:1777497734.162067:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1777497734.162077:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565037568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.162090:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.162125:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150b200/0x3e357265691dea4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691de9d expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.162151:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150b200/0x3e357265691dea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691de9d expref: 18 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.162161:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150b200/0x3e357265691dea4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de9d expref: 18 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.162180:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b200, rc 0) 00000100:00100000:3.0:1777497734.162221:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.162227:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1777497734.162444:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497734.162458:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dea4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497734.162467:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dea4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497734.162534:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.162559:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497734.162589:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.162774:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037696 00000100:00100000:3.0:1777497734.162779:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037696 00000100:00100000:3.0:1777497734.162812:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1777497734.162819:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.162919:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.162924:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1777497734.163327:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.163372:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.163415:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497734.163442:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c186300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.163478:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037824 00000100:00100000:3.0:1777497734.163490:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037824 00000100:00100000:3.0:1777497734.163524:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1777497734.163531:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.163613:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.163619:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1777497734.163836:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497734.165062:0:90659:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1777497734.165360:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1777497734.165389:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1777497734.165399:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dea4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.165410:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dea4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497734.165420:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497734.165422:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 58 10000000:01000000:0.0:1777497734.165427:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497734.165461:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.165469:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.165478:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.165515:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.165564:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.165598:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.165921:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565037952 00000100:00100000:3.0:1777497734.165928:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565037952 00000100:00100000:3.0:1777497734.165973:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1777497734.165981:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565037952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.165994:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.166006:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691deab expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.166048:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691deab expref: 19 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.166058:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691deab expref: 19 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.166067:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150a200, rc 0) 00000100:00100000:3.0:1777497734.166129:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565037952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.166136:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1777497734.166222:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565037952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.166243:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.166250:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.166314:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.166341:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.166369:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.166478:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038080 00000100:00100000:3.0:1777497734.166490:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038080 00000100:00100000:3.0:1777497734.166527:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1777497734.166534:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565038080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.166629:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565038080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.166636:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1777497734.166941:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.166970:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.167008:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497734.167159:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c900 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.173677:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038208 00000100:00100000:3.0:1777497734.173693:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038208 00000100:00100000:3.0:1777497734.173746:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1777497734.173755:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565038208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.173914:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565038208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.173922:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1777497734.176867:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497734.183602:0:90661:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 57 00000020:01000000:1.0:1777497734.185049:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-57 (rc=0) 10000000:01000000:1.0:1777497734.185079:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497734.185089:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.185124:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.185134:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1777497734.185137:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1777497734.185140:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1777497734.185180:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.185188:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.185200:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.185225:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.185295:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.185338:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.186415:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038336 00000100:00100000:3.0:1777497734.186431:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038336 00000100:00100000:3.0:1777497734.186495:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1777497734.186509:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565038336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.186523:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.186536:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691deb9 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.186562:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691deb9 expref: 20 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.186572:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691deb9 expref: 20 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.186580:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150ae00, rc 0) 00000100:00100000:3.0:1777497734.186633:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.186640:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1777497734.186933:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497734.186950:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.186959:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.187024:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.187058:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.187081:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.187626:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038464 00000100:00100000:3.0:1777497734.187632:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038464 00000100:00100000:3.0:1777497734.187794:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1777497734.187803:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.187943:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.187949:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1777497734.191219:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.191290:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.191366:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.191401:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497734.191525:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038592 00000100:00100000:0.0:1777497734.191532:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038592 00000100:00100000:0.0:1777497734.191579:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1777497734.191588:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.193090:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1496us (1718us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.193130:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1777497734.193461:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497734.194918:0:90664:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:1.0:1777497734.195444:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1777497734.195747:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1777497734.195758:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.195771:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.195780:0:6511:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1777497734.195790:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff9240bcd94000 from 7 10000000:01000000:1.0:1777497734.195793:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1777497734.195832:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.195839:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.195851:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.195875:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.195936:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.196022:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.198178:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038720 00000100:00100000:3.0:1777497734.198201:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038720 00000100:00100000:3.0:1777497734.199509:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1777497734.199524:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565038720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.199543:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.199561:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5aa00/0x3e357265691dece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691dec7 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.199593:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5aa00/0x3e357265691dece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dec7 expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.199605:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5aa00/0x3e357265691dece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dec7 expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.199615:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5aa00, rc 0) 00000100:00100000:3.0:1777497734.199711:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565038720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (3777us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.199719:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1777497734.199768:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497734.199786:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497734.199796:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497734.199878:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497734.199925:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497734.209152:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038848 00000100:00100000:2.0:1777497734.209168:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038848 00000100:00100000:2.0:1777497734.209227:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1777497734.209237:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565038848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.209491:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565038848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 247us (9558us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.209505:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1777497734.209974:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8440c900 going to sleep for 11 seconds 00000100:00100000:1.0:1777497734.210007:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.210059:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.210380:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.210437:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497734.210467:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565038976 00000100:00100000:2.0:1777497734.210478:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565038976 00000100:00100000:2.0:1777497734.210775:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1777497734.210784:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565038976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497734.210889:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565038976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497734.210896:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1777497734.210959:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565038976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1777497734.211998:0:90665:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1777497734.212068:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1777497734.212112:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1777497734.212122:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.212134:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.212155:0:6511:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1777497734.212158:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log nodemap-ffff9240911f99c0 from 1 10000000:01000000:1.0:1777497734.212161:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1777497734.212195:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.212204:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.212216:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.212237:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.212367:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.212753:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.212882:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039104 00000100:00100000:3.0:1777497734.212889:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039104 00000100:00100000:3.0:1777497734.213022:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1777497734.213032:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565039104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.213046:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.213062:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a000/0x3e357265691dedc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ded5 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213088:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a000/0x3e357265691dedc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ded5 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213122:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a000/0x3e357265691dedc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ded5 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213140:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a000, rc 0) 00000100:00100000:3.0:1777497734.213190:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565039104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.213197:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1777497734.213393:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497734.213407:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dedc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.213416:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dedc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.213434:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1777497734.213438:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dedc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.213444:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cae00/0x3e357265691ded5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dedc expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497734.213462:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1777497734.213464:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:1.0:1777497734.213466:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1777497734.213495:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.213582:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.213590:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.213605:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.213634:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497734.213768:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039232 00000100:00100000:3.0:1777497734.213773:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039232 00000100:00100000:3.0:1777497734.213797:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1777497734.213803:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565039232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.213811:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.213820:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691dee3 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213833:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691dee3 expref: 23 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213842:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dee3 expref: 23 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.213848:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5ae00, rc 0) 00000100:00100000:3.0:1777497734.213869:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565039232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.213874:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1777497734.213927:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497734.213939:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497734.213948:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.213956:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497734.214006:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497734.214028:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497734.214055:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497734.214194:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039360 00000100:00100000:3.0:1777497734.214198:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039360 00000100:00100000:3.0:1777497734.214225:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1777497734.214232:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565039360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497734.214391:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565039360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (361us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497734.214404:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1777497734.214490:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565039360:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1777497734.214755:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1777497734.214769:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.214778:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497734.312735:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497734.340200:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497734.340835:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360192 00000100:00100000:3.0:1777497734.340847:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360192 00000100:00100000:3.0:1777497734.340912:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:3.0:1777497734.340922:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546360192:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497734.340938:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497734.340956:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c46a expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.340984:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.340995:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497734.341004:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240baa5a800, rc 0) 00000100:00100000:3.0:1777497734.341071:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546360192:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 150us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497734.341078:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 75 00000100:00100000:2.0:1777497734.349238:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497734.349357:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360320 00000100:00100000:1.0:1777497734.349368:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360320 00000100:00100000:1.0:1777497734.349435:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:1.0:1777497734.349445:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546360320:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497734.349474:0:90574:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:01000000:1.0:1777497734.349498:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497734.349501:0:90574:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 124 00000100:00100000:1.0:1777497734.352224:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546360320:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 2769us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497734.352238:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 76 00000100:00100000:3.0:1777497735.204878:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497735.204901:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497735.204942:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497735.204952:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565039616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497735.204969:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497735.205007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497735.205025:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039488 00000100:00100000:3.0:1777497735.205031:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039488 00000100:00100000:2.0:1777497735.205031:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039616 00000100:00100000:2.0:1777497735.205034:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039616 00000100:00100000:3.0:1777497735.205090:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:3.0:1777497735.205199:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565039488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497735.205234:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497735.205316:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565039488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 123us (346us total) trans 0 rc 0/0 00000100:00080000:1.0:1777497735.207852:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497735.207862:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497735.209378:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1777497735.209405:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565039616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497735.209443:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 211008 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497735.209478:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:3.0:1777497735.209585:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565039488:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497735.210788:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f840d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565039616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1393us (5776us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497735.210799:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:0.0:1777497735.211003:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565039616:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777497735.332347:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497736.354243:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497737.381468:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1777497738.179336:0:90837:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1777497738.274564:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497738.274585:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565039744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497738.274652:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.274711:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039744 00000100:00100000:1.0:1777497738.274718:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039744 00000100:00100000:1.0:1777497738.274756:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4071 00000100:00100000:1.0:1777497738.274764:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565039744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497738.274799:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00080000:3.0:1777497738.274803:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497738.274808:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497738.274812:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497738.274819:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff92409c46a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497738.274838:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089359500 x1863837565040000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497738.274850:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565039744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.274857:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4071 00000100:00080000:3.0:1777497738.274859:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497738.274861:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497738.274863:0:38121:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497738.274867:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff923f8275c800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497738.274876:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408935ad80 x1863837565040256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497738.274882:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565040128:0@lo:400:kworker.0 00000100:00080000:3.0:1777497738.274889:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497738.274892:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497738.274894:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497738.274898:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff92408395d800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497738.274907:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089358380 x1863837565040512/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497738.274907:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497738.274925:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1777497738.274926:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1777497738.274931:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565039872:0@lo:400:kworker.0 00000100:00080000:3.0:1777497738.274934:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497738.274935:0:38121:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497738.274939:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff92409c5dd800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497738.274949:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92408935b800 x1863837565040896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497738.274968:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1777497738.274969:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1777497738.274972:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1777497738.274973:0:38121:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497738.274977:0:38121:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9240bb6f5800 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497738.274986:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089358a80 x1863837565041280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1777497738.274993:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565040768:0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.275004:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497738.275011:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565041024:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275015:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275040:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565040000:0@lo:38:kworker.0 00000100:00100000:1.0:1777497738.275055:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565039872 00000100:00100000:1.0:1777497738.275059:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565039872 00000100:00100000:3.0:1777497738.275062:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275079:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565040256:0@lo:38:kworker.0 00000100:00100000:1.0:1777497738.275082:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1777497738.275087:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565039872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.275115:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275131:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565040512:0@lo:38:kworker.0 00000100:00100000:1.0:1777497738.275134:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565039872:12345-0@lo:400:kworker.0 Request processed in 46us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.275139:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1777497738.275148:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275162:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565040896:0@lo:38:kworker.0 00000100:00100000:1.0:1777497738.275168:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040768 00000100:00100000:1.0:1777497738.275171:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040768 00000100:00100000:3.0:1777497738.275179:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275200:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565041280:0@lo:38:kworker.0 00000100:00100000:1.0:1777497738.275204:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2659 00000100:00100000:1.0:1777497738.275210:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565040768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.275217:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.275235:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565040768:12345-0@lo:400:kworker.0 Request processed in 26us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.275241:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2659 00000100:00100000:3.0:1777497738.275245:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040128 00000100:00100000:3.0:1777497738.275254:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040128 00000100:00100000:1.0:1777497738.275255:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.275278:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040000 00000100:00100000:3.0:1777497738.275281:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040000 00000100:00100000:3.0:1777497738.275290:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040256 00000100:00080000:1.0:1777497738.275291:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497738.275292:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040256 00000100:00080000:1.0:1777497738.275295:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497738.275298:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040896 00000100:00100000:3.0:1777497738.275300:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040896 00000100:00100000:3.0:1777497738.275306:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041280 00000100:00100000:1.0:1777497738.275320:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041024 00000100:00100000:1.0:1777497738.275323:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041024 00000100:00100000:1.0:1777497738.275351:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2660 00000100:00100000:1.0:1777497738.275361:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565041024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275394:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565041024:12345-0@lo:400:kworker.0 Request processed in 38us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.275399:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2660 00000100:00080000:1.0:1777497738.275416:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497738.275445:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565041024:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275466:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565040384:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275488:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.275500:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565041152:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275520:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.275545:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565039744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497738.275555:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497738.275559:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565040640:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275578:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.275607:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565039872:0@lo:400:kworker.0 00000100:00100000:1.0:1777497738.275616:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565040768:0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.276630:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041280 00000100:00100000:3.0:1777497738.276658:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1777497738.276728:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565040128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.276786:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565040128:12345-0@lo:400:kworker.0 Request processed in 122us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.276792:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1777497738.276808:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040384 00000100:00100000:3.0:1777497738.276812:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040384 00000100:00100000:3.0:1777497738.276837:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1777497738.276842:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565040384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.276869:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565040384:12345-0@lo:400:kworker.0 Request processed in 27us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.276874:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1777497738.276884:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1777497738.276888:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565040000:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.276906:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3867 last 0 00000020:00000080:3.0:1777497738.276941:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691def8 00000004:00100000:3.0:1777497738.276954:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497738.277072:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f88a18800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497738.277125:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837565040000:12345-0@lo:38:kworker.0 Request processed in 235us (2061us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.277143:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:3.0:1777497738.277156:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1777497738.277159:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565040256:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.277171:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3867 last 0 00000020:00000080:3.0:1777497738.277191:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3e357265691deff 00000004:00100000:3.0:1777497738.277197:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497738.277211:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f88a18000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497738.277235:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3656:x1863837565040256:12345-0@lo:38:kworker.0 Request processed in 74us (2119us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.277240:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:3.0:1777497738.277252:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1777497738.277255:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565040896:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.277266:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3867 last 0 00000020:00000080:3.0:1777497738.277287:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x3e357265691df06 00000004:00100000:3.0:1777497738.277293:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497738.277305:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f88a1a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497738.277342:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3656:x1863837565040896:12345-0@lo:38:kworker.0 Request processed in 85us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.277348:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:3.0:1777497738.277361:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1777497738.277365:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3656:x1863837565041280:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.277376:0:64885:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo recovering/t0 exp 0000000000000000 cur 3867 last 0 00000020:00000080:3.0:1777497738.277394:0:64885:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3e357265691df0d 00000004:00100000:3.0:1777497738.277400:0:64885:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497738.277419:0:64885:0:(import.c:65:import_set_state_nolock()) ffff9240849d5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1777497738.277425:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565040128:0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.277442:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3656:x1863837565041280:12345-0@lo:38:kworker.0 Request processed in 76us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.277447:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:3.0:1777497738.277476:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040512 00000100:00100000:3.0:1777497738.277482:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040512 00000100:00100000:3.0:1777497738.278161:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4072 00000100:00100000:3.0:1777497738.278168:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:0+-99:3656:x1863837565040512:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.278186:0:8407:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9240a3af2000, cookie 0x3e357265691dd70 00010000:00080000:3.0:1777497738.278190:0:8407:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t115964116999 exp ffff9240a3af2000 cur 3867 last 1777497732 00000004:00100000:3.0:1777497738.278201:0:8407:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1777497738.278223:0:8407:0:(import.c:65:import_set_state_nolock()) ffff9240bb780000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1777497738.278270:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837565040512:12345-0@lo:38:kworker.0 Request processed in 101us (3119us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.278276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4072 00000100:00100000:3.0:1777497738.278305:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041152 00000100:00100000:3.0:1777497738.278318:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041152 00000100:00100000:3.0:1777497738.278348:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565040640 00000100:00100000:3.0:1777497738.278351:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565040640 00000100:00100000:3.0:1777497738.278372:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1777497738.278378:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565041152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.278408:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565041152:12345-0@lo:400:kworker.0 Request processed in 30us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.278414:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2661 00000100:00100000:3.0:1777497738.278424:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2662 00000100:00100000:3.0:1777497738.278429:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565040640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497738.278452:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565040640:12345-0@lo:400:kworker.0 Request processed in 23us (2874us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.278468:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2662 00010000:00080000:1.0:1777497738.281432:0:90603:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 2 abort 0 expired 0 00010000:00080000:1.0:1777497738.281441:0:90603:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 115964117001 00000020:00080000:1.0:1777497738.281451:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.281455:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 0, queue_len: 1, req_transno: 115964117001, next_transno: 115964117001 00010000:00080000:1.0:1777497738.281477:0:90603:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (115964117001) 00000020:00080000:1.0:1777497738.281480:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.281494:0:90603:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546349952 t115964117001 from 192.168.202.4@tcp req@ffff9240bcd55c00 x1863837546349952/t0(115964117001) o36->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:489/0 lens 528/0 e 0 to 0 dl 1777497744 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'mcreate.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497738.281594:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497738.281599:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497738.281603:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497738.281649:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565040640:0@lo:400:kworker.0 00010000:00080000:3.0:1777497738.287212:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924089359500 x1863837565040000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.287233:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000100:00080000:3.0:1777497738.290428:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0000: lwp recover req@ffff924089359500 x1863837565040000/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.290441:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777497738.290447:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497738.290451:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0000: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497738.290458:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565040000:0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.290496:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92408935ad80 x1863837565040256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.290511:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 28 00000100:00080000:3.0:1777497738.291349:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-OST0001: lwp recover req@ffff92408935ad80 x1863837565040256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.291359:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777497738.291362:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f8275c800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497738.291366:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-OST0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497738.291371:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3656:1863837565040256:0@lo:38:kworker.0 00000100:00100000:3.0:1777497738.291394:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000004:00080000:3.0:1777497738.291399:0:3656:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964116999 committed transno 115964117000 00000020:00080000:3.0:1777497738.291405:0:3656:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff923f83e2a0c0 refcount 2 committed 0 result 0 batchid 77309411388 00000020:00080000:3.0:1777497738.291409:0:3656:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff924091504900 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff923f83e2a6c0 00000020:00080000:3.0:1777497738.291430:0:3656:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].4 00000020:00080000:3.0:1777497738.291433:0:3656:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff924091504f00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff923f8502bc00 00000020:00080000:3.0:1777497738.291435:0:3656:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].4 00000004:00080000:3.0:1777497738.291478:0:3656:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 115964117000 committed transno 115964117000 00000020:00080000:3.0:1777497738.291482:0:3656:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0001-osd tmt ffff92409110f840 refcount 2 committed 0 result 0 batchid 77309411389 00000020:00080000:3.0:1777497738.291485:0:3656:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92408a09c200 obd lustre-MDT0000-osp-MDT0001 committed 1 started 1 stopped 1 result 0 sub_th ffff92409110ff00 00000020:00080000:3.0:1777497738.291488:0:3656:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2000088d1:0x2:0x0].5 00000020:00080000:3.0:1777497738.291491:0:3656:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff92409c72bf00 obd lustre-MDT0001-osd committed 1 started 1 stopped 1 result 0 sub_th ffff923f8502ae00 00000020:00080000:3.0:1777497738.291493:0:3656:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x2400090a0:0x2:0x0].5 00000100:00080000:3.0:1777497738.291507:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 28 00000100:00080000:3.0:1777497738.291516:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:3.0:1777497738.291520:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-MDT0000_UUID 00000100:00100000:3.0:1777497738.291523:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 115964117000 gen 3 00000100:00080000:3.0:1777497738.291526:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff92408395d800 from lustre-MDT0000_UUID committed 115964117000 last 0 00000100:00080000:3.0:1777497738.291529:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00080000:3.0:1777497738.291560:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 77309411389 committed batchid 77309411387 00000020:00080000:3.0:1777497738.291629:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411387 00000100:00100000:3.0:1777497738.291888:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565040512:0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.291906:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92408935b800 x1863837565040896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.291918:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 28 00000100:00100000:1.0:1777497738.293473:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565040384:0@lo:400:kworker.0 00000004:00080000:1.0:1777497738.293496:0:90603:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11925us 00000100:00100000:1.0:1777497738.293606:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565041152:0@lo:400:kworker.0 00010000:00080000:0.0:1777497738.305500:0:90843:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-MDT0000-osp-MDT0001 to lustre-MDT0000_UUID@0@lo 00010000:00010000:0.0:1777497738.305506:0:90843:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-MDT0000-osp-MDT0001 (0) 00010000:00010000:0.0:1777497738.305512:0:90843:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-MDT0000-osp-MDT0001 00000100:00080000:3.0:1777497738.306355:0:3656:0:(import.c:1328:ptlrpc_connect_interpret()) @@@ lustre-MDT0000-lwp-MDT0001: lwp recover req@ffff92408935b800 x1863837565040896/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497763 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.306368:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to RECOVER 00000100:00080000:3.0:1777497738.306374:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c5dd800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:3.0:1777497738.306390:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-lwp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00100000:3.0:1777497738.306396:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3656:1863837565040896:0@lo:38:kworker.0 00010000:00080000:3.0:1777497738.306584:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff924089358a80 x1863837565041280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497738.306599:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 28 00000100:00080000:3.0:1777497738.306607:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1777497738.306612:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1777497738.306614:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240bb6f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1777497738.306618:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3656:1863837565041280:0@lo:38:kworker.0 00010000:00010000:0.0:1777497738.310961:0:90843:0:(ldlm_request.c:2848:replay_one_lock()) ### replaying lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691d654 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1777497738.310990:0:90843:0:(ldlm_request.c:2898:lock_can_replay()) check lock replay limit, inflights = 1(512) 00000100:00100000:3.0:1777497738.311538:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565041408:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777497738.311604:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.311641:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041408 00000100:00100000:3.0:1777497738.311647:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041408 00000100:00100000:3.0:1777497738.311954:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4073 00000100:00100000:3.0:1777497738.311964:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837565041408:12345-0@lo:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777497738.311988:0:8406:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff924086430380 x1863837565041408/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:494/0 lens 328/0 e 0 to 0 dl 1777497749 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497738.311999:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:3656:x1863837565041408:12345-0@lo:101:ldlm_lock_repla.0 Request processed in 38us (396us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497738.312004:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4073 00000020:00080000:3.0:1777497738.313005:0:72699:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0001: 77309411389 batchid updated 00000001:00100000:3.0:1777497738.313032:0:72699:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00080000:0.0:1777497738.316848:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:0.0:1777497738.316913:0:72719:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff923f8440c9c0 with version 15 00000020:00080000:0.0:1777497738.316936:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411388 cancel update log [0x2000088d1:0x2:0x0].4: rc = 0 00000020:00080000:0.0:1777497738.317037:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411388 cancel update log [0x2400090a0:0x2:0x0].4: rc = 0 00000004:00080000:0.0:1777497738.317061:0:72719:0:(osp_trans.c:1582:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth ffff923f8440c780 with version 16 00000020:00080000:0.0:1777497738.317065:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osp-MDT0001: batchid 77309411389 cancel update log [0x2000088d1:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1777497738.317084:0:72719:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0001-osd: batchid 77309411389 cancel update log [0x2400090a0:0x2:0x0].5: rc = 0 00000020:00080000:0.0:1777497738.317090:0:72719:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 77309411389 00000004:00080000:1.0:1777497738.317813:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 15 rpc_version 15 00000020:00100000:1.0:1777497738.317850:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1777497738.317862:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff9240a6de3480 x1863837565041664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1777497738.317884:0:72705:0:(client.c:1830:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != REPLAY_LOCKS) req@ffff9240a6de3480 x1863837565041664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497738.317893:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050a80 going to sleep for 0 seconds 00010000:00010000:1.0:1777497738.343247:0:90603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343268:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343283:0:90603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343304:0:90603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343321:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343327:0:90603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343659:0:90603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343667:0:90603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343673:0:90603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343679:0:90603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497738.343683:0:90603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343690:0:90603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343702:0:90603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9240aefbbe00) 00010000:00010000:1.0:1777497738.343705:0:90603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497738.343710:0:90603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343715:0:90603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df14 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497738.343736:0:90603:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000b8da4e69 reply state 0000000019e4c0f7 transno 115964117001 ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343747:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.343754:0:90603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240aefbbb00) 00010000:00010000:1.0:1777497738.343756:0:90603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497738.343759:0:90603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497738.343863:0:90603:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 101 seconds 00000020:00080000:1.0:1777497738.343882:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.343885:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000020:00080000:1.0:1777497738.343889:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.343891:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117002 00000001:00080000:1.0:1777497738.356941:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117001 is committed 00010000:00010000:0.0:1777497738.358668:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358698:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358705:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358722:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896caa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497738.358727:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358735:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358755:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff9240aefbbb00) 00010000:00010000:0.0:1777497738.358758:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497738.358762:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.358769:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df1b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497738.362427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497738.362523:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546350464 00000100:00100000:0.0:1777497738.362533:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546350464 00000100:00100000:0.0:1777497738.362594:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1441 00000100:00100000:0.0:1777497738.362603:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546350464:12345-192.168.202.4@tcp:36:rm.0 00010000:00080000:0.0:1777497738.362623:0:64885:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 115964117002, current: 115964117002, replaying 00000100:00100000:0.0:1777497738.362637:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546350464:12345-192.168.202.4@tcp:36:rm.0 Request processed in 36us (220us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497738.362644:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1441 00000020:00080000:1.0:1777497738.363429:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.363435:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 1, req_transno: 115964117002, next_transno: 115964117002 00010000:00080000:1.0:1777497738.363440:0:90603:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (115964117002) 00000020:00080000:1.0:1777497738.363444:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.363454:0:90603:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546350464 t115964117002 from 192.168.202.4@tcp req@ffff924086433480 x1863837546350464/t0(115964117002) o36->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:494/0 lens 512/0 e 0 to 0 dl 1777497749 ref 1 fl Complete:/204/ffffffff rc 0/-1 job:'rm.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777497738.363549:0:90603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363565:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363577:0:90603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363596:0:90603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363603:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363609:0:90603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363689:0:90603:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363698:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363705:0:90603:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363917:0:90603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363925:0:90603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363931:0:90603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363936:0:90603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497738.363941:0:90603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363948:0:90603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363965:0:90603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x3:0x0].0x0 (ffff92409f6de900) 00010000:00010000:1.0:1777497738.363968:0:90603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497738.363972:0:90603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.363978:0:90603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca200/0x3e357265691df30 lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364017:0:90603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364024:0:90603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364029:0:90603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364034:0:90603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497738.364036:0:90603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364042:0:90603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364049:0:90603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6def00) 00010000:00010000:1.0:1777497738.364052:0:90603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497738.364055:0:90603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364060:0:90603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896cbe00/0x3e357265691df22 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497738.364081:0:90603:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001d956422 reply state 0000000068523c78 transno 115964117002 ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364092:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.364118:0:90603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff92409f6de400) 00010000:00010000:1.0:1777497738.364120:0:90603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497738.364123:0:90603:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1777497738.364198:0:90603:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00000020:00080000:1.0:1777497738.364215:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.364218:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000020:00080000:1.0:1777497738.364221:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.364223:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 1, queue_len: 0, req_transno: 0, next_transno: 115964117003 00000100:00100000:3.0:1777497738.370887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497738.370924:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360448 00000100:00100000:3.0:1777497738.370949:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360448 00000100:00100000:3.0:1777497738.371019:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1385 00000100:00100000:3.0:1777497738.371030:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546360448:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 00010000:00080000:3.0:1777497738.371056:0:73210:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff924086430e00 x1863837546360448/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:494/0 lens 224/0 e 0 to 0 dl 1777497749 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497738.371079:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546360448:12345-192.168.202.4@tcp:400:ldlm_lock_repla.0 Request processed in 53us (204us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497738.371086:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1385 00000020:00080000:1.0:1777497738.371232:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.371236:0:90603:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 2, connected: 2, completed: 2, queue_len: 0, req_transno: 0, next_transno: 115964117003 00010000:00080000:1.0:1777497738.371240:0:90603:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00000020:00080000:1.0:1777497738.371242:0:90603:0:(update_recovery.c:580:distribute_txn_get_next_transno()) lustre-MDT0000: Next update transno 0 00010000:00080000:1.0:1777497738.371249:0:90603:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:1.0:1777497738.371251:0:90603:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777497738.371258:0:90603:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 0@lo: req@ffff924086430380 x1863837565041408/t0(0) o101->lustre-MDT0001-mdtlov_UUID@0@lo:494/0 lens 328/0 e 0 to 0 dl 1777497749 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1777497738.371276:0:90603:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497738.371304:0:90603:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df37 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x3e357265691d64d expref: -99 pid: 90603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.371338:0:90603:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691d64d expref: 7 pid: 90603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.371363:0:90603:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896caa00/0x3e357265691df37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691d64d expref: 7 pid: 90603 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.371370:0:90603:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f896caa00, rc 0) 00010000:00080000:1.0:1777497738.371431:0:90603:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-MDT0000: recovery timer will expire in 100 seconds 00010000:00080000:1.0:1777497738.371443:0:90603:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00010000:3.0:1777497738.372111:0:3656:0:(ldlm_request.c:2765:replay_lock_interpret()) ### replayed lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff924087d38600/0x3e357265691d64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x3e357265691df37 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497738.372123:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000100:00100000:3.0:1777497738.372155:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565041408:0@lo:101:ldlm_lock_repla.0 00000100:00100000:3.0:1777497738.372180:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565041792:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:3.0:1777497738.372218:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.372410:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041792 00000100:00100000:1.0:1777497738.372417:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041792 00000100:00100000:1.0:1777497738.372467:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4074 00000100:00100000:1.0:1777497738.372475:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1863837565041792:12345-0@lo:400:ptlrpcd_rcv.0 00010000:00080000:1.0:1777497738.372488:0:8407:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff924086433b80 x1863837565041792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:494/0 lens 224/0 e 0 to 0 dl 1777497749 ref 2 fl Interpret:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497738.372504:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3656:x1863837565041792:12345-0@lo:400:ptlrpcd_rcv.0 Request processed in 30us (286us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497738.372509:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4074 00010000:00080000:1.0:1777497738.372521:0:90603:0:(ldlm_lib.c:2271:check_for_next_lock()) waking for completed lock replay 00000001:00000004:1.0:1777497738.372627:0:90603:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 28, last_transno is 120259084288 00000001:00100000:1.0:1777497738.375362:0:90569:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1777497738.375372:0:90569:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00080000:1.0:1777497738.375399:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 115964117002 is committed 00010000:00010000:3.0:1777497738.375459:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375473:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375482:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375488:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497738.375493:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375513:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375536:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.375542:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f896ca600/0x3e357265691df29 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 90603 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497738.376513:0:90603:0:(tgt_lastrcvd.c:223:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00010000:00080000:1.0:1777497738.376554:0:90603:0:(ldlm_lib.c:1982:target_cancel_recovery_timer()) lustre-MDT0000: cancel recovery timer 00010000:00080000:1.0:1777497738.376570:0:90603:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 192.168.202.4@tcp: req@ffff924086430e00 x1863837546360448/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:494/0 lens 224/0 e 0 to 0 dl 1777497749 ref 1 fl Complete:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1777497738.376687:0:90603:0:(ldlm_lib.c:2923:target_recovery_thread()) @@@ processing final ping from 0@lo: req@ffff924086433b80 x1863837565041792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:494/0 lens 224/0 e 0 to 0 dl 1777497749 ref 1 fl Complete:/2c0/ffffffff rc 0/-1 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1777497738.376780:0:90603:0:(ldlm_lib.c:1854:target_finish_recovery()) lustre-MDT0000: Recovery over after 0:04, of 2 clients 2 recovered and 0 were evicted. 00000100:00080000:2.0:1777497738.376847:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from REPLAY_WAIT to RECOVER 00000100:00080000:2.0:1777497738.376857:0:3656:0:(client.c:3223:ptlrpc_resend_req()) @@@ going to resend req@ffff924086432a00 x1863837565041792/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497754 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497738.376866:0:3656:0:(client.c:3232:ptlrpc_resend_req()) @@@ it has reply, so skip it req@ffff924086432a00 x1863837565041792/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497754 ref 1 fl Interpret:RQU/2c0/0 rc 0/0 job:'ptlrpcd_rcv.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497738.376873:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92408395d800 lustre-MDT0000_UUID: changing import state from RECOVER to FULL 00000100:02000000:2.0:1777497738.376887:0:3656:0:(import.c:1737:ptlrpc_import_recovery_state_machine()) lustre-MDT0000-osp-MDT0001: Connection restored to 0@lo (at 0@lo) 00000100:00080000:2.0:1777497738.376899:0:3656:0:(recover.c:189:ptlrpc_wake_delayed()) @@@ waking (set 00000000a82b3b15): req@ffff9240a6de3480 x1863837565041664/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp_up0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497738.376915:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565041792:0@lo:400:ptlrpcd_rcv.0 00000100:00100000:2.0:1777497738.376990:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565041920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497738.377031:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.380897:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041920 00000100:00100000:3.0:1777497738.380912:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041920 00000100:00100000:3.0:1777497738.380975:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1777497738.380988:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565041920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497738.381025:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:3.0:1777497738.381152:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565041920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 168us (4119us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.381161:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4075 00000100:00100000:3.0:1777497738.381215:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240af503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565041920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497738.383289:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497738.383336:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497738.383376:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565041664 00000100:00100000:3.0:1777497738.383384:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565041664 00000100:00100000:3.0:1777497738.383437:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4076 00000100:00100000:3.0:1777497738.383446:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:72705:x1863837565041664:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777497738.383656:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72705:x1863837565041664:12345-0@lo:1000:osp_up0-1.0 Request processed in 211us (372us total) trans 120259084289 rc 0/0 00000100:00100000:3.0:1777497738.383665:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4076 00000100:00100000:2.0:1777497738.383841:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de3480 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565041664:0@lo:1000:osp_up0-1.0 00000004:00080000:2.0:1777497738.383854:0:72705:0:(osp_trans.c:1330:osp_get_next_request()) ou ffff923f86215d80 version 16 rpc_version 16 00000020:00100000:2.0:1777497738.383876:0:72705:0:(genops.c:2444:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1777497738.383882:0:72705:0:(client.c:806:ptlrpc_reassign_next_xid()) @@@ reassign xid req@ffff924086e9c000 x1863837565042176/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 488/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497738.383902:0:72705:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565042176:0@lo:1000:osp_up0-1.0 00000100:00100000:2.0:1777497738.383930:0:72705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497738.383954:0:72705:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c7b1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497738.384400:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042176 00000100:00100000:3.0:1777497738.384407:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042176 00000100:00100000:3.0:1777497738.384447:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1777497738.384454:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:72705:x1863837565042176:12345-0@lo:1000:osp_up0-1.0 00000100:00100000:3.0:1777497738.384554:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:72705:x1863837565042176:12345-0@lo:1000:osp_up0-1.0 Request processed in 101us (623us total) trans 120259084290 rc 0/0 00000100:00100000:3.0:1777497738.384560:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4077 00000100:00100000:3.0:1777497738.384592:0:72705:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c000 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:72705:1863837565042176:0@lo:1000:osp_up0-1.0 00010000:00010000:3.0:1777497738.411639:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1777497738.422501:0:90603:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb9ef04efbe10 00100000:10000000:1.0:1777497738.422515:0:90603:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000004:00080000:3.0:1777497738.427637:0:90590:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x303:0x0] 00000100:00100000:3.0:1777497738.427685:0:90590:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086432a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90590:1863837565042304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1777497738.427778:0:90588:0:(osp_precreate.c:878:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x302:0x0] 00000100:00100000:1.0:1777497738.427798:0:90588:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565042432:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1777497738.427860:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.427884:0:90588:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497738.427908:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042432 00000100:00100000:1.0:1777497738.427915:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042432 00000100:00100000:1.0:1777497738.427964:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5900 00000100:00100000:1.0:1777497738.427974:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+6:90588:x1863837565042432:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1777497738.428003:0:25495:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -95 00002000:02000040:1.0:1777497738.428008:0:25495:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:771 to 0x280000401:865) 00000100:00100000:3.0:1777497738.428852:0:90590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497738.428880:0:90590:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f8602bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497738.428908:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042304 00000100:00100000:3.0:1777497738.428913:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042304 00000100:00100000:3.0:1777497738.428946:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5901 00000100:00100000:3.0:1777497738.428953:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:90590:x1863837565042304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1777497738.428972:0:25497:0:(ofd_dev.c:1637:ofd_create_hdl()) ofd_last_id() = 865 -> diff = -94 00002000:02000040:3.0:1777497738.428976:0:25497:0:(ofd_dev.c:1488:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:772 to 0x2c0000401:865) 00002000:00010000:1.0:1777497738.437926:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.437940:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.437958:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.437960:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.437966:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.437983:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.437994:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438009:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438031:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.438050:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.438057:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438065:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cbe00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.438070:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438080:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438122:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438131:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e48ccaa/0x3e357265691df3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.438155:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.438157:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.438158:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.439606:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.439625:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.439639:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.439641:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.439646:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.439659:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.439977:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.439987:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440024:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497738.440044:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497738.440052:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440062:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497738.440073:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497738.440076:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.440086:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440088:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440125:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.440127:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.440131:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440135:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440147:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440149:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000919b16aa/0x3e357265691df45 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440167:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440174:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.440176:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440177:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497738.440180:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.440205:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497738.440225:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497738.440231:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440238:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896ca600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497738.440242:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497738.440245:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.440254:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440255:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440275:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.440278:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497738.440280:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440281:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440292:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440298:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085dfbf1b/0x3e357265691df4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.440303:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.440328:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497738.440330:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497738.440331:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.441538:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441559:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1777497738.441624:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497738.441630:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.441639:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497738.441642:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497738.441643:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.441653:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.441656:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.441680:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.441687:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc88adbc/0x3e357265691df53 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441760:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.441763:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.441768:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441785:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441795:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.441798:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497738.441801:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497738.441804:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.441807:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441827:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.441838:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.441842:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441849:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164fa00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.441853:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441860:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441878:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441885:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c408c561/0x3e357265691df5a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441900:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.441902:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.441904:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.441945:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.441951:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441959:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.441961:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.441964:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441973:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441981:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.441988:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.442340:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497738.442387:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.442392:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.442400:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.442402:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.442405:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.442414:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.442422:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.442429:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.446825:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497738.446842:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.446856:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:0.0:1777497738.446862:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.446875:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.446899:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.446905:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003edab67b/0x3e357265691df61 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447076:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497738.447132:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497738.447139:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447148:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ec00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497738.447152:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447159:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447189:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447195:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c80a73b/0x3e357265691df68 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447210:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497738.447212:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.447213:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497738.447214:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.447222:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447235:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.447238:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.447250:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447269:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447278:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447285:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447315:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1777497738.447352:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497738.447358:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497738.447358:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.447366:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447371:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497738.447376:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447380:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.447384:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497738.447388:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447389:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447413:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447414:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447433:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447434:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c22015/0x3e357265691df6f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447477:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447485:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497738.447488:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.447495:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1777497738.447502:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447510:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497738.447514:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447521:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447531:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497738.447537:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1777497738.447539:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863d78de/0x3e357265691df76 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447545:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447558:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497738.447560:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.447560:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497738.447564:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.447566:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.447567:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.447577:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447585:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447592:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447763:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497738.447806:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.447811:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447829:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.447831:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.447834:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447843:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447850:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.447856:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448194:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497738.448201:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448209:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ee00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497738.448218:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448226:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448239:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448246:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003847dcc6/0x3e357265691df7d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448261:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.448272:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497738.448275:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448278:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.448279:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497738.448282:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448289:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164ea00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.448293:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448302:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448336:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448343:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082364375/0x3e357265691df84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448357:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448359:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448361:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.448408:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.448414:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448423:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.448425:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.448428:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448438:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448447:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448454:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448485:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497738.448524:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.448529:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448538:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.448539:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.448542:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448551:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448560:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448567:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448581:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497738.448587:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497738.448591:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448598:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.448601:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448848:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448861:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448869:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5b4c72d/0x3e357265691df8b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448882:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.448885:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448892:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.448895:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448903:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448912:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448920:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d635a955/0x3e357265691df92 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.448946:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448947:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.448950:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.448990:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.448996:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449004:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449006:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449009:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449018:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449026:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449034:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449049:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.449055:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.449058:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449077:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.449081:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449089:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449125:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449133:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006fffccf2/0x3e357265691df99 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449146:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449148:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449150:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.449190:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.449195:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449204:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449206:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449209:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449218:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449233:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449241:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449253:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.449260:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.449263:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449270:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164e000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.449273:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449282:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449292:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449300:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2472938/0x3e357265691dfa0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449328:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449334:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449336:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.449374:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.449379:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449387:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449389:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449392:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449401:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449409:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449416:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449428:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.449434:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.449437:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449444:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.449446:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449465:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449475:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449482:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f985019/0x3e357265691dfa7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449495:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449497:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449499:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.449533:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.449538:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 3/0,1 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449547:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449549:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449551:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449560:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449568:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449585:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449597:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.449604:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.449607:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449814:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408164f600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.449820:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449829:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449840:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449848:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000878a4426/0x3e357265691dfae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449862:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449863:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.449866:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.449908:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.449920:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449928:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449930:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.449933:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449942:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449950:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449958:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449971:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.449978:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.449981:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449988:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.449991:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.449999:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450023:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450030:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f275c730/0x3e357265691dfb5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450043:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450045:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450047:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.450083:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.450089:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450116:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450117:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450120:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450129:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450138:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450145:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450167:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.450174:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.450177:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450184:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.450187:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450194:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450204:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450211:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c3b917/0x3e357265691dfbc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450223:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450225:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450227:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.450264:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.450269:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450276:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450282:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450286:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450295:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450303:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450324:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450337:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.450343:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.450347:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450354:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.450358:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450367:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450377:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450395:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004edfb43b/0x3e357265691dfc3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450408:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450410:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450412:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.450449:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.450454:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450462:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450464:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450467:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450478:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450486:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450494:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450508:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.450514:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.450523:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450531:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.450535:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450543:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450555:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450562:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d83b37b8/0x3e357265691dfca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450578:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450580:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450582:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.450826:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.450832:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450841:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450843:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.450846:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450867:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450875:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450883:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450897:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.450904:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.450908:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450915:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.450918:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450926:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450937:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450945:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3c8282b/0x3e357265691dfd1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.450964:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450966:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.450967:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.451005:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.451010:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451018:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451020:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451023:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451032:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451040:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451047:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451059:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.451064:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.451068:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451086:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.451090:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451130:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451141:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451149:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000422a6df/0x3e357265691dfd8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451162:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451164:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451165:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.451201:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.451206:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451214:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451216:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451219:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451228:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451242:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451251:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451264:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.451271:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.451275:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451283:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.451286:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451294:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451305:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451325:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041974fa0/0x3e357265691dfdf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451338:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451344:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451346:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.451389:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.451393:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451401:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451402:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451405:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451413:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451420:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451428:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451439:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.451445:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.451448:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451454:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.451457:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451476:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451487:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451494:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000707eba7a/0x3e357265691dfe6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451509:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497738.451510:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451511:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.451515:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.451555:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.451561:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 3/0,1 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451569:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451571:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.451574:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451582:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451590:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.451606:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.452051:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x361:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.452058:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.452068:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.452069:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.452072:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.452084:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.452130:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.452137:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452450:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.452461:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.452465:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452472:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.452475:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452483:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452495:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 1/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452503:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941ac3e7/0x3e357265691dfed lrc: 0/0,0 mode: --/PW res: [0x280000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452517:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.452520:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.452521:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.452581:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.452595:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.452603:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.452604:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.452607:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453085:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.453125:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.453131:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453139:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.453143:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453152:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453166:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453172:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691dff4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x361:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453190:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.453199:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.453201:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453371:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453380:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453388:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453404:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.453414:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.453418:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453425:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.453428:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453436:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.453444:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x360:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.453453:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453462:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453463:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.453467:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.453472:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453474:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006897227/0x3e357265691dffb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453499:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453502:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453505:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.453507:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453517:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453525:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.453548:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.453554:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.453559:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453567:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.453570:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453578:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453590:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453598:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f241dee/0x3e357265691e002 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x360:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453694:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453696:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453698:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.453714:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.453719:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453727:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.453729:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.453732:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453741:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453749:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453757:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453779:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497738.453818:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.453823:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453842:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.453844:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.453847:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453857:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453866:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453874:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453888:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497738.453895:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497738.453899:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453905:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.453908:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453915:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453937:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453943:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5b30c6b/0x3e357265691e009 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453963:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.453966:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453971:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.453974:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453981:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497738.453985:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.453991:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.453999:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087864bac/0x3e357265691e010 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454010:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.454012:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.454025:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.454057:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1777497738.454066:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.454071:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454079:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454080:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454083:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454113:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454122:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454128:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454143:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1777497738.454176:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.454180:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454187:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454189:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454191:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454210:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454218:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454225:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454237:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1777497738.454277:0:25495:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.454281:0:25495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454288:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454289:0:25495:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.454293:0:25495:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454301:0:25495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454320:0:25495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454326:0:25495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454346:0:25495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1777497738.454353:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1777497738.454356:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454362:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.454366:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454374:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454384:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454391:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e3a79a8/0x3e357265691e017 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454404:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497738.454406:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.454412:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.454415:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454591:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.454597:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454605:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.454609:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454622:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454634:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454641:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e099238/0x3e357265691e025 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454655:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.454657:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.454659:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.454713:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.454718:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454727:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.454729:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.454732:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454742:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454750:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454767:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454781:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.454788:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.454793:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454801:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.454804:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454812:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454823:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454831:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000945bcab1/0x3e357265691e02c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454844:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.454846:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.454848:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.454888:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.454899:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454907:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.454909:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.454912:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454921:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454929:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454937:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454950:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.454956:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.454959:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454966:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.454969:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.454980:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455006:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455011:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455021:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cf1b287/0x3e357265691e033 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455023:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455040:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2e3cf93/0x3e357265691e01e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455046:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455049:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455051:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455059:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455061:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455063:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.455124:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.455130:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455139:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455141:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455143:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455152:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455160:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455167:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1777497738.455176:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777497738.455193:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497738.455194:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.455201:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455205:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455211:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5a200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.455214:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455223:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455236:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.455243:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.455254:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455258:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054cf0367/0x3e357265691e03a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455272:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.455274:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455275:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.455277:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455279:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455280:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455290:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455297:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455304:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455327:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.455334:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.455338:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455345:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ac00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.455354:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455362:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455374:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455381:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffb1eefd/0x3e357265691e041 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455397:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455400:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455402:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.455449:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.455454:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455462:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455464:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455466:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455476:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455485:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455498:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455515:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.455523:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.455526:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455533:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5ba00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.455537:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455545:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455557:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455564:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e89544fa/0x3e357265691e048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455581:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455584:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455585:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.455633:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x35a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.455644:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455651:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455652:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455655:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455663:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455670:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455676:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455689:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.455695:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.455698:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455704:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.455706:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455713:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455731:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455737:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d48c4cf2/0x3e357265691e04f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455751:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455753:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455754:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.455803:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x359:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.455808:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455817:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455818:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455821:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455832:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455841:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455848:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455882:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.455887:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.455893:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455902:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5be00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.455906:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455914:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.455921:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x358:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.455925:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455928:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455944:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000651952ce/0x3e357265691e056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x359:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455946:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455950:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.455953:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455966:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.455966:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455969:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.455972:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.455977:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.455986:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456000:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.456008:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.456013:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456020:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456024:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456040:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456053:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1777497738.456059:0:25495:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:770 00010000:00010000:3.0:1777497738.456061:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0788e68/0x3e357265691e05d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x358:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456078:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456080:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456082:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.456151:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x357:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.456157:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456166:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456168:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456171:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456180:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456188:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456194:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:90588:x1863837565042432:12345-0@lo:5:osp-pre-0-0.0 Request processed in 28217us (28330us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.456206:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5900 00010000:00010000:3.0:1777497738.456213:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456227:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.456234:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.456238:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456244:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456248:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456256:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456266:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456274:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c5ea5aea/0x3e357265691e064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x357:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456281:0:90588:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565042432:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497738.456285:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456288:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456290:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1777497738.456300:0:90588:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x361:0x0] from OST, last_created [0x280000401:0x361:0x0]last_used is [0x280000401:0x302:0x0] 00002000:00010000:3.0:1777497738.456344:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x356:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.456356:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456365:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456367:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456370:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456380:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456387:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456396:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456403:0:90588:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565042688:0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497738.456412:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.456418:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.456422:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456429:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456433:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456441:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456449:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497738.456466:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456473:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5485bc/0x3e357265691e06b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x356:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456476:0:90588:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050480 going to sleep for 11 seconds 00010000:00010000:3.0:1777497738.456491:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456493:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456495:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497738.456501:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565042560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497738.456530:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1777497738.456543:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x355:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.456549:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456557:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456559:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456562:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456571:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456575:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042688 00010000:00010000:3.0:1777497738.456578:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456583:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042688 00010000:00010000:3.0:1777497738.456587:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456612:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.456646:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x354:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.456650:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456656:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456657:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456660:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456668:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456676:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456682:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456694:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497738.456700:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497738.456703:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456710:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456713:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456727:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456737:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456744:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb303a46/0x3e357265691e072 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x355:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456757:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.456761:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456767:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456770:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456775:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5902 00010000:00010000:3.0:1777497738.456784:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497738.456790:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:90588:x1863837565042688:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:3.0:1777497738.456800:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456810:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f0115d5/0x3e357265691e079 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x354:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456837:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456839:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.456843:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1777497738.456847:0:25489:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 866 00002000:00010000:3.0:1777497738.456887:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x353:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.456893:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456901:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456903:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.456907:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456917:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456926:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456934:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456949:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.456956:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.456961:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456983:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.456987:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.456996:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457007:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457016:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022c72b74/0x3e357265691e080 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x353:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457033:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.457036:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.457037:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.457090:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x352:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.457144:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457152:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.457153:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.457156:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457167:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457182:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457189:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457204:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.457212:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.457216:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457223:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.457227:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457235:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457248:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457254:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000200a2bed/0x3e357265691e087 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x352:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.457268:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.457275:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.457277:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497738.458354:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:90588:x1863837565042688:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1565us (1905us total) trans 4294969459 rc 0/0 00000100:00100000:1.0:1777497738.458363:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5902 00000100:00100000:1.0:1777497738.458393:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042560 00000100:00100000:1.0:1777497738.458398:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042560 00000100:00100000:1.0:1777497738.458426:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1777497738.458432:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565042560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1777497738.458451:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00100000:1.0:1777497738.458480:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3657:x1863837565042560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (1950us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.458495:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:1.0:1777497738.458546:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565042560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497738.458578:0:90588:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565042688:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1777497738.458591:0:90588:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x361:0x0]-[0x280000401:0x381:0x0] 00010000:00010000:1.0:1777497738.458609:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.459145:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.468222:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x351:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.468232:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468250:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468252:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468264:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468280:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468290:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468298:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468332:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.468384:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x350:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.468389:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468395:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468396:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468399:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468418:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468425:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468432:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468446:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497738.468456:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497738.468461:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468469:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.468474:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468481:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468508:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468517:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000101643e1/0x3e357265691e08e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x351:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468542:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.468545:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468552:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.468555:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468561:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468570:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468576:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d14c1a0a/0x3e357265691e095 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x350:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468586:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.468587:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.468589:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.468629:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.468633:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468640:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468646:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.468649:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468658:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468665:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468671:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.468684:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.469048:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.469054:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469061:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.469065:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469073:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469085:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469135:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009099c113/0x3e357265691e09c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469152:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.469153:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.469155:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.469322:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.469328:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469337:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.469339:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.469342:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469351:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469359:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469366:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469382:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.469420:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.469431:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469438:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.469440:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.469442:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469452:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469460:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469467:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.469479:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1777497738.469717:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1777497738.469725:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469734:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.469738:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469745:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469758:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469765:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050fe3d95/0x3e357265691e0a3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469784:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.469786:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469801:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.469804:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469811:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469820:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469828:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc1753c0/0x3e357265691e0aa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.469840:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.469842:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.469843:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.469850:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.470183:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.470190:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470199:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.470200:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.470204:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470213:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470227:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470235:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470248:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.470256:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.470349:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470357:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.470360:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470367:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470379:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470386:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b801a35/0x3e357265691e0b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470400:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.470408:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.470410:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.470454:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.470460:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470468:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.470470:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.470473:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.470482:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497738.470827:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.471397:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.471412:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.471463:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1777497738.471474:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.471479:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.471487:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89400 already unused, calling callback (ffffffffc0d802e0) 00000001:00100000:1.0:1777497738.472434:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1777497738.472811:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.472845:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.472865:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.472872:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074ebccff/0x3e357265691e0b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.472898:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.472900:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.472902:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.472999:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x34a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.473005:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473016:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.473018:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.473022:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473034:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473042:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473061:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473087:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.473148:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.473156:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.473167:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d89200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.473171:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.473176:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x349:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.473183:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473206:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.473209:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.473209:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473212:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473232:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.473234:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.473248:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.473251:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b90fc172/0x3e357265691e0bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.473285:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.473286:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.473288:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.475125:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475155:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.475284:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x348:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.475291:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475329:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475332:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475338:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475354:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475364:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475372:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475390:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497738.475402:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497738.475408:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475417:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88000 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.475422:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475432:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475462:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475471:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad56b62d/0x3e357265691e0c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x349:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475766:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.475772:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475780:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240baa5b400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.475783:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475791:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475803:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475810:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007799fb31/0x3e357265691e0cd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x348:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475826:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.475829:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.475836:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.475890:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x347:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.475896:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475904:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475906:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475908:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475917:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475924:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475931:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475943:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.475979:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x346:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.475983:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.475990:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475992:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.475995:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476015:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476023:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476029:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476046:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1777497738.476054:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1777497738.476058:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476064:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.476067:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476073:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476082:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476089:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007bad15ef/0x3e357265691e0d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x347:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476133:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1777497738.476136:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476143:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17a00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.476146:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476153:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476163:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476170:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007136edcc/0x3e357265691e0db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x346:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476182:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.476184:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.476186:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1777497738.476233:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x345:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.476239:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.476247:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.476257:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497738.477597:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497738.477606:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.483930:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.483964:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.483976:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.483983:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484012:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.484043:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.484050:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484060:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17800 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.484065:0:83956:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484075:0:83956:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484120:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.484141:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x344:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.484143:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8f60f1c/0x3e357265691e0e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x345:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484150:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484161:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.484163:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.484167:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484170:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484172:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484175:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.484181:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484190:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484209:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484227:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.484243:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.484248:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484256:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16200 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.484260:0:8412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484276:0:8412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497738.484283:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x343:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1777497738.484288:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484290:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484299:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047e0e9d8/0x3e357265691e0e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x344:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484315:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.484318:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.484322:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484327:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484330:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484333:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.484336:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484347:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484354:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484375:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1777497738.484411:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x342:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1777497738.484415:0:25497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484425:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.484432:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484438:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497738.484441:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497738.484443:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17e00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497738.484446:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484448:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484469:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484470:0:25497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484487:0:25497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484488:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484497:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc55ff06/0x3e357265691e0f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x343:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497738.484515:0:25497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484517:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484520:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484523:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497738.484536:0:25497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497738.484543:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497738.484547:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484555:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16c00 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497738.484559:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484577:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484589:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484597:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003033e986/0x3e357265691e0f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x342:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497738.484623:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484626:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497738.484629:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1777497738.485445:0:25497:0:(ofd_dev.c:1515:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:771 00000100:00100000:3.0:1777497738.485562:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:90590:x1863837565042304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 56604us (56706us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497738.485574:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5901 00000100:00100000:1.0:1777497738.485620:0:90590:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086432a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90590:1863837565042304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1777497738.485641:0:90590:0:(osp_precreate.c:956:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x361:0x0] from OST, last_created [0x2c0000401:0x361:0x0]last_used is [0x2c0000401:0x303:0x0] 00000100:00100000:1.0:1777497738.485719:0:90590:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90590:1863837565042944:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1777497738.485763:0:90590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.485787:0:90590:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f86050480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497738.485806:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497738.485831:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497738.485868:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042944 00000100:00100000:1.0:1777497738.485874:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042944 00000100:00100000:1.0:1777497738.485913:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1777497738.485922:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:90590:x1863837565042944:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1777497738.485974:0:25493:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 866 00000100:00100000:1.0:1777497738.487497:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+6:90590:x1863837565042944:12345-0@lo:5:osp-pre-1-0.0 Request processed in 1570us (1727us total) trans 4294969455 rc 0/0 00000100:00100000:1.0:1777497738.487508:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5903 00000100:00100000:1.0:1777497738.487718:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565042816 00000100:00100000:1.0:1777497738.487724:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565042816 00000100:00100000:1.0:1777497738.487758:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1777497738.487767:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565042816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497738.487784:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497738.487817:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565042816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497738.487824:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:1.0:1777497738.487875:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565042816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497738.487906:0:90590:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:90590:1863837565042944:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1777497738.487916:0:90590:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x361:0x0]-[0x2c0000401:0x381:0x0] 00000100:00100000:2.0:1777497739.085893:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497739.085938:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497739.085970:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497739.085999:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360832 00000100:00100000:2.0:1777497739.086007:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360832 00000100:00100000:2.0:1777497739.086068:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360704 00000100:00100000:2.0:1777497739.086072:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360704 00000100:00100000:2.0:1777497739.086119:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1386 00000100:00100000:2.0:1777497739.086130:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546360832:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497739.086220:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546360832:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497739.086228:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1386 00000100:00100000:2.0:1777497739.086245:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1387 00000100:00100000:2.0:1777497739.086252:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546360704:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497739.086291:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546360704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 40us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497739.086298:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1387 00000100:00080000:2.0:1777497739.086327:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497739.086529:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360576 00000100:00100000:1.0:1777497739.086534:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360576 00000100:00100000:1.0:1777497739.086566:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 78 00000100:00100000:1.0:1777497739.086573:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546360576:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497739.086605:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546360576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497739.086611:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 78 00000020:00000004:0.0:1777497739.128483:0:90892:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1777497739.128788:0:90892:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1777497739.426476:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1777497740.017414:0:90942:0:(tgt_mount.c:2299:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497740.017991:0:90942:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1777497740.324312:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497740.324342:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565043072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497740.324417:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497740.325391:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043072 00000100:00100000:0.0:1777497740.325401:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043072 00000100:00100000:0.0:1777497740.325493:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1777497740.325505:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565043072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497740.325538:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497740.325600:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565043072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497740.325622:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1777497740.325852:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565043072:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497740.326423:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497740.328948:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565043200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497740.329015:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497740.332965:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043200 00000100:00100000:1.0:1777497740.332980:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043200 00000100:00100000:1.0:1777497740.333124:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:1.0:1777497740.333138:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565043200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1777497740.333188:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 210112 pending 0 free 3922481152 avail 3690958848 00000100:00080000:2.0:1777497740.333451:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497740.336924:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565043200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3782us (7900us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497740.336939:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:0.0:1777497740.337652:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565043200:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1777497740.450996:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497741.479480:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497742.243599:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497742.244327:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546360960 00000100:00100000:1.0:1777497742.244338:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546360960 00000100:00080000:2.0:1777497742.244411:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497742.244428:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1442 00000100:00100000:1.0:1777497742.244439:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:71687:x1863837546360960:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:1.0:1777497742.244459:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497742.244479:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734400/0x3e357265691e0fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c471 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244550:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244564:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244578:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497742.244634:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1777497742.244638:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497742.244674:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244697:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734400/0x3e357265691e0fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c471 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244735:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c471 expref: 7 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497742.244743:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497742.244746:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497742.244749:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735600, rc 0) 00000100:00100000:1.0:1777497742.244814:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:71687:x1863837546360960:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 378us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497742.244832:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1442 00000100:00100000:1.0:1777497742.260588:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497742.260785:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361088 00000100:00100000:2.0:1777497742.260795:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361088 00000100:00100000:2.0:1777497742.262376:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1443 00000100:00100000:2.0:1777497742.262396:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:71687:x1863837546361088:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497742.262439:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:2.0:1777497742.262525:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:71687:x1863837546361088:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 138us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497742.262532:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1443 00000100:00100000:2.0:1777497742.266728:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497742.267479:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361216 00000100:00100000:3.0:1777497742.267491:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361216 00000100:00100000:2.0:1777497742.267719:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1444 00000100:00100000:2.0:1777497742.267730:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:71687:x1863837546361216:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497742.268054:0:63729:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497742.268194:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:71687:x1863837546361216:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 465us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497742.268202:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1444 00000100:00080000:1.0:1777497742.268717:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1777497742.283282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497742.283414:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361344 00000100:00100000:2.0:1777497742.283425:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361344 00000100:00100000:2.0:1777497742.283480:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5904 00000100:00100000:2.0:1777497742.283488:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2411:x1863837546361344:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:2.0:1777497742.283524:0:25496:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3871 last 0 00000020:00000080:2.0:1777497742.283561:0:25496:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691e10c 00002000:00100000:2.0:1777497742.283573:0:25496:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff924086e21800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8409088 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1777497742.283593:0:25496:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1777497742.283662:0:25496:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1777497742.283696:0:25496:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497742.283770:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546361344:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 282us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497742.283778:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5904 00000100:00100000:3.0:1777497742.287320:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497742.288176:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361472 00000100:00100000:0.0:1777497742.288187:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361472 00000100:00100000:0.0:1777497742.288320:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2170 00000100:00100000:0.0:1777497742.288331:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71687:x1863837546361472:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:0.0:1777497742.288358:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497742.288433:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71687:x1863837546361472:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 105us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497742.288454:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2170 00000100:00080000:1.0:1777497742.290541:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497742.293503:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497742.293936:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361600 00000100:00100000:2.0:1777497742.293956:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361600 00000100:00100000:2.0:1777497742.294014:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5905 00000100:00100000:2.0:1777497742.294023:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2411:x1863837546361600:12345-192.168.202.4@tcp:8:lfs.0 00010000:00080000:2.0:1777497742.294325:0:8398:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0001: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp t0 exp 0000000000000000 cur 3871 last 0 00000020:00000080:2.0:1777497742.294358:0:8398:0:(genops.c:1406:class_connect()) connect: client d146155b-4321-4b14-9284-f644ed9631fb, cookie 0x3e357265691e113 00002000:00100000:2.0:1777497742.294368:0:8398:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff924086e23000 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1777497742.294399:0:8398:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1777497742.294467:0:8398:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1777497742.294499:0:8398:0:(import.c:65:import_set_state_nolock()) ffff924086e22800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1777497742.294569:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546361600:12345-192.168.202.4@tcp:8:lfs.0 Request processed in 547us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497742.294576:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5905 00000100:00100000:2.0:1777497742.301569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497742.301755:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361728 00000100:00100000:3.0:1777497742.301770:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361728 00000100:00100000:3.0:1777497742.301880:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2171 00000100:00100000:3.0:1777497742.301892:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71687:x1863837546361728:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497742.301940:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497742.302031:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+6:71687:x1863837546361728:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 141us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497742.302039:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2171 00000100:00080000:1.0:1777497742.303993:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777497742.504929:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497743.398055:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565043328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497743.398173:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.399311:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043328 00000100:00100000:2.0:1777497743.399322:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043328 00000100:00100000:2.0:1777497743.399386:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1777497743.399397:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565043328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497743.399444:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497743.399511:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565043328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.399519:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4078 00000100:00100000:2.0:1777497743.399609:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565043328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497743.399631:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497743.399639:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565043456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497743.399671:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.399704:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043456 00000100:00100000:2.0:1777497743.399708:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043456 00000100:00100000:2.0:1777497743.399735:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1777497743.399741:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3657:x1863837565043456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497743.399786:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:2.0:1777497743.399820:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:3657:x1863837565043456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.399841:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4079 00000100:00100000:2.0:1777497743.399882:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565043456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497743.400071:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565043840:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400126:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400145:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565044352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400167:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400184:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565044864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400208:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400226:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1777497743.400232:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565043968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400251:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400277:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565044480:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400298:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400325:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044352 00000100:00100000:2.0:1777497743.400329:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044352 00000100:00100000:2.0:1777497743.400371:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2663 00000100:00100000:2.0:1777497743.400378:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565044352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400414:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565044352:12345-0@lo:400:kworker.0 Request processed in 37us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.400420:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2663 00000100:00100000:2.0:1777497743.400440:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043840 00000100:00100000:2.0:1777497743.400444:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043840 00000100:00100000:2.0:1777497743.400470:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044864 00000100:00100000:2.0:1777497743.400487:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044864 00000100:00100000:2.0:1777497743.400507:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043968 00000100:00100000:2.0:1777497743.400520:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043968 00000100:00100000:2.0:1777497743.400540:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044480 00000100:00100000:2.0:1777497743.400543:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044480 00000100:00100000:2.0:1777497743.400556:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1777497743.400562:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400592:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565043840:12345-0@lo:400:kworker.0 Request processed in 31us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.400599:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:2.0:1777497743.400611:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1777497743.400616:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565044864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400642:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565044864:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.400647:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1777497743.400661:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1777497743.400666:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400690:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565043968:12345-0@lo:400:kworker.0 Request processed in 24us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.400695:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1777497743.400706:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:2.0:1777497743.400712:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565044480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400735:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565044480:12345-0@lo:400:kworker.0 Request processed in 24us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.400741:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00080000:2.0:1777497743.400762:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497743.400767:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497743.400769:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497743.400799:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565043968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400821:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565044480:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400830:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565043840:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400839:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565044352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400849:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb160e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565044864:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400904:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565043584:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400936:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.400968:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565044096:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.400988:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.401002:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565044608:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401018:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.401036:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777497743.401042:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565043712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401059:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.401074:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565044224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401119:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.401137:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565044736:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401157:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497743.401183:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043584 00000100:00100000:2.0:1777497743.401188:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043584 00000100:00100000:2.0:1777497743.401215:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1777497743.401221:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565043584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401256:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565043584:12345-0@lo:400:kworker.0 Request processed in 35us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401289:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1777497743.401318:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044096 00000100:00100000:2.0:1777497743.401323:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044096 00000100:00100000:2.0:1777497743.401347:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565043712 00000100:00100000:2.0:1777497743.401349:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565043712 00000100:00100000:2.0:1777497743.401363:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1777497743.401368:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565044096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401399:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565044096:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401405:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1777497743.401416:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:2.0:1777497743.401422:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401445:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565043712:12345-0@lo:400:kworker.0 Request processed in 24us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401451:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00080000:2.0:1777497743.401468:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497743.401470:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497743.401488:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565043712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401497:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565043584:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401507:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565044096:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401547:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044608 00000100:00100000:2.0:1777497743.401551:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044608 00000100:00100000:2.0:1777497743.401582:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044224 00000100:00100000:2.0:1777497743.401585:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044224 00000100:00100000:2.0:1777497743.401603:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044736 00000100:00100000:2.0:1777497743.401606:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044736 00000100:00100000:2.0:1777497743.401636:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1777497743.401642:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565044608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401675:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565044608:12345-0@lo:400:kworker.0 Request processed in 33us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401681:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2664 00000100:00100000:2.0:1777497743.401691:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1777497743.401696:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565044224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401717:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565044224:12345-0@lo:400:kworker.0 Request processed in 22us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401722:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2665 00000100:00100000:2.0:1777497743.401731:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2666 00000100:00100000:2.0:1777497743.401737:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565044736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401760:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:3659:x1863837565044736:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497743.401765:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2666 00000100:00080000:2.0:1777497743.401789:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497743.401791:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497743.401805:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565044224:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401815:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565044736:0@lo:400:kworker.0 00000100:00100000:2.0:1777497743.401825:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb160000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565044608:0@lo:400:kworker.0 00010000:00010000:1.0:1777497743.531341:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497743.906494:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497743.906578:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497743.906630:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1777497743.906638:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924087889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497743.906667:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497743.906696:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565044992 00000100:00100000:0.0:1777497743.906704:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565044992 00000100:00100000:0.0:1777497743.906760:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045120 00000100:00100000:0.0:1777497743.906762:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045120 00000100:00100000:0.0:1777497743.906781:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1777497743.906789:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565044992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497743.906816:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1777497743.906828:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565045120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497743.906839:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1777497743.906851:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497743.906902:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565044992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497743.906910:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:3.0:1777497743.906917:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565045120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497743.906926:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:3.0:1777497743.906977:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924087889500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565045120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497743.907166:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565044992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1777497744.189147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497744.189193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497744.189236:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497744.189335:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361984 00000100:00100000:2.0:1777497744.189346:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361984 00000100:00100000:2.0:1777497744.189411:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1394 00000100:00100000:2.0:1777497744.189422:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546361984:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497744.189496:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546361984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 77us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497744.189519:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1394 00000100:00080000:2.0:1777497744.189544:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497744.189799:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362240 00000100:00100000:0.0:1777497744.189804:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362240 00000100:00100000:0.0:1777497744.189853:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2667 00000100:00100000:0.0:1777497744.189860:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546362240:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497744.189895:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546362240:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497744.189902:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2667 00000100:00080000:2.0:1777497744.192439:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497744.192516:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497744.192572:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497744.192599:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362112 00000100:00100000:0.0:1777497744.192609:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362112 00000100:00080000:2.0:1777497744.192635:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497744.192705:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362368 00000100:00100000:1.0:1777497744.192710:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362368 00000100:00100000:0.0:1777497744.192746:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1395 00000100:00100000:1.0:1777497744.192757:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2668 00000100:00100000:0.0:1777497744.192762:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546362112:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497744.192772:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546362368:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497744.192853:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+6:2413:x1863837546362368:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497744.192875:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2668 00000100:00080000:1.0:1777497744.192897:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497744.193177:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546362112:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 422us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497744.193185:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1395 00000100:00100000:3.0:1777497744.193512:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546361856 00000100:00100000:3.0:1777497744.193518:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546361856 00000100:00100000:2.0:1777497744.193611:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 80 00000100:00100000:2.0:1777497744.193620:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546361856:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497744.193654:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546361856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 36us (4418us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497744.193660:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 80 00000001:00100000:0.0:1777497744.424345:0:8391:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00080000:0.0:1777497744.424362:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969459 is committed 00000001:00100000:3.0:1777497744.424444:0:9460:0:(tgt_lastrcvd.c:568:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d146155b-4321-4b14-9284-f644ed9631fb 00000001:00080000:3.0:1777497744.424454:0:9460:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0001: transno 4294969455 is committed 00000001:00080000:1.0:1777497744.424579:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084290 is committed 00010000:00010000:0.0:1777497744.546277:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497745.443829:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565045248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497745.443907:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497745.443971:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045248 00000100:00100000:0.0:1777497745.443996:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045248 00000100:00100000:0.0:1777497745.444060:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1777497745.444070:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565045248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497745.444125:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497745.444174:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565045248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497745.444181:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1777497745.444227:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565045248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497745.444988:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565045376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497745.445030:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497745.445157:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045376 00000100:00100000:2.0:1777497745.445163:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045376 00000100:00100000:2.0:1777497745.445215:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:2.0:1777497745.445225:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565045376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497745.445239:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497745.445284:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565045376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497745.445290:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1777497745.445371:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565045376:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497745.445791:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497745.445800:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497745.579690:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497746.134039:0:91039:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid 00010000:00010000:1.0:1777497746.594313:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497747.528753:0:91087:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec 00010000:00010000:1.0:1777497747.618286:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497748.514769:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565045504:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.514837:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.514882:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565046016:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.514908:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.514933:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565046528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.514953:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.514974:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565047040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.514988:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046016 00000100:00100000:0.0:1777497748.515000:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515003:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046016 00000100:00100000:0.0:1777497748.515026:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1777497748.515034:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565045888:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515063:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.515083:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565046400:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515134:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046528 00000100:00100000:3.0:1777497748.515139:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046528 00000100:00100000:3.0:1777497748.515177:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047040 00000100:00100000:3.0:1777497748.515182:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047040 00000100:00100000:0.0:1777497748.515189:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515202:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045888 00000100:00100000:3.0:1777497748.515207:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045888 00000100:00100000:0.0:1777497748.515225:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565046912:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515245:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1777497748.515253:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515277:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565046016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515294:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565045760:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515323:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.515340:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565046272:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515379:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515394:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565046016:12345-0@lo:400:kworker.0 Request processed in 121us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497748.515402:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565046784:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515407:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:3.0:1777497748.515438:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045760 00000100:00100000:0.0:1777497748.515443:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515445:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045760 00000100:00100000:0.0:1777497748.515472:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1777497748.515480:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1777497748.515486:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837565045632:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515493:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515522:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.515549:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565046144:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515567:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565046528:12345-0@lo:400:kworker.0 Request processed in 77us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.515576:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:0.0:1777497748.515591:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515594:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045632 00000100:00100000:3.0:1777497748.515599:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045632 00000100:00100000:0.0:1777497748.515619:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565046656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515625:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1777497748.515634:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565047040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515644:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497748.515662:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565047168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497748.515684:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565047040:12345-0@lo:400:kworker.0 Request processed in 50us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.515692:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1777497748.515702:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497748.515719:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1777497748.515732:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565045888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515752:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1777497748.515769:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565045760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515777:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565045888:12345-0@lo:400:kworker.0 Request processed in 48us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.515784:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1777497748.515799:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1777497748.515810:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837565045632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515847:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565045760:12345-0@lo:400:kworker.0 Request processed in 83us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497748.515855:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1777497748.515864:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1863837565045632:12345-0@lo:400:kworker.0 Request processed in 54us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.515880:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:0.0:1777497748.515913:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb161880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3660:1863837565045632:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.515943:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565045760:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.515946:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046400 00000100:00100000:3.0:1777497748.515952:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046400 00000100:00100000:3.0:1777497748.516004:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046912 00000100:00100000:3.0:1777497748.516010:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046912 00000100:00100000:0.0:1777497748.516014:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565045888:0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.516041:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565046016:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.516042:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046272 00000100:00100000:3.0:1777497748.516047:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046272 00000100:00100000:0.0:1777497748.516060:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565046528:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.516076:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046784 00000100:00100000:0.0:1777497748.516081:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565047040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.516083:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046784 00000100:00100000:3.0:1777497748.516157:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2669 00000100:00100000:3.0:1777497748.516167:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565046400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.516236:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565046400:12345-0@lo:400:kworker.0 Request processed in 70us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.516247:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2669 00000100:00100000:0.0:1777497748.516258:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1777497748.516270:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2671 00000100:00100000:0.0:1777497748.516276:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497748.516283:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565046272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.516344:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565046912:12345-0@lo:400:kworker.0 Request processed in 75us (1088us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497748.516352:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565046272:12345-0@lo:400:kworker.0 Request processed in 71us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497748.516362:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2670 00000100:00100000:3.0:1777497748.516372:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2671 00000100:00100000:0.0:1777497748.516400:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2672 00000100:00100000:2.0:1777497748.516474:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565045504 00000100:00100000:2.0:1777497748.516481:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565045504 00000100:00100000:2.0:1777497748.516519:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1777497748.516525:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565045504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497748.516568:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565045504:12345-0@lo:400:kworker.0 Request processed in 43us (1732us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497748.516585:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1777497748.516626:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046144 00000100:00100000:2.0:1777497748.516629:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046144 00000100:00100000:2.0:1777497748.516650:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565046656 00000100:00100000:2.0:1777497748.516652:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565046656 00000100:00100000:2.0:1777497748.516661:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047168 00000100:00100000:2.0:1777497748.516663:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047168 00000100:00100000:2.0:1777497748.516672:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4080 00000100:00100000:2.0:1777497748.516678:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1863837565046144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497748.516709:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:3660:x1863837565046144:12345-0@lo:400:kworker.0 Request processed in 31us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497748.516715:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4080 00000100:00100000:2.0:1777497748.516726:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4081 00000100:00100000:2.0:1777497748.516731:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565046656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497748.516753:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565046656:12345-0@lo:400:kworker.0 Request processed in 22us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497748.516759:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4081 00000100:00100000:2.0:1777497748.516770:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4082 00000100:00100000:2.0:1777497748.516775:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565047168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497748.516797:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:2.0:1777497748.516826:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565047168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (1132us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497748.516831:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4082 00000100:00100000:0.0:1777497748.517115:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565046784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497748.517151:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565046784:12345-0@lo:400:kworker.0 Request processed in 744us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497748.517258:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1777497748.517270:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565047296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497748.517300:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1777497748.517336:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497748.517341:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497748.517344:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497748.517346:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497748.517403:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565046400:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517413:0:3658:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294969455 gen 2 00000100:00100000:1.0:1777497748.517424:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565046912:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517432:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565045504:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517468:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 120259084290 gen 3 00000004:00080000:1.0:1777497748.517473:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084289 committed transno 120259084290 00000004:00080000:1.0:1777497748.517487:0:3660:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 120259084290 committed transno 120259084290 00000100:00100000:1.0:1777497748.517499:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565046144:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517509:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565046656:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517521:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408788b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565047168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497748.517544:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565046272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497748.517553:0:3660:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969459 gen 2 00000100:00100000:1.0:1777497748.517575:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565046784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497748.518502:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047296 00000100:00100000:2.0:1777497748.518511:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047296 00000100:00100000:2.0:1777497748.518567:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4083 00000100:00100000:2.0:1777497748.518578:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565047296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497748.518620:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497748.518675:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565047296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497748.518681:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4083 00000100:00100000:0.0:1777497748.522151:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2672 00000100:00100000:1.0:1777497748.524470:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565047296:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1777497748.642464:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497749.027695:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497749.027721:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565047424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497749.027791:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497749.028024:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497749.028034:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565047552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497749.028073:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497749.028146:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047424 00000100:00100000:0.0:1777497749.028155:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047424 00000100:00100000:0.0:1777497749.028216:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047552 00000100:00100000:0.0:1777497749.028219:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047552 00000100:00100000:0.0:1777497749.028244:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1777497749.028254:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565047424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497749.028304:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497749.028355:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565047424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497749.028363:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1777497749.028383:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1777497749.028389:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565047552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497749.028406:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497749.028446:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565047552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497749.028452:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:3.0:1777497749.028606:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565047424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497749.028680:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565047552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497749.309962:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497749.310017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497749.310057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497749.310088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497749.310155:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497749.310340:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363008 00000100:00100000:2.0:1777497749.310355:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363008 00000100:00100000:2.0:1777497749.310430:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362880 00000100:00100000:2.0:1777497749.310433:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362880 00000100:00100000:2.0:1777497749.310458:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2673 00000100:00100000:2.0:1777497749.310469:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546363008:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497749.310544:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546363008:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497749.310551:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2673 00000100:00100000:2.0:1777497749.310581:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2674 00000100:00100000:2.0:1777497749.310587:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546362880:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497749.310614:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546362880:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497749.310620:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2674 00000100:00100000:2.0:1777497749.310742:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362752 00000100:00100000:2.0:1777497749.310746:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362752 00000100:00100000:2.0:1777497749.310772:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362624 00000100:00100000:2.0:1777497749.310774:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362624 00000100:00100000:2.0:1777497749.310793:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1402 00000100:00100000:2.0:1777497749.310811:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546362752:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497749.310843:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:2413:x1863837546362752:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 33us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497749.310849:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1402 00000100:00100000:2.0:1777497749.310861:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1403 00000100:00100000:2.0:1777497749.310867:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546362624:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497749.310886:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546362624:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 21us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497749.310892:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1403 00000100:00100000:1.0:1777497749.311471:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546362496 00000100:00100000:1.0:1777497749.311477:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546362496 00000100:00100000:1.0:1777497749.311522:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00100000:1.0:1777497749.311529:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546362496:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497749.311574:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546362496:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497749.311580:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 82 00000100:00080000:0.0:1777497749.312127:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497749.312134:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1777497749.312137:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497749.312139:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497749.669639:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497750.170044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.170297:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363136 00000100:00100000:3.0:1777497750.170308:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363136 00000100:00100000:3.0:1777497750.170370:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1445 00000100:00100000:3.0:1777497750.170379:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:72133:x1863837546363136:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:3.0:1777497750.170415:0:65418:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:3.0:1777497750.170494:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:72133:x1863837546363136:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 115us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.170502:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1445 00000100:00100000:0.0:1777497750.174809:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497750.175131:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363264 00000100:00100000:2.0:1777497750.175141:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363264 00000100:00100000:2.0:1777497750.175221:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1446 00000100:00100000:2.0:1777497750.175232:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:72133:x1863837546363264:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:2.0:1777497750.175272:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497750.175346:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:72133:x1863837546363264:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 115us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.175353:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1446 00000100:00100000:2.0:1777497750.180513:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.180671:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363392 00000100:00100000:3.0:1777497750.180681:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363392 00000100:00100000:3.0:1777497750.180743:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2178 00000100:00100000:3.0:1777497750.180754:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:72133:x1863837546363392:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:3.0:1777497750.180780:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497750.180857:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:72133:x1863837546363392:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 105us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.180864:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2178 00000100:00100000:0.0:1777497750.185051:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497750.185709:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363520 00000100:00100000:2.0:1777497750.185720:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363520 00000100:00100000:2.0:1777497750.185782:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2179 00000100:00100000:2.0:1777497750.185794:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:72133:x1863837546363520:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497750.185823:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497750.185908:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+5:72133:x1863837546363520:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 117us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.185928:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2179 00000100:00100000:1.0:1777497750.232297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.232443:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363648 00000100:00100000:3.0:1777497750.232453:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363648 00000100:00100000:3.0:1777497750.232514:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1447 00000100:00100000:3.0:1777497750.232524:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:71049:x1863837546363648:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1777497750.232544:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497750.232573:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e11a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c478 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232632:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232646:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232658:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232672:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232689:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232696:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232833:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17600/0x3e357265691e12f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232842:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17600/0x3e357265691e12f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232849:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17600/0x3e357265691e12f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497750.232876:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1777497750.232880:0:63727:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1777497750.232910:0:63727:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17600/0x3e357265691e12f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232921:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232927:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232933:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232938:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232954:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497750.232958:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232966:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232977:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:3.0:1777497750.232980:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497750.232985:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.232991:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233004:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233010:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233016:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233020:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497750.233023:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233028:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233044:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91905c78 (ffff9240a6e49b00) 00010000:00010000:3.0:1777497750.233047:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497750.233049:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233054:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16a00/0x3e357265691e128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91905c78 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.233083:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e11a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c478 expref: 9 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.234291:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17600/0x3e357265691e12f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c478 expref: 8 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.234305:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9240a6e49500) 00010000:00010000:3.0:1777497750.234308:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1777497750.234311:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17600, rc 0) 00000100:00100000:3.0:1777497750.234433:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+8:71049:x1863837546363648:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1909us (2147us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.234442:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1447 00000100:00100000:3.0:1777497750.252526:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497750.252837:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363776 00000100:00100000:2.0:1777497750.252850:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363776 00000100:00100000:2.0:1777497750.252922:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1448 00000100:00100000:2.0:1777497750.252932:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:71049:x1863837546363776:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1777497750.252956:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497750.252982:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e136 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c47f expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253043:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253060:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253075:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253089:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253133:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.253140:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497750.253292:0:65418:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837565047680:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1777497750.253352:0:65418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497750.253412:0:65418:0:(client.c:2691:ptlrpc_set_wait()) set ffff924093d7a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497750.253540:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047680 00000100:00100000:1.0:1777497750.253546:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047680 00000100:00100000:1.0:1777497750.253591:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4084 00000100:00100000:1.0:1777497750.253599:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837565047680:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1777497750.253696:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:65418:x1863837565047680:12345-0@lo:1000:mdt00_004.0 Request processed in 98us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497750.253704:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4084 00000100:00100000:3.0:1777497750.253851:0:65418:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:65418:1863837565047680:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1777497750.253906:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e14b lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253917:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e14b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253936:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e14b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497750.253956:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e14b lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253969:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253975:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253981:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253987:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.253994:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497750.253997:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254005:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254016:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9240a6e49500) 00010000:00010000:3.0:1777497750.254019:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497750.254024:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254031:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e13d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254050:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254057:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254062:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254067:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497750.254070:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254075:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254083:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0xb04f75d6 (ffff924090680f00) 00010000:00010000:3.0:1777497750.254085:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497750.254088:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254142:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e144 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0xb04f75d6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254177:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e136 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c47f expref: 10 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254191:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17a00/0x3e357265691e14b lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c47f expref: 9 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.254242:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff9240a6e49b00) 00010000:00010000:3.0:1777497750.254245:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497750.254248:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17a00, rc 0) 00000100:00100000:3.0:1777497750.254296:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+9:71049:x1863837546363776:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1366us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.254303:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1448 00000100:00100000:0.0:1777497750.259492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497750.259591:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546363904 00000100:00100000:2.0:1777497750.259603:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546363904 00000100:00100000:2.0:1777497750.259665:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1449 00000100:00100000:2.0:1777497750.259689:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:71049:x1863837546363904:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:2.0:1777497750.259715:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497750.259739:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe400/0x3e357265691e152 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c486 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.259805:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b000/0x3e357265691e159 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.259821:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b000/0x3e357265691e159 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.259834:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b000/0x3e357265691e159 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497750.259881:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x2:0x0]: returning size 4096 00000004:00200000:2.0:1777497750.259885:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:2.0:1777497750.259943:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff9240bb7fe400/0x3e357265691e152 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c486 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.259961:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b000/0x3e357265691e159 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c486 expref: 10 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.259970:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff923f847c8b00) 00010000:00010000:2.0:1777497750.259973:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1777497750.259977:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b000, rc 0) 00000100:00100000:2.0:1777497750.260041:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:71049:x1863837546363904:12345-192.168.202.4@tcp:101:bash.0 Request processed in 368us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.260064:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1449 00000100:00100000:1.0:1777497750.272153:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497750.272273:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364032 00000100:00100000:0.0:1777497750.272284:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364032 00000100:00100000:0.0:1777497750.272353:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1450 00000100:00100000:0.0:1777497750.272365:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+10:71049:x1863837546364032:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1777497750.272401:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497750.272422:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef400/0x3e357265691e160 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c48d expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272493:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272510:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272521:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272536:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272542:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272549:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272636:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272645:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272652:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497750.272704:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x4:0x0]: returning size 0 00000004:00200000:0.0:1777497750.272712:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1777497750.272738:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272750:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272758:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272764:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272770:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272776:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497750.272780:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272786:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272798:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff923f847c8b00) 00010000:00010000:0.0:1777497750.272801:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497750.272806:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272813:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefc00/0x3e357265691e167 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272826:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272843:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272849:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272854:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefe00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497750.272857:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272864:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272872:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x9add8152 (ffff924083cd1700) 00010000:00010000:0.0:1777497750.272874:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497750.272877:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272883:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eefe00/0x3e357265691e16e lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272914:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef400/0x3e357265691e160 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c48d expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272926:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff924085eef800/0x3e357265691e175 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c48d expref: 11 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.272933:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x4:0x0].0x0 (ffff924091207700) 00010000:00010000:0.0:1777497750.272935:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497750.272943:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef800, rc 0) 00000100:00100000:0.0:1777497750.273014:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:71049:x1863837546364032:12345-192.168.202.4@tcp:101:bash.0 Request processed in 651us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497750.273021:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1450 00000100:00100000:3.0:1777497750.279707:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497750.279836:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364160 00000100:00100000:0.0:1777497750.279853:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364160 00000100:00100000:0.0:1777497750.279932:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 731 00000100:00100000:0.0:1777497750.279947:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546364160:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497750.279965:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497750.279993:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff92409902b000/0x3e357265691e159 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x2:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c486 expref: 11 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.280016:0:6500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x2:0x0].0x0 (ffff923f847c8b00) 00010000:00010000:0.0:1777497750.280022:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497750.280157:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:2412:x1863837546364160:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 214us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497750.280165:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 731 00000100:00100000:2.0:1777497750.290314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.290571:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364288 00000100:00100000:3.0:1777497750.290585:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364288 00000100:00100000:3.0:1777497750.290658:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5906 00000100:00100000:3.0:1777497750.290669:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546364288:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1777497750.290695:0:8397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497750.290721:0:8397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f1a4da8/0x3e357265691e17c lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c494 expref: -99 pid: 8397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497750.290753:0:8397:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x622:0x0] initial LVB size: 0, mtime: 0x69f27663, atime: 0x69f27663, ctime: 0x69f27663, blocks: 0x0 00010000:00010000:3.0:1777497750.290779:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497750.290781:0:8397:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497750.290792:0:8397:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f1a4da8/0x3e357265691e17c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c494 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.290815:0:8397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004f1a4da8/0x3e357265691e17c lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x622:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c494 expref: 6 pid: 8397 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.290833:0:8397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a16a00, rc 0) 00000100:00100000:3.0:1777497750.290933:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546364288:12345-192.168.202.4@tcp:101:bash.0 Request processed in 265us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.290942:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5906 00000100:00100000:1.0:1777497750.294194:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.294540:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364416 00000100:00100000:3.0:1777497750.294556:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364416 00000100:00100000:3.0:1777497750.294644:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1451 00000100:00100000:3.0:1777497750.294656:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:71049:x1863837546364416:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1777497750.294687:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497750.294717:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e183 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c49b expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294802:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294820:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294835:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294852:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294859:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.294865:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497750.295025:0:63729:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865db480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:63729:1863837565047808:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1777497750.295924:0:63729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497750.298991:0:63729:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240b568ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497750.300712:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047808 00000100:00100000:2.0:1777497750.300732:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047808 00000100:00100000:2.0:1777497750.300837:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4085 00000100:00100000:2.0:1777497750.300850:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63729:x1863837565047808:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1777497750.301112:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:63729:x1863837565047808:12345-0@lo:1000:mdt00_002.0 Request processed in 246us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.301120:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4085 00000100:00100000:0.0:1777497750.305214:0:63729:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865db480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:63729:1863837565047808:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1777497750.305529:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735e00/0x3e357265691e198 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305552:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735e00/0x3e357265691e198 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305587:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735e00/0x3e357265691e198 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497750.305626:0:63729:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735e00/0x3e357265691e198 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305646:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305653:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305661:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305668:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305675:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497750.305680:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305689:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305703:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x0 (ffff9240a6e49500) 00010000:00010000:1.0:1777497750.305707:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497750.305715:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305722:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16600/0x3e357265691e18a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305749:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305755:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305761:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305767:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497750.305770:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305776:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305785:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1:0x0].0x8f93a2f9 (ffff9240a6e49600) 00010000:00010000:1.0:1777497750.305787:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497750.305790:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305796:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16e00/0x3e357265691e191 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1:0x0].0x8f93a2f9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305851:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17400/0x3e357265691e183 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c49b expref: 11 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305869:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735e00/0x3e357265691e198 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c49b expref: 10 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.305889:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff92409c7a4200) 00010000:00010000:1.0:1777497750.305892:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1777497750.305894:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735e00, rc 0) 00000100:00100000:1.0:1777497750.305999:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:71049:x1863837546364416:12345-192.168.202.4@tcp:101:bash.0 Request processed in 11345us (11819us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497750.306011:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1451 00000100:00100000:2.0:1777497750.308955:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497750.309070:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364544 00000100:00100000:3.0:1777497750.309084:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364544 00000100:00100000:3.0:1777497750.309660:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1452 00000100:00100000:3.0:1777497750.309673:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+10:71049:x1863837546364544:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:3.0:1777497750.309703:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497750.309729:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a16400/0x3e357265691e19f lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4a2 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.309812:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a17200/0x3e357265691e1a6 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.309831:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a17200/0x3e357265691e1a6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.309845:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a17200/0x3e357265691e1a6 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497750.309911:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1777497750.309916:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1777497750.309965:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a16400/0x3e357265691e19f lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4a2 expref: 12 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.309987:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a17200/0x3e357265691e1a6 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4a2 expref: 11 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497750.309996:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924091207400) 00010000:00010000:3.0:1777497750.310000:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1777497750.310004:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17200, rc 0) 00000100:00100000:3.0:1777497750.310900:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:71049:x1863837546364544:12345-192.168.202.4@tcp:101:bash.0 Request processed in 1221us (1950us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497750.310912:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1452 00000100:00100000:0.0:1777497750.315375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497750.315432:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497750.315539:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364672 00000100:00100000:1.0:1777497750.315556:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364672 00000100:00100000:1.0:1777497750.315637:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1453 00000100:00100000:1.0:1777497750.315652:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:71049:x1863837546364672:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:1.0:1777497750.315684:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497750.315713:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734c00/0x3e357265691e1ad lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4a9 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315803:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/1,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315822:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315834:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315850:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315857:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315885:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315989:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/1,0 mode: --/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.315996:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316003:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497750.316055:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400090a5:0x5:0x0]: returning size 0 00000004:00200000:1.0:1777497750.316060:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497750.316089:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316143:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316152:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/1,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316158:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 2/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316178:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316185:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497750.316189:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 3/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316216:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 4/0,0 mode: CR/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316230:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924091207400) 00010000:00010000:1.0:1777497750.316234:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497750.316239:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 2/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316245:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734e00/0x3e357265691e1b4 lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316260:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/1,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316266:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 2/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316272:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316277:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497750.316280:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316286:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 4/0,0 mode: PR/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316292:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x9add8152 (ffff92409c7a4500) 00010000:00010000:1.0:1777497750.316295:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497750.316297:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 2/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316312:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89735a00/0x3e357265691e1bb lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x9add8152 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316349:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734c00/0x3e357265691e1ad lrc: 0/0,0 mode: --/CR res: [0x2400090a5:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4a9 expref: 13 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316364:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff923f89734a00/0x3e357265691e1c2 lrc: 3/0,0 mode: PR/PR res: [0x2400090a5:0x5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4a9 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497750.316371:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x5:0x0].0x0 (ffff923f847c8100) 00010000:00010000:1.0:1777497750.316373:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497750.316376:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734a00, rc 0) 00000100:00100000:1.0:1777497750.316454:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:71049:x1863837546364672:12345-192.168.202.4@tcp:101:bash.0 Request processed in 807us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497750.316463:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1453 00000100:00100000:2.0:1777497750.316749:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364800 00000100:00100000:2.0:1777497750.316756:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364800 00000100:00100000:2.0:1777497750.316807:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 732 00000100:00100000:2.0:1777497750.316815:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:2412:x1863837546364800:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777497750.316828:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497750.316845:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff923f88a17200/0x3e357265691e1a6 lrc: 0/0,0 mode: --/PR res: [0x2400090a5:0x3:0x0].0x0 bits 0x10/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4a2 expref: 12 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497750.316858:0:25500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400090a5:0x3:0x0].0x0 (ffff924091207400) 00010000:00010000:2.0:1777497750.316862:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497750.316887:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546364800:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 74us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.316893:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 732 00000100:00100000:1.0:1777497750.331985:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497750.332193:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546364928 00000100:00100000:0.0:1777497750.332218:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546364928 00000100:00100000:0.0:1777497750.332312:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5907 00000100:00100000:0.0:1777497750.332323:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2412:x1863837546364928:12345-192.168.202.4@tcp:101:bash.0 00010000:00010000:0.0:1777497750.332348:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497750.332394:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691e1c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4b0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497750.332426:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000400:0x623:0x0] initial LVB size: 0, mtime: 0x69f27663, atime: 0x69f27663, ctime: 0x69f27663, blocks: 0x0 00010000:00010000:0.0:1777497750.332452:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497750.332455:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497750.332466:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691e1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b0 expref: 7 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.332489:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0194b7f/0x3e357265691e1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000400:0x623:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b0 expref: 7 pid: 8396 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497750.332507:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eefe00, rc 0) 00000100:00100000:0.0:1777497750.332593:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546364928:12345-192.168.202.4@tcp:101:bash.0 Request processed in 271us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497750.332601:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5907 00000100:00100000:3.0:1777497750.573560:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565048064:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497750.573674:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497750.573740:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497750.573748:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565047936:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497750.573773:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497750.573879:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048064 00000100:00100000:2.0:1777497750.573890:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048064 00000100:00100000:2.0:1777497750.573983:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565047936 00000100:00100000:2.0:1777497750.574004:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565047936 00000100:00100000:2.0:1777497750.574045:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1777497750.574057:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565048064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1777497750.574090:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497750.574190:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565048064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 137us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.574209:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1777497750.574230:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1777497750.574237:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565047936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497750.574250:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497750.574277:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565047936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497750.574284:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1777497750.574338:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565047936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497750.574353:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565048064:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1777497750.575645:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497750.575653:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1777497750.692265:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497751.716522:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497752.738895:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497753.643858:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497753.643885:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565048192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497753.643941:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497753.644140:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048192 00000100:00100000:1.0:1777497753.644148:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048192 00000100:00100000:1.0:1777497753.644203:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1777497753.644212:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565048192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497753.644249:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:1.0:1777497753.644291:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb160380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565048192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497753.644298:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4086 00000100:00100000:1.0:1777497753.644696:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497753.645597:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb163100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565048192:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497753.646644:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565048448:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.646780:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.646814:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497753.646818:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565048576:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.646836:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.646859:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048448 00000100:00100000:0.0:1777497753.646869:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048448 00000100:00100000:0.0:1777497753.646899:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1777497753.646905:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565048448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.646937:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565048448:12345-0@lo:400:kworker.0 Request processed in 33us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.646941:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1777497753.646972:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565048448:0@lo:400:kworker.0 00000100:00100000:1.0:1777497753.648690:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565048704:0@lo:400:kworker.0 00000100:00100000:1.0:1777497753.648750:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497753.648789:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565048320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497753.648818:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.648823:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048576 00000100:00100000:0.0:1777497753.648832:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048576 00000100:00080000:1.0:1777497753.648872:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497753.648906:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048704 00000100:00100000:0.0:1777497753.648910:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048704 00000100:00100000:0.0:1777497753.648938:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1777497753.648948:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565048576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.648998:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565048576:12345-0@lo:400:kworker.0 Request processed in 53us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.649005:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1777497753.649023:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1777497753.649028:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565048704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.649060:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565048704:12345-0@lo:400:kworker.0 Request processed in 32us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.649065:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00080000:0.0:1777497753.649082:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497753.650086:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565048576:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650191:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565049088:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650235:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497753.650260:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049600:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650282:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497753.650303:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1777497753.650309:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565048960:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650329:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497753.650345:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049472:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650367:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497753.650405:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048960 00000100:00100000:2.0:1777497753.650411:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048960 00000100:00100000:2.0:1777497753.650459:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1777497753.650469:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565048960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.650512:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565048960:12345-0@lo:400:kworker.0 Request processed in 45us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497753.650519:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1777497753.650559:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048320 00000100:00100000:2.0:1777497753.650564:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048320 00000100:00100000:2.0:1777497753.650590:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4087 00000100:00100000:2.0:1777497753.650596:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565048320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497753.650624:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497753.650657:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565048320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497753.650663:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4087 00000100:00100000:0.0:1777497753.650792:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049088 00000100:00100000:0.0:1777497753.650797:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049088 00000100:00100000:0.0:1777497753.650820:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049600 00000100:00100000:0.0:1777497753.650821:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049600 00000100:00100000:0.0:1777497753.650843:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049472 00000100:00100000:0.0:1777497753.650845:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049472 00000100:00100000:0.0:1777497753.650857:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1777497753.650861:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565049088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.650887:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565049088:12345-0@lo:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.650891:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2675 00000100:00100000:0.0:1777497753.650898:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1777497753.650902:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.650916:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049600:12345-0@lo:400:kworker.0 Request processed in 14us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.650919:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2676 00000100:00100000:0.0:1777497753.650924:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2677 00000100:00100000:0.0:1777497753.650927:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.650939:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049472:12345-0@lo:400:kworker.0 Request processed in 12us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.650944:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2677 00000100:00080000:0.0:1777497753.650979:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1777497753.650983:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497753.650984:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497753.650993:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565048832:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.651003:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565048960:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.651017:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497753.651019:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049472:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.651037:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565049088:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.651039:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565049344:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.651056:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049600:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.651063:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.651088:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777497753.653255:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565049216:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.653328:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.653369:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565049728:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.653390:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497753.653430:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049216 00000100:00100000:0.0:1777497753.653436:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049216 00000100:00100000:0.0:1777497753.653486:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1777497753.653495:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565049216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.653544:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565049216:12345-0@lo:400:kworker.0 Request processed in 50us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.653552:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2678 00000100:00100000:0.0:1777497753.653577:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565048832 00000100:00100000:0.0:1777497753.653580:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565048832 00000100:00100000:0.0:1777497753.653602:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049344 00000100:00100000:0.0:1777497753.653604:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049344 00000100:00100000:0.0:1777497753.653613:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049728 00000100:00100000:0.0:1777497753.653614:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049728 00000100:00100000:0.0:1777497753.653624:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1777497753.653629:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565048832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.653660:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565048832:12345-0@lo:400:kworker.0 Request processed in 31us (2644us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.653666:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1777497753.653678:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:2.0:1777497753.654325:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:2.0:1777497753.654338:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565049728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.654387:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565049728:12345-0@lo:400:kworker.0 Request processed in 53us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497753.654393:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00080000:2.0:1777497753.654416:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497753.654427:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497753.654467:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565048704:0@lo:400:kworker.0 00000100:00100000:2.0:1777497753.654487:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565048320:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497753.654965:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565049216:0@lo:400:kworker.0 00000100:00100000:1.0:1777497753.654985:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565049728:0@lo:400:kworker.0 00000100:00100000:1.0:1777497753.654998:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565048832:0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.655918:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565049344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497753.656010:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565049344:12345-0@lo:400:kworker.0 Request processed in 2325us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497753.656019:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:1.0:1777497753.656173:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565049344:0@lo:400:kworker.0 00010000:00010000:2.0:1777497753.764818:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497754.146580:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497754.146605:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497754.146674:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497754.146868:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049856 00000100:00100000:0.0:1777497754.146888:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049856 00000100:00100000:0.0:1777497754.146946:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1777497754.146956:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565049856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497754.146984:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497754.147032:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565049856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497754.147039:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000100:00100000:0.0:1777497754.147084:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565049856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497754.147379:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497754.147389:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497754.147417:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497754.147530:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565049984 00000100:00100000:1.0:1777497754.147536:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565049984 00000100:00100000:1.0:1777497754.147576:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:1.0:1777497754.147585:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497754.147602:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497754.147639:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565049984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497754.147646:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:1.0:1777497754.147675:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565049984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497754.451019:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497754.451059:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497754.451133:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497754.451175:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497754.451199:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497754.451233:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365312 00000100:00100000:2.0:1777497754.451245:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365312 00000100:00100000:2.0:1777497754.451325:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365184 00000100:00100000:2.0:1777497754.451328:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365184 00000100:00100000:2.0:1777497754.451350:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1410 00000100:00100000:2.0:1777497754.451359:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546365312:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497754.451424:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546365312:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 67us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497754.451431:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1410 00000100:00100000:2.0:1777497754.451458:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1411 00000100:00100000:2.0:1777497754.451464:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:2414:x1863837546365184:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497754.451487:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+10:2414:x1863837546365184:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497754.451493:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1411 00000100:00080000:2.0:1777497754.451511:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497754.451515:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497754.451872:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365056 00000100:00100000:1.0:1777497754.451877:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365056 00000100:00100000:1.0:1777497754.451917:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:1.0:1777497754.451923:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546365056:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497754.451950:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546365056:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 28us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497754.451971:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 84 00000100:00100000:3.0:1777497754.452201:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365568 00000100:00100000:3.0:1777497754.452207:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365568 00000100:00100000:3.0:1777497754.452257:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365440 00000100:00100000:3.0:1777497754.452260:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365440 00000100:00100000:3.0:1777497754.452283:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2679 00000100:00100000:3.0:1777497754.452289:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546365568:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497754.452322:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546365568:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 34us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497754.452329:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2679 00000100:00100000:3.0:1777497754.452343:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2680 00000100:00100000:3.0:1777497754.452349:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546365440:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497754.452381:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+5:2414:x1863837546365440:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497754.452387:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2680 00000100:00080000:0.0:1777497754.452598:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497754.452602:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497754.787550:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497755.686916:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1777497755.686938:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565050112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497755.687006:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497755.687054:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050112 00000100:00100000:3.0:1777497755.687062:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050112 00000100:00100000:3.0:1777497755.687138:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:3.0:1777497755.687158:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565050112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497755.687188:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497755.687230:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565050112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497755.687236:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00080000:3.0:1777497755.687257:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497755.687292:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565050112:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497755.687684:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497755.687707:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565050240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1777497755.687739:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497755.695318:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050240 00000100:00100000:1.0:1777497755.695333:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050240 00000100:00100000:1.0:1777497755.695408:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:1.0:1777497755.695420:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565050240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497755.695450:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1777497755.695608:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497755.696338:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565050240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 919us (8595us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497755.696348:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:2.0:1777497755.696465:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565050240:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497755.812756:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497756.834660:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497757.858307:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497758.723455:0:91379:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd6901c3d0 20000000:00000080:2.0:1777497758.723471:0:91379:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9240b54b4000 uarg=0000000000000000 00000040:00100000:2.0:1777497758.724047:0:91379:0:(llog.c:1067:llog_reverse_process()) index 57 : idx 49 20000000:01000000:2.0:1777497758.724055:0:91379:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 56 cmd:0xce021 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1777497758.724067:0:91379:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1777497758.736331:0:91380:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 55 marker 42 1->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:3.0:1777497758.736412:0:91380:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 57 marker 42 2->4: lustre-clilov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:3.0:1777497758.736426:0:91380:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 58 count 57 00000040:00080000:2.0:1777497758.736716:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].58, 224 off18320 20000000:01000000:2.0:1777497758.736733:0:91379:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1777497758.736749:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].59, 136 off18456 00000040:00080000:2.0:1777497758.736765:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].60, 224 off18680 20000000:01000000:2.0:1777497758.736777:0:91379:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1777497758.737406:0:91381:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 50 marker 43 1->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:0.0:1777497758.737441:0:91381:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 43 2->4: lustre-MDT0000-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:0.0:1777497758.737454:0:91381:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 53 count 52 00000040:00080000:3.0:1777497758.737621:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].53, 224 off17424 20000000:01000000:3.0:1777497758.737633:0:91379:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1777497758.737649:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].54, 144 off17568 00000040:00080000:3.0:1777497758.737666:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].55, 224 off17792 20000000:01000000:3.0:1777497758.737680:0:91379:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.pool_134.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1777497758.740063:0:91382:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 50 marker 44 1->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 20000000:01000000:2.0:1777497758.740168:0:91382:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 44 2->4: lustre-MDT0001-mdtlov add lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:2.0:1777497758.740186:0:91382:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 53 count 52 00000040:00080000:3.0:1777497758.740483:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].53, 224 off17424 20000000:01000000:3.0:1777497758.740509:0:91379:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre pool_134 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1777497758.740526:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].54, 144 off17568 00000040:00080000:3.0:1777497758.740543:0:91379:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].55, 224 off17792 10000000:01000000:3.0:1777497758.740556:0:91379:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1777497758.740576:0:91379:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740596:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740605:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740613:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dd2a expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740619:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de0a expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740625:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de3b expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740631:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de57 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740638:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de81 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740645:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de8f expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740651:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691deab expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740665:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691deb9 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740672:0:91379:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691dee3 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740678:0:91379:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740728:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740744:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 22 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.740759:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050368:0@lo:104: 00000100:00100000:3.0:1777497758.740822:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.740875:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740883:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 22 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.740891:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050496:0@lo:104: 00000100:00100000:3.0:1777497758.740916:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.740949:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691deab expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.740957:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691deab expref: 22 pid: 90580 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.740973:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050624:0@lo:104: 00010000:00010000:3.0:1777497758.741000:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de8f expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.741009:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de8f expref: 22 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.741017:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050752:0@lo:104: 00010000:00010000:3.0:1777497758.741040:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de81 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.741048:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de81 expref: 22 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.741057:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050880:0@lo:104: 00010000:00010000:3.0:1777497758.741080:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de57 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.741088:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de57 expref: 22 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.741235:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1777497758.741254:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.741271:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.741279:0:6497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.741286:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050368 00000100:00100000:0.0:1777497758.741293:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050368 00000100:00100000:0.0:1777497758.741343:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050496 00000100:00100000:0.0:1777497758.741347:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050496 00000100:00100000:0.0:1777497758.741358:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050624 00000100:00100000:0.0:1777497758.741361:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050624 00000100:00100000:0.0:1777497758.741370:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050752 00000100:00100000:0.0:1777497758.741372:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050752 00000100:00100000:0.0:1777497758.741381:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565050880 00000100:00100000:0.0:1777497758.741384:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565050880 00000100:00100000:0.0:1777497758.741397:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1777497758.741412:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:91379:x1863837565050368:12345-0@lo:104: 00010000:00010000:0.0:1777497758.741424:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.741477:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497758.741483:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:91379:x1863837565050368:12345-0@lo:104: Request processed in 72us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.741490:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1777497758.741508:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1777497758.741515:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f862de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:91379:x1863837565050496:12345-0@lo:104: 00010000:00010000:0.0:1777497758.741521:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.741552:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777497758.741557:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f862de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:91379:x1863837565050496:12345-0@lo:104: Request processed in 43us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.741562:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1777497758.741577:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1777497758.741584:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:91379:x1863837565050624:12345-0@lo:104: 00010000:00010000:2.0:1777497758.741596:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.741597:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1777497758.741602:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:91379:x1863837565050752:12345-0@lo:104: 00010000:00010000:0.0:1777497758.741608:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.741632:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1777497758.741637:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:91379:x1863837565050624:12345-0@lo:104: Request processed in 54us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497758.741642:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1777497758.741657:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1777497758.741664:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91379:x1863837565050880:12345-0@lo:104: 00010000:00010000:2.0:1777497758.741678:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.742712:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051008:0@lo:104: 00000100:00100000:3.0:1777497758.742752:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.742796:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de3b expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.742807:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de3b expref: 22 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.742828:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051136:0@lo:104: 00000100:00100000:3.0:1777497758.742850:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.742868:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de0a expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.742877:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de0a expref: 22 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.742884:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051264:0@lo:104: 00000100:00100000:3.0:1777497758.742902:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.742917:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.742925:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 22 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.742933:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051392:0@lo:104: 00000100:00100000:3.0:1777497758.742955:0:91379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.742973:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.742982:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.742991:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051520:192.168.202.4@tcp:104: 00010000:00010000:3.0:1777497758.743043:0:91379:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.743062:0:91379:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 8 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497758.743071:0:91379:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051648:192.168.202.4@tcp:104: 00000100:00100000:3.0:1777497758.743135:0:91379:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497758.743161:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050368:0@lo:104: 00000100:00100000:3.0:1777497758.743172:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050496:0@lo:104: 00000100:00100000:3.0:1777497758.743180:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050624:0@lo:104: 00000100:00100000:3.0:1777497758.743187:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050752:0@lo:104: 00000100:00100000:3.0:1777497758.743195:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565050880:0@lo:104: 00000100:00100000:1.0:1777497758.743734:0:6498:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1777497758.743747:0:6498:0:(service.c:3443:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1777497758.743752:0:6498:0:(service.c:3502:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1777497758.747015:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1777497758.747036:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91379:x1863837565050752:12345-0@lo:104: Request processed in 5427us (5757us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.747051:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1777497758.747088:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051008 00000100:00100000:0.0:1777497758.747140:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051008 00000100:00100000:0.0:1777497758.747172:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051136 00000100:00100000:0.0:1777497758.747175:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051136 00000100:00100000:0.0:1777497758.747185:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051264 00000100:00100000:0.0:1777497758.747188:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051264 00000100:00100000:0.0:1777497758.747197:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051392 00000100:00100000:0.0:1777497758.747200:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051392 00000100:00100000:0.0:1777497758.747212:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1777497758.747219:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:91379:x1863837565051008:12345-0@lo:104: 00010000:00010000:0.0:1777497758.747234:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747350:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1777497758.747356:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+7:91379:x1863837565051008:12345-0@lo:104: Request processed in 138us (4604us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.747362:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1777497758.747375:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1777497758.747381:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:91379:x1863837565051136:12345-0@lo:104: 00010000:00010000:0.0:1777497758.747388:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747416:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:0.0:1777497758.747421:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+6:91379:x1863837565051136:12345-0@lo:104: Request processed in 41us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.747426:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1777497758.747439:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1777497758.747446:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:91379:x1863837565051264:12345-0@lo:104: 00010000:00010000:0.0:1777497758.747454:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747492:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:0.0:1777497758.747497:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+5:91379:x1863837565051264:12345-0@lo:104: Request processed in 52us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.747503:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1777497758.747516:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1777497758.747523:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91379:x1863837565051392:12345-0@lo:104: 00010000:00010000:0.0:1777497758.747530:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747558:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:0.0:1777497758.747562:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c0ff450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91379:x1863837565051392:12345-0@lo:104: Request processed in 42us (4607us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.747568:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:0.0:1777497758.747591:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:0.0:1777497758.747597:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747604:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb600 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497758.747608:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747617:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747625:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497758.747630:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.747672:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747679:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497758.747701:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747707:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cb600/0x3e357265691dee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deea expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747710:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1777497758.747718:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91379:x1863837565050880:12345-0@lo:104: Request processed in 6054us (6437us total) trans 0 rc 0/0 00010000:00010000:0.0:1777497758.747722:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00000100:00100000:2.0:1777497758.747725:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:0.0:1777497758.747725:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747730:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497758.747732:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747738:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747744:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497758.747748:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497758.747760:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1777497758.747760:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747765:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747766:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497758.747771:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeee00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497758.747774:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747781:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747781:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497758.747788:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497758.747794:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.747798:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cb200/0x3e357265691deb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dec0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747807:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1777497758.747808:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747810:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747814:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497758.747816:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b000 already unused, calling callback (ffffffffc139bc20) 00010000:00010000:2.0:1777497758.747819:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747819:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747826:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eeee00/0x3e357265691deab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691deb2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747826:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747833:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497758.747838:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497758.747841:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1777497758.747844:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747848:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747850:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cba00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497758.747853:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747854:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497758.747859:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747859:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747865:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92408150b000/0x3e357265691de8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de96 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497758.747866:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497758.747872:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.747874:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1777497758.747881:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747882:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747887:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497758.747887:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497758.747890:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747891:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747897:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cba00/0x3e357265691de81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de88 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747897:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747904:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747906:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1777497758.747908:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497758.747908:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.747918:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747922:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc139bc20) 00010000:00010000:0.0:1777497758.747924:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1777497758.747925:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747928:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747931:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747933:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cb400/0x3e357265691de57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de5e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497758.747938:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747941:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:2.0:1777497758.747942:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.747944:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747949:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff400 already unused, calling callback (ffffffffc139bc20) 00010000:00010000:2.0:1777497758.747951:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747952:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747956:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497758.747961:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747967:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffc00/0x3e357265691de3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de42 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747967:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497758.747974:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.747975:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497758.747977:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497758.747979:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1777497758.747983:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497758.747986:0:16604:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747988:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.747993:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497758.747997:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.748000:0:16604:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.748003:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff400/0x3e357265691de0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de11 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497758.748006:0:16604:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497758.748011:0:16604:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497758.748011:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497758.748013:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497758.748014:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497758.748021:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497758.748024:0:16604:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.748029:0:16604:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497758.748033:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.748038:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cb000/0x3e357265691dd2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691dd31 expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.748042:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565051776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497758.748050:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497758.748052:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497758.748053:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497758.748079:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1777497758.748277:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497758.750712:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497758.751730:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051008:0@lo:104: 00000100:00100000:2.0:1777497758.751745:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051136:0@lo:104: 00000100:00100000:2.0:1777497758.751755:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051264:0@lo:104: 00000100:00100000:2.0:1777497758.751765:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051392:0@lo:104: 00000100:00100000:0.0:1777497758.751856:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.751924:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.751965:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.751987:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752028:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1777497758.752036:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752055:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752072:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752091:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752159:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565051904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752181:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752196:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752212:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752222:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1777497758.752227:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752255:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752265:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.752284:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.752308:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051776 00000100:00100000:0.0:1777497758.752316:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051776 00010000:00010000:0.0:1777497758.752347:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 23 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752372:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052288 00000100:00100000:0.0:1777497758.752375:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052288 00010000:00010000:0.0:1777497758.752386:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de81 expref: 24 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752396:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052800 00000100:00100000:0.0:1777497758.752398:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052800 00010000:00010000:0.0:1777497758.752406:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 25 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752428:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052160 00000100:00100000:0.0:1777497758.752431:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052160 00010000:00010000:0.0:1777497758.752443:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de8f expref: 26 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752452:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052672 00000100:00100000:0.0:1777497758.752454:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052672 00010000:00010000:0.0:1777497758.752463:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de0a expref: 27 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752472:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565051904 00000100:00100000:0.0:1777497758.752474:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565051904 00010000:00010000:0.0:1777497758.752483:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 28 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752492:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052416 00000100:00100000:0.0:1777497758.752495:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052416 00010000:00010000:0.0:1777497758.752504:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de57 expref: 29 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752513:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052032 00000100:00100000:0.0:1777497758.752515:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052032 00010000:00010000:0.0:1777497758.752524:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691deab expref: 30 pid: 90580 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752533:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052544 00000100:00100000:0.0:1777497758.752536:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052544 00010000:00010000:0.0:1777497758.752544:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de3b expref: 31 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.752555:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1777497758.752573:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+31:3658:x1863837565051776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.752587:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.752592:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 31 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752604:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 31 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752622:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5ae00/0x3e357265691deea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691dee3 expref: 31 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752638:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.752673:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+30:3658:x1863837565051776:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.752680:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:0.0:1777497758.752726:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1777497758.752732:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+29:3658:x1863837565052288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.752739:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.752743:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de81 expref: 29 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752751:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de81 expref: 29 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752760:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896ca400/0x3e357265691de88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de81 expref: 29 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752769:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.752790:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+28:3658:x1863837565052288:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.752801:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1777497758.752813:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1777497758.752818:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+27:3658:x1863837565052800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.752826:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.752830:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 27 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752837:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 27 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752847:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896ca800/0x3e357265691dd31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691dd2a expref: 27 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752855:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.752877:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+26:3658:x1863837565052800:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.752882:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1777497758.752893:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1777497758.752898:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837565052160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.752904:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.752908:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de8f expref: 25 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752916:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de8f expref: 25 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752925:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7ff600/0x3e357265691de96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de8f expref: 25 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.752945:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.752967:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3658:x1863837565052160:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.752973:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1777497758.752986:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1777497758.752992:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565052672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.752999:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.753003:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de0a expref: 23 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753010:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de0a expref: 23 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753020:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7fee00/0x3e357265691de11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de0a expref: 23 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753028:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.753046:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837565052672:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.753052:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000100:00100000:0.0:1777497758.753064:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1777497758.753069:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3659:x1863837565051904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.753076:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.753080:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 21 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753087:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 21 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753148:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150ae00/0x3e357265691dec0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691deb9 expref: 21 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753157:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.753186:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3659:x1863837565051904:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.753192:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1777497758.753205:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1777497758.753211:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:3659:x1863837565052416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.753218:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.753222:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de57 expref: 19 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753229:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de57 expref: 19 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753238:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150a000/0x3e357265691de5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de57 expref: 19 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753245:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.753265:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:3659:x1863837565052416:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.753270:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1777497758.753281:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1777497758.753286:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:3659:x1863837565052032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.753292:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.753295:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691deab expref: 17 pid: 90580 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753309:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691deab expref: 17 pid: 90580 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753318:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150a200/0x3e357265691deb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691deab expref: 17 pid: 90580 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753326:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.753346:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:3659:x1863837565052032:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.753352:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2583 00000100:00100000:0.0:1777497758.753380:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1777497758.753386:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:3659:x1863837565052544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.753392:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.753395:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de3b expref: 15 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753403:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de3b expref: 15 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753412:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150b600/0x3e357265691de42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de3b expref: 15 pid: 90573 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.753422:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.753439:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3659:x1863837565052544:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1154us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.753444:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2584 00000100:00100000:0.0:1777497758.753490:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753498:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753514:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565051904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753520:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565052416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753557:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753564:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052672:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753571:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565051776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753577:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.753582:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565052800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497758.757866:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565052928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497758.757918:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497758.759443:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497758.759546:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365824 00000100:00100000:0.0:1777497758.759555:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365824 00010000:00010000:0.0:1777497758.759593:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 9 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.759628:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2585 00000100:00100000:0.0:1777497758.759637:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546365824:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1777497758.759650:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497758.759655:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 9 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.759667:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 9 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.759706:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.759754:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546365824:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 118us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.759762:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2585 00000100:00100000:1.0:1777497758.759932:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565052928 00000100:00100000:1.0:1777497758.759938:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565052928 00000100:00100000:1.0:1777497758.760010:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4088 00000100:00100000:1.0:1777497758.760019:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565052928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497758.760051:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:1.0:1777497758.760132:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565052928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (2213us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497758.760138:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4088 00000100:00100000:3.0:1777497758.760169:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565052928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497758.762033:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565053056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1777497758.762357:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497758.763841:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051520:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497758.763860:0:91379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f896cbc00/0x3e357265691dcf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c44e expref: 8 pid: 90574 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497758.763892:0:91379:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91379:1863837565051648:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497758.763943:0:91379:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.774525:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053056 00000100:00100000:0.0:1777497758.774541:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053056 00000100:00100000:0.0:1777497758.774794:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4089 00000100:00100000:0.0:1777497758.774807:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565053056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497758.774874:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:0.0:1777497758.774963:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565053056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 160us (12606us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.774970:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4089 00000100:00100000:0.0:1777497758.775773:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565053440:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.775826:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.775852:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565053952:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.775874:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.775894:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1777497758.775901:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565053568:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.775921:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.775937:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565054080:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.775960:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.775991:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053440 00000100:00100000:0.0:1777497758.775996:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053440 00000100:00100000:0.0:1777497758.776040:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053952 00000100:00100000:0.0:1777497758.776043:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053952 00000100:00100000:0.0:1777497758.776077:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053568 00000100:00100000:0.0:1777497758.776081:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053568 00000100:00100000:0.0:1777497758.776141:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1777497758.776150:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565053440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776195:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565053440:12345-0@lo:400:kworker.0 Request processed in 47us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776202:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1777497758.776216:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1777497758.776223:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565053952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776248:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565053952:12345-0@lo:400:kworker.0 Request processed in 26us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776254:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:0.0:1777497758.776265:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1777497758.776271:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565053568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776294:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565053568:12345-0@lo:400:kworker.0 Request processed in 25us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776320:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:0.0:1777497758.776346:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054080 00000100:00100000:0.0:1777497758.776350:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054080 00000100:00100000:0.0:1777497758.776382:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1777497758.776388:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565054080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776419:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565054080:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776426:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2681 00000100:00100000:0.0:1777497758.776455:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565053312:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776477:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776504:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565053824:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776526:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776542:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565054336:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776560:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776577:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1777497758.776582:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565053184:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776600:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776615:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565053696:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776633:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776647:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565054208:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776668:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497758.776695:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053824 00000100:00100000:0.0:1777497758.776699:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053824 00000100:00100000:0.0:1777497758.776724:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053696 00000100:00100000:0.0:1777497758.776727:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053696 00000100:00100000:0.0:1777497758.776743:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054208 00000100:00100000:0.0:1777497758.776745:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054208 00000100:00100000:0.0:1777497758.776761:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1777497758.776766:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565053824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776800:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565053824:12345-0@lo:400:kworker.0 Request processed in 34us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776805:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2682 00000100:00100000:0.0:1777497758.776816:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2683 00000100:00100000:3.0:1777497758.776822:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565053056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1777497758.776822:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565053696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776845:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565053696:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776850:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2683 00000100:00080000:3.0:1777497758.776861:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497758.776865:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497758.776867:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2684 00000100:00080000:3.0:1777497758.776868:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497758.776870:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497758.776872:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565054208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.776898:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565054208:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.776903:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2684 00000100:00100000:3.0:1777497758.776918:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497758.776927:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053312 00000100:00100000:0.0:1777497758.776930:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053312 00000100:00100000:3.0:1777497758.776940:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365696 00000100:00100000:3.0:1777497758.776943:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365696 00000100:00100000:0.0:1777497758.776953:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054336 00000100:00100000:0.0:1777497758.776955:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054336 00010000:00010000:3.0:1777497758.776962:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.776966:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565053184 00000100:00100000:0.0:1777497758.776969:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565053184 00000100:00100000:0.0:1777497758.776979:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1777497758.776984:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565053312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497758.776992:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2586 00000100:00100000:3.0:1777497758.776997:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2414:x1863837546365696:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497758.777007:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1777497758.777011:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565053312:12345-0@lo:400:kworker.0 Request processed in 27us (533us total) trans 0 rc 0/0 00010000:00010000:3.0:1777497758.777012:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777017:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:0.0:1777497758.777027:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1777497758.777032:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565054336:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1777497758.777041:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777054:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565054336:12345-0@lo:400:kworker.0 Request processed in 24us (493us total) trans 0 rc 0/0 00010000:00010000:3.0:1777497758.777059:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240bb7fea00/0x3e357265691dd07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c45c expref: 8 pid: 90575 timeout: 3988 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777059:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1777497758.777069:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1777497758.777074:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565053184:12345-0@lo:400:kworker.0 00010000:00010000:3.0:1777497758.777076:0:25500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.777084:0:25500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777110:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565053184:12345-0@lo:400:kworker.0 Request processed in 21us (493us total) trans 0 rc 0/0 00010000:00010000:3.0:1777497758.777127:0:25500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777127:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00010000:00010000:3.0:1777497758.777134:0:25500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.777141:0:25500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.777147:0:25500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777161:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565053568:0@lo:400:kworker.0 00010000:00010000:3.0:1777497758.777163:0:25500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:3.0:1777497758.777167:0:25500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497758.777175:0:25500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777177:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565054080:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.777186:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565053440:0@lo:400:kworker.0 00010000:00010000:3.0:1777497758.777189:0:25500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497758.777195:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565053952:0@lo:400:kworker.0 00010000:00010000:3.0:1777497758.777199:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497758.777225:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565053184:0@lo:400:kworker.0 00000100:00100000:3.0:1777497758.777232:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:34a4158d-137e-4629-9769-4a4bd53f7f61+7:2414:x1863837546365696:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 235us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497758.777234:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565053696:0@lo:400:kworker.0 00000100:00100000:3.0:1777497758.777238:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2586 00000100:00100000:0.0:1777497758.777241:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565054208:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.777249:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565053312:0@lo:400:kworker.0 00000100:00080000:3.0:1777497758.777252:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497758.777255:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497758.777258:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565053824:0@lo:400:kworker.0 00000100:00100000:0.0:1777497758.777266:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565054336:0@lo:400:kworker.0 00010000:00010000:2.0:1777497758.777359:0:91379:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.777367:0:91379:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497758.777372:0:91379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88a16400/0x3e357265691e1d0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91379 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497758.882349:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497759.266437:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565054464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1777497759.266512:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497759.266629:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054464 00000100:00100000:3.0:1777497759.266638:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054464 00000100:00100000:3.0:1777497759.266702:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:3.0:1777497759.266711:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565054464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497759.266740:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497759.266793:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565054464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497759.266800:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:2.0:1777497759.266882:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565054464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497759.267226:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497759.267254:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497759.267645:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054592 00000100:00100000:1.0:1777497759.267650:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054592 00000100:00100000:1.0:1777497759.267695:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:1.0:1777497759.267703:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565054592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497759.267723:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497759.267772:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565054592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497759.267793:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1777497759.267910:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565054592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497759.561245:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497759.561313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497759.561348:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497759.561366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497759.561392:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497759.561417:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366336 00000100:00100000:0.0:1777497759.561426:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366336 00000100:00100000:0.0:1777497759.561477:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366464 00000100:00100000:0.0:1777497759.561480:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366464 00000100:00100000:0.0:1777497759.561506:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2685 00000100:00100000:0.0:1777497759.561516:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546366336:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497759.561604:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+5:2412:x1863837546366336:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497759.561612:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2685 00000100:00100000:0.0:1777497759.561629:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2686 00000100:00100000:0.0:1777497759.561636:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546366464:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497759.561662:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546366464:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497759.561668:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2686 00000100:00100000:0.0:1777497759.561692:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366080 00000100:00100000:0.0:1777497759.561695:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366080 00000100:00100000:0.0:1777497759.561720:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366208 00000100:00100000:0.0:1777497759.561722:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366208 00000100:00100000:0.0:1777497759.561737:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1418 00000100:00100000:0.0:1777497759.561743:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:2413:x1863837546366080:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497759.561768:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:2413:x1863837546366080:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497759.561774:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1418 00000100:00100000:0.0:1777497759.561785:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1419 00000100:00100000:0.0:1777497759.561790:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546366208:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497759.561810:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546366208:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 20us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497759.561815:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1419 00000100:00100000:2.0:1777497759.562010:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546365952 00000100:00100000:2.0:1777497759.562015:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546365952 00000100:00100000:2.0:1777497759.562054:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00100000:2.0:1777497759.562061:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:2413:x1863837546365952:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497759.562090:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+7:2413:x1863837546365952:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497759.562149:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 85 00000100:00080000:3.0:1777497759.562399:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497759.562413:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497759.562416:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497759.562418:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1777497759.906369:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497760.381515:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497760.382042:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366592 00000100:00100000:1.0:1777497760.382067:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366592 00000100:00100000:1.0:1777497760.382177:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:1.0:1777497760.382188:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546366592:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.382205:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497760.382225:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4b7 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.382264:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.382277:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.382286:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734600, rc 0) 00000100:00100000:1.0:1777497760.382354:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546366592:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 168us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.382362:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 86 00000100:00100000:3.0:1777497760.396196:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497760.396398:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366720 00000100:00100000:2.0:1777497760.396408:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366720 00000100:00100000:2.0:1777497760.396462:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:2.0:1777497760.396486:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546366720:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.396647:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546366720:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 161us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.396655:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 87 00000100:00100000:0.0:1777497760.404454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497760.404558:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366848 00000100:00100000:1.0:1777497760.404568:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366848 00000100:00100000:1.0:1777497760.404625:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:1.0:1777497760.404635:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546366848:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.404785:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546366848:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 151us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.404793:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 88 00000100:00100000:3.0:1777497760.416831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497760.416950:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546366976 00000100:00100000:2.0:1777497760.416960:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546366976 00000100:00100000:2.0:1777497760.417024:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:2.0:1777497760.417034:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72617:x1863837546366976:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777497760.417257:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72617:x1863837546366976:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 224us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.417265:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 89 00000100:00100000:3.0:1777497760.428004:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497760.428670:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367104 00000100:00100000:2.0:1777497760.428682:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367104 00000100:00100000:2.0:1777497760.428747:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:2.0:1777497760.428758:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72617:x1863837546367104:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:2.0:1777497760.428912:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72617:x1863837546367104:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 156us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.428920:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 90 00000100:00100000:1.0:1777497760.432154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497760.432264:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367232 00000100:00100000:2.0:1777497760.432276:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367232 00000100:00100000:2.0:1777497760.432336:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:2.0:1777497760.432346:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546367232:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.432364:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497760.432384:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4be expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.432430:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.432440:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.432449:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b400, rc 0) 00000100:00100000:2.0:1777497760.432517:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546367232:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 172us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.432524:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 91 00000100:00100000:3.0:1777497760.440635:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497760.440926:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367360 00000100:00100000:2.0:1777497760.440937:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367360 00000100:00100000:2.0:1777497760.440998:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 92 00000100:00100000:2.0:1777497760.441007:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546367360:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.441224:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546367360:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 217us (598us total) trans 0 rc -2/-2 00000100:00100000:2.0:1777497760.441233:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 92 10000000:01000000:0.0:1777497760.738276:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497760.738301:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff92409c468800 from 58 10000000:01000000:0.0:1777497760.738307:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497760.738354:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.738365:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.738376:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497760.738404:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.738490:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.738597:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924085510a80 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.740316:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054720 00000100:00100000:2.0:1777497760.740331:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054720 00000100:00100000:2.0:1777497760.740478:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1777497760.740490:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837565054720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.740508:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497760.740525:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e1e5 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.740553:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e1e5 expref: 15 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.740577:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e1e5 expref: 15 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.740586:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ae00, rc 0) 00000100:00100000:2.0:1777497760.740697:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565054720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 211us (2207us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.740705:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1777497760.740819:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.740839:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.740849:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497760.740950:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.740986:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.748044:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.748426:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054848 00000100:00100000:0.0:1777497760.748437:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054848 00000100:00100000:2.0:1777497760.749628:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1777497760.750148:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565054848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.750349:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565054848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 708us (9361us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.750358:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1777497760.753350:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.753432:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.758550:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.758609:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.758963:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565054976 00000100:00100000:3.0:1777497760.758972:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565054976 00000100:00100000:3.0:1777497760.759025:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1777497760.759035:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565054976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.759208:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565054976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.759215:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1777497760.761034:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565054976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.762593:0:91384:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91384:1863837565055104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.763604:0:91384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.763994:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055104 00000100:00100000:0.0:1777497760.764003:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055104 00000100:00100000:0.0:1777497760.764069:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1777497760.764079:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91384:x1863837565055104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.764409:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91384:x1863837565055104:12345-0@lo:502:llog_process_th.0 Request processed in 331us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.764417:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1777497760.764563:0:91384:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3180 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.764592:0:91384:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91384:1863837565055104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.766906:0:91384:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91384:1863837565055232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.767010:0:91384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.767570:0:91384:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.767690:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055232 00000100:00100000:3.0:1777497760.767698:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055232 00000100:00100000:3.0:1777497760.767755:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1777497760.767764:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91384:x1863837565055232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497760.767933:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91384:x1863837565055232:12345-0@lo:502:llog_process_th.0 Request processed in 169us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.767941:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1777497760.768426:0:91384:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91384:1863837565055232:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497760.768486:0:91384:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1777497760.769374:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1777497760.769403:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497760.769413:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.769425:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497760.769447:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1777497760.769450:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 53 10000000:01000000:3.0:1777497760.769453:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497760.769497:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.769505:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.769514:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497760.769535:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.769586:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.769615:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.769682:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055360 00000100:00100000:0.0:1777497760.769689:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055360 00000100:00100000:0.0:1777497760.769735:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1777497760.769744:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565055360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497760.769756:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497760.769768:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e1f3 expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.769811:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e1f3 expref: 16 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.769822:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e1f3 expref: 16 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.769831:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef400, rc 0) 00000100:00100000:0.0:1777497760.769876:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565055360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.769883:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1777497760.770026:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.770039:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.770049:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497760.770150:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.770178:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.770197:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.770337:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055488 00000100:00100000:3.0:1777497760.770342:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055488 00000100:00100000:3.0:1777497760.770380:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1777497760.770387:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565055488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.770497:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565055488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.770503:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1777497760.774874:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.774947:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.775028:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.775078:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3180 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.775384:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055616 00000100:00100000:0.0:1777497760.775393:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055616 00000100:00100000:0.0:1777497760.775451:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1777497760.775470:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565055616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.775600:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565055616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.775607:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1777497760.776348:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565055616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.777154:0:91385:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91385:1863837565055744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.777222:0:91385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.777257:0:91385:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.777526:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055744 00000100:00100000:0.0:1777497760.777533:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055744 00000100:00100000:0.0:1777497760.777583:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1777497760.777593:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91385:x1863837565055744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.777743:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91385:x1863837565055744:12345-0@lo:502:llog_process_th.0 Request processed in 152us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.777750:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1777497760.778010:0:91385:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91385:1863837565055744:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497760.778036:0:91385:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497760.778047:0:91385:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497760.778059:0:91385:0:(obd_config.c:1561:class_process_config()) marker 44 (0x1) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:3.0:1777497760.778069:0:91385:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1777497760.778090:0:91385:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:1.0:1777497760.782722:0:91385:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91385:1863837565055872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.782961:0:91385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.783008:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565055872 00000100:00100000:1.0:1777497760.783016:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565055872 00000100:00100000:1.0:1777497760.783187:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1777497760.783198:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91385:x1863837565055872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.783333:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91385:x1863837565055872:12345-0@lo:502:llog_process_th.0 Request processed in 137us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.783341:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1777497760.783391:0:91385:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83fd3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.783414:0:91385:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91385:1863837565055872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497760.783441:0:91385:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497760.783448:0:91385:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497760.783450:0:91385:0:(obd_config.c:1561:class_process_config()) marker 44 (0x2) lustre-MDT0000-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1777497760.783453:0:91385:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000020:01000000:2.0:1777497760.784008:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 53-55 (rc=0) 10000000:01000000:2.0:1777497760.784027:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1777497760.784035:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.784044:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497760.784061:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497760.784062:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 58 10000000:01000000:2.0:1777497760.784064:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497760.784087:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.784119:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.784136:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.784152:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.784188:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.784207:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.784377:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056000 00000100:00100000:0.0:1777497760.784383:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056000 00000100:00100000:0.0:1777497760.784432:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1777497760.784440:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565056000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497760.784451:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497760.784466:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e201 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.784490:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e201 expref: 17 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.784501:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e201 expref: 17 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497760.784509:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:0.0:1777497760.784542:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565056000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.784548:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000020:01000004:0.0:1777497760.784615:0:91386:0:(tgt_mount.c:153:server_get_mount()) get mount ffff92409c468800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1777497760.784620:0:91386:0:(obd_mount.c:701:lustre_put_lsi()) put ffff92409c468800 4 00000100:00100000:2.0:1777497760.784780:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.784793:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.784947:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.785003:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.785029:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.785046:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.785187:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056128 00000100:00100000:1.0:1777497760.785192:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056128 00000100:00100000:1.0:1777497760.785220:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1777497760.785227:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565056128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.785337:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565056128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.785344:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1777497760.786018:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.786188:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.786244:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.786275:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb0e4000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.788552:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056256 00000100:00100000:0.0:1777497760.788565:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056256 00000100:00100000:0.0:1777497760.788612:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1777497760.788621:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565056256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.788787:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565056256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (2541us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.789346:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1777497760.789430:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.789656:0:91387:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91387:1863837565056384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.789703:0:91387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.789738:0:91387:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bce3cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.789765:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056384 00000100:00100000:0.0:1777497760.789769:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056384 00000100:00100000:0.0:1777497760.789796:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1777497760.793706:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91387:x1863837565056384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.795445:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91387:x1863837565056384:12345-0@lo:502:llog_process_th.0 Request processed in 1755us (5732us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.797720:0:91387:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91387:1863837565056384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497760.797811:0:91387:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91387:1863837565056512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497760.797880:0:91387:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.797919:0:91387:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2900 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.797930:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056512 00000100:00100000:1.0:1777497760.797937:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056512 00000100:00100000:1.0:1777497760.797986:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1777497760.797997:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91387:x1863837565056512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.798263:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91387:x1863837565056512:12345-0@lo:502:llog_process_th.0 Request processed in 268us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.798270:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1777497760.798318:0:91387:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91387:1863837565056512:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777497760.798339:0:91387:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:2.0:1777497760.798559:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:2.0:1777497760.798586:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1777497760.798595:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.798607:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497760.798616:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1777497760.798618:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 53 10000000:01000000:2.0:1777497760.798621:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1777497760.798666:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.798674:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.798682:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.798696:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.798725:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.798758:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048b40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.798893:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056640 00000100:00100000:1.0:1777497760.798898:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056640 00000100:00100000:1.0:1777497760.798925:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1777497760.799242:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565056640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.799253:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497760.799266:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e20f expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.799701:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e20f expref: 19 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.799714:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e20f expref: 19 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.799724:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734c00, rc 0) 00000100:00100000:1.0:1777497760.799770:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565056640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 531us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.799778:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1777497760.800037:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1777497760.800234:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.800251:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.800262:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.800946:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.800987:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.801018:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.801163:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056768 00000100:00100000:0.0:1777497760.801169:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056768 00000100:00100000:0.0:1777497760.801222:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1777497760.801231:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565056768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.801381:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565056768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 152us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.801387:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1777497760.801839:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.801873:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.801919:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.801943:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.802067:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565056896 00000100:00100000:0.0:1777497760.802073:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565056896 00000100:00100000:0.0:1777497760.802134:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1777497760.802142:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565056896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.802232:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565056896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.802251:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1777497760.802820:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565056896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.804087:0:91388:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91388:1863837565057024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.804198:0:91388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.804411:0:91388:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.804575:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057024 00000100:00100000:0.0:1777497760.804582:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057024 00000100:00100000:0.0:1777497760.804636:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1777497760.804652:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91388:x1863837565057024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.804785:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91388:x1863837565057024:12345-0@lo:502:llog_process_th.0 Request processed in 141us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.804791:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1777497760.805118:0:91388:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91388:1863837565057024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777497760.805149:0:91388:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497760.805161:0:91388:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497760.805163:0:91388:0:(obd_config.c:1561:class_process_config()) marker 45 (0x1) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000020:00000080:0.0:1777497760.805169:0:91388:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1777497760.805187:0:91388:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from pool_134 00000100:00100000:0.0:1777497760.805573:0:91388:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91388:1863837565057152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497760.805749:0:91388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.805816:0:91388:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c726240 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.806000:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057152 00000100:00100000:2.0:1777497760.806006:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057152 00000100:00100000:2.0:1777497760.806270:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1777497760.806290:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91388:x1863837565057152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.806402:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91388:x1863837565057152:12345-0@lo:502:llog_process_th.0 Request processed in 124us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.806408:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1777497760.806683:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565057280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497760.806718:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.807252:0:91388:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91388:1863837565057152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497760.807293:0:91388:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497760.807301:0:91388:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497760.807303:0:91388:0:(obd_config.c:1561:class_process_config()) marker 45 (0x2) lustre-MDT0001-m rem lustre.pool_134.lustre-OST0001_UUID 00000040:00080000:1.0:1777497760.807308:0:91388:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000020:01000000:2.0:1777497760.807759:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 53-55 (rc=0) 10000000:01000000:2.0:1777497760.807781:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1777497760.807791:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.807877:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497760.807888:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497760.807891:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 58 10000000:01000000:2.0:1777497760.807894:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497760.807919:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.807928:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.807937:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.807962:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.808000:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.808421:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057408 00000100:00100000:1.0:1777497760.808428:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057408 00000100:00100000:1.0:1777497760.808468:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1777497760.808476:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565057408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.808488:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497760.808509:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e21d expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.808532:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e21d expref: 19 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.808544:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e21d expref: 19 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.808553:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735a00, rc 0) 00000100:00100000:1.0:1777497760.808587:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565057408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.808594:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1777497760.808784:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.808876:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.808890:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.808899:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.808959:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.808984:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.808997:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048540 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.809013:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057536 00000100:00100000:2.0:1777497760.809017:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057536 00000100:00100000:2.0:1777497760.809390:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777497760.809399:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565057536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.809504:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565057536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.809511:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1777497760.809541:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.809570:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.809619:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.809637:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048540 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.809752:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057664 00000100:00100000:1.0:1777497760.809756:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057664 00000100:00100000:1.0:1777497760.809780:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1777497760.809787:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565057664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.810005:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565057664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 217us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.810012:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1777497760.810400:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565057664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.811493:0:91389:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91389:1863837565057792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.811563:0:91389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.811638:0:91389:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.811891:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057792 00000100:00100000:1.0:1777497760.811898:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057792 00000100:00100000:1.0:1777497760.811981:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1777497760.811991:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91389:x1863837565057792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.812182:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91389:x1863837565057792:12345-0@lo:502:llog_process_th.0 Request processed in 193us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.812190:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1777497760.812341:0:91389:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91389:1863837565057792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.812393:0:91389:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91389:1863837565057920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.812425:0:91389:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.812448:0:91389:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84e4a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.812882:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057920 00000100:00100000:1.0:1777497760.812893:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057920 00000100:00100000:1.0:1777497760.812930:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1777497760.812937:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91389:x1863837565057920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.813018:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91389:x1863837565057920:12345-0@lo:502:llog_process_th.0 Request processed in 81us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.813024:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1777497760.813250:0:91389:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91389:1863837565057920:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1777497760.814028:0:91389:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:1.0:1777497760.814536:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:1.0:1777497760.814561:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497760.814572:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.814584:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497760.814594:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1777497760.814597:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:1.0:1777497760.814600:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497760.814794:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.814878:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.814889:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497760.814913:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.814974:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.815016:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.817723:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058048 00000100:00100000:3.0:1777497760.817735:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058048 00000100:00100000:3.0:1777497760.817797:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1777497760.817806:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565058048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497760.817823:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497760.817841:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e22b expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.817868:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e22b expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.817879:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e22b expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.817888:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a16000, rc 0) 00000100:00100000:3.0:1777497760.817955:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.817962:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1777497760.818000:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565057280 00000100:00100000:3.0:1777497760.818004:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565057280 00000100:00100000:3.0:1777497760.818036:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:3.0:1777497760.818050:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565057280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497760.818071:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497760.818595:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565057280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 544us (11876us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.818602:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00080000:3.0:1777497760.818666:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497760.818710:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5690700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565057280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497760.818730:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1777497760.818738:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565058176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497760.818770:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.818804:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058176 00000100:00100000:3.0:1777497760.818808:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058176 00000100:00100000:3.0:1777497760.818835:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:3.0:1777497760.818842:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565058176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497760.818858:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497760.818889:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565058176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.818894:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00080000:3.0:1777497760.818906:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497760.818926:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565058176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1777497760.818964:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497760.818983:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.818993:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497760.819059:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.819083:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.819639:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058304 00000100:00100000:2.0:1777497760.819788:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058304 00000100:00100000:2.0:1777497760.819834:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1777497760.819841:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.825020:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 5171us (5927us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.825034:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1777497760.831839:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2300 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.831881:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.831944:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.832006:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.832037:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2300 going to sleep for 11 seconds 00000100:00100000:0.0:1777497760.832636:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058432 00000100:00100000:0.0:1777497760.832645:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058432 00000100:00100000:0.0:1777497760.832692:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1777497760.832700:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.832816:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497760.832823:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1777497760.833296:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497760.836822:0:91392:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:1.0:1777497760.837476:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:1.0:1777497760.837507:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1777497760.837519:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.837532:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497760.837542:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1777497760.837545:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 58 10000000:01000000:1.0:1777497760.837548:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1777497760.837591:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.837599:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.838438:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497760.838466:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.838535:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.838588:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf240 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.838669:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058560 00000100:00100000:3.0:1777497760.838677:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058560 00000100:00100000:3.0:1777497760.838723:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1777497760.838732:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565058560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497760.838746:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497760.838760:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e239 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.838784:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e239 expref: 21 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.838794:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e239 expref: 21 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.838803:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17c00, rc 0) 00000100:00100000:3.0:1777497760.840549:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565058560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1812us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.840568:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1777497760.840935:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.840960:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.840973:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497760.841057:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.841142:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.841182:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.841641:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058688 00000100:00100000:3.0:1777497760.841649:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058688 00000100:00100000:3.0:1777497760.841697:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1777497760.841706:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565058688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.841859:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565058688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.841867:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1777497760.841943:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.841989:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497760.842026:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497760.842068:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409c726240 going to sleep for 11 seconds 00000100:00100000:1.0:1777497760.842217:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058816 00000100:00100000:1.0:1777497760.842221:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058816 00000100:00100000:1.0:1777497760.842255:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1777497760.842263:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565058816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.844517:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565058816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2246us (2481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497760.844530:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1777497760.853024:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565058816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.855870:0:91393:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91393:1863837565058944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497760.855953:0:91393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.856001:0:91393:0:(client.c:2691:ptlrpc_set_wait()) set ffff924091048540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.856090:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565058944 00000100:00100000:3.0:1777497760.856129:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565058944 00000100:00100000:3.0:1777497760.856176:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1777497760.856185:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91393:x1863837565058944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497760.856321:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91393:x1863837565058944:12345-0@lo:502:llog_process_th.0 Request processed in 137us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.856328:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1777497760.856477:0:91393:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91393:1863837565058944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.856531:0:91393:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91393:1863837565059072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497760.856565:0:91393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.856589:0:91393:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.856595:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059072 00000100:00100000:3.0:1777497760.856599:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059072 00000100:00100000:3.0:1777497760.856633:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1777497760.856640:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91393:x1863837565059072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497760.856795:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91393:x1863837565059072:12345-0@lo:502:llog_process_th.0 Request processed in 156us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.856802:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1777497760.856888:0:91393:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ee680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91393:1863837565059072:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1777497760.856909:0:91393:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000020:01000000:3.0:1777497760.857409:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 58-60 (rc=0) 10000000:01000000:3.0:1777497760.857429:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497760.857439:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.857465:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497760.857474:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1777497760.857554:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1777497760.857558:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497760.857588:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.857596:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.857606:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497760.857622:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.857660:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497760.857792:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059200 00000100:00100000:3.0:1777497760.857835:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.857877:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059200 00000100:00100000:2.0:1777497760.857913:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777497760.857921:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565059200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.857932:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497760.857945:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e247 expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.857968:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.857978:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.857985:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a600, rc 0) 00000100:00100000:2.0:1777497760.858216:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 295us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497760.858284:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497760.858298:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.858306:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497760.858360:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.858385:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.858419:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.858441:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059328 00000100:00100000:3.0:1777497760.858444:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059328 00000100:00100000:2.0:1777497760.867614:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1777497760.874967:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1777497760.874991:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.875617:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 630us (17227us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.875627:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1777497760.876314:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.876372:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.876418:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.876539:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.876557:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059456 00000100:00100000:2.0:1777497760.876564:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059456 00000100:00100000:2.0:1777497760.877667:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1777497760.877679:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497760.877787:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.877794:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1777497760.879692:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1777497760.882328:0:91397:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:3.0:1777497760.882596:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:3.0:1777497760.882618:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1777497760.882628:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.882640:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497760.882650:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1777497760.882652:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:3.0:1777497760.882655:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1777497760.882691:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.882699:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497760.882710:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497760.882735:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.882801:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497760.882836:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1777497760.882904:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059584 00000100:00100000:2.0:1777497760.882911:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059584 00000100:00100000:2.0:1777497760.882990:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1777497760.883000:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565059584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497760.883012:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497760.883023:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e255 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.883045:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e255 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.883056:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e255 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.883065:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a000, rc 0) 00000100:00100000:2.0:1777497760.883149:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565059584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497760.883162:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1777497760.883260:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497760.883275:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.883284:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497760.883335:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497760.883361:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497760.890737:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409077b480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497760.891290:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059712 00000100:00100000:3.0:1777497760.891300:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059712 00000100:00100000:3.0:1777497760.891355:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1777497760.891365:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565059712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497760.891487:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565059712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (8114us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497760.891494:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1777497760.892417:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565059712:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1777497760.892478:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1777497760.892491:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497760.892503:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497760.931746:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497761.956246:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1777497762.771707:0:91490:0:(class_obd.c:319:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffe9df50e70 20000000:00000080:2.0:1777497762.771727:0:91490:0:(mgs_handler.c:1163:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9240b54b5000 uarg=0000000000000000 00000040:00100000:2.0:1777497762.772452:0:91490:0:(llog.c:1067:llog_reverse_process()) index 60 : idx 49 20000000:01000000:2.0:1777497762.772460:0:91490:0:(mgs_llog.c:959:mgs_search_pool_cb()) Matched pool rec 59 cmd:0xce022 lustre.pool_134 lustre-OST0001_UUID 20000000:01000000:2.0:1777497762.772476:0:91490:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1777497762.773197:0:91491:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 52 marker 39 1->4: lustre-clilov new lustre.pool_134 20000000:01000000:1.0:1777497762.773252:0:91491:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 54 marker 39 2->4: lustre-clilov new lustre.pool_134 00000040:00080000:1.0:1777497762.773283:0:91491:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 61 count 60 00000040:00080000:2.0:1777497762.773860:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].61, 224 off18904 20000000:01000000:2.0:1777497762.773877:0:91490:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-clilov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1777497762.773894:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].62, 112 off19016 00000040:00080000:2.0:1777497762.773910:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].63, 224 off19240 20000000:01000000:2.0:1777497762.773925:0:91490:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1777497762.774509:0:91492:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 46 marker 40 1->4: lustre-MDT0000-mdtlov new lustre.pool_134 20000000:01000000:1.0:1777497762.774578:0:91492:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 49 marker 40 2->4: lustre-MDT0000-mdtlov new lustre.pool_134 00000040:00080000:1.0:1777497762.774595:0:91492:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 56 count 55 00000040:00080000:2.0:1777497762.774856:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].56, 224 off18016 20000000:01000000:2.0:1777497762.774868:0:91490:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:2.0:1777497762.774883:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].57, 120 off18136 00000040:00080000:2.0:1777497762.774899:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].58, 224 off18360 20000000:01000000:2.0:1777497762.774911:0:91490:0:(mgs_llog.c:1105:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.pool_134 fl=4 20000000:01000000:1.0:1777497762.775700:0:91493:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 46 marker 41 1->4: lustre-MDT0001-mdtlov new lustre.pool_134 20000000:01000000:1.0:1777497762.775742:0:91493:0:(mgs_llog.c:1072:mgs_modify_handler()) Changing rec 49 marker 41 2->4: lustre-MDT0001-mdtlov new lustre.pool_134 00000040:00080000:1.0:1777497762.775760:0:91493:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 56 count 55 00000040:00080000:1.0:1777497762.786364:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].56, 224 off18016 20000000:01000000:1.0:1777497762.786394:0:91490:0:(mgs_llog.c:1526:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre pool_134 (null) (null) 00000040:00080000:1.0:1777497762.786411:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].57, 120 off18136 00000040:00080000:1.0:1777497762.786427:0:91490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].58, 224 off18360 10000000:01000000:1.0:1777497762.786444:0:91490:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1777497762.786465:0:91490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786488:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786495:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786503:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e1e5 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786509:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e1f3 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786615:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e201 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786621:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e20f expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786640:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e21d expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786647:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e22b expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786653:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e239 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786659:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786664:0:91490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e255 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786671:0:91490:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786715:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e255 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.786730:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e255 expref: 22 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497762.786745:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565059840:0@lo:104: 00000100:00100000:1.0:1777497762.786811:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1777497762.788075:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497762.788116:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497762.788139:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565059968:0@lo:104: 00000100:00100000:1.0:1777497762.788178:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.791785:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059840 00000100:00100000:0.0:1777497762.791798:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059840 00000100:00100000:0.0:1777497762.791859:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565059968 00000100:00100000:0.0:1777497762.791862:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565059968 00000100:00100000:0.0:1777497762.791887:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1777497762.791897:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91490:x1863837565059840:12345-0@lo:104: 00010000:00010000:0.0:1777497762.791917:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.791996:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.792002:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+4:91490:x1863837565059840:12345-0@lo:104: Request processed in 107us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.792009:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1777497762.792026:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1777497762.793007:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565059968:12345-0@lo:104: 00010000:00010000:0.0:1777497762.793028:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793130:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777497762.793137:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565059968:12345-0@lo:104: Request processed in 1104us (4957us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.793145:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:0.0:1777497762.793175:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497762.793181:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793201:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16400 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.793205:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793213:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.793220:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.793226:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.793271:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793278:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.793298:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793304:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88a16400/0x3e357265691e255 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e25c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793317:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.793319:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793325:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.793328:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793344:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.793350:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.793355:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.793367:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793373:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.793378:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793384:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88a16800/0x3e357265691e247 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e24e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793392:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.793394:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.793396:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.793402:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497762.793423:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565060096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.793458:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.793494:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497762.793500:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565060224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.793533:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.793562:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060096 00000100:00100000:0.0:1777497762.793568:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060096 00010000:00010000:0.0:1777497762.793591:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e255 expref: 23 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.793618:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060224 00000100:00100000:0.0:1777497762.793621:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060224 00010000:00010000:0.0:1777497762.793633:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e247 expref: 24 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.793649:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1777497762.793655:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3659:x1863837565060096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497762.793666:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497762.793671:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e255 expref: 24 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793680:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e255 expref: 24 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793697:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497762.793720:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3659:x1863837565060096:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.793725:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2587 00000100:00100000:0.0:1777497762.793737:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1777497762.793742:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565060224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497762.793749:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497762.793752:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e247 expref: 23 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793761:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e247 expref: 23 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793769:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497762.793795:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565060224:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.793801:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2588 00000100:00100000:0.0:1777497762.793842:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565060224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.793851:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565060096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497762.793907:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e239 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.793919:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e239 expref: 22 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.793929:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060352:0@lo:104: 00000100:00100000:0.0:1777497762.793952:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.793974:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060352 00000100:00100000:0.0:1777497762.793977:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060352 00000100:00100000:0.0:1777497762.793994:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1777497762.793999:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060352:12345-0@lo:104: 00010000:00010000:0.0:1777497762.794007:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794038:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.794043:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060352:12345-0@lo:104: Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.794048:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:0.0:1777497762.794061:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.794066:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794125:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.794128:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794135:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.794141:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.794146:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.794166:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794172:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.794186:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794193:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89735200/0x3e357265691e239 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e240 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794202:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.794204:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.794205:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.794229:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e22b expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794237:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e22b expref: 22 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.794257:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060608:0@lo:104: 00000100:00100000:0.0:1777497762.794281:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.794302:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060608 00000100:00100000:0.0:1777497762.794305:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060608 00000100:00100000:0.0:1777497762.794322:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1777497762.794329:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060608:12345-0@lo:104: 00010000:00010000:0.0:1777497762.794336:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794368:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.794373:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060608:12345-0@lo:104: Request processed in 45us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.794378:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:0.0:1777497762.794403:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e21d expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794412:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e21d expref: 22 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.794419:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060736:0@lo:104: 00000100:00100000:0.0:1777497762.794437:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.794454:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060736 00000100:00100000:0.0:1777497762.794457:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060736 00000100:00100000:0.0:1777497762.794470:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1777497762.794476:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060736:12345-0@lo:104: 00010000:00010000:0.0:1777497762.794483:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794530:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1777497762.794536:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060736:12345-0@lo:104: Request processed in 61us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.794542:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:0.0:1777497762.794567:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e20f expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794575:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e20f expref: 22 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.794582:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060864:0@lo:104: 00000100:00100000:0.0:1777497762.794600:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.794616:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060864 00000100:00100000:0.0:1777497762.794619:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060864 00000100:00100000:0.0:1777497762.794632:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1777497762.794637:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060864:12345-0@lo:104: 00010000:00010000:0.0:1777497762.794643:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794671:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1777497762.794676:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565060864:12345-0@lo:104: Request processed in 39us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.794681:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:0.0:1777497762.794692:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1777497762.794696:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794702:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.794710:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794717:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.794722:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.794727:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.794743:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794749:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.794756:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794762:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f89734e00/0x3e357265691e22b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e232 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794771:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1777497762.794774:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794779:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.794782:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794787:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.794793:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.794804:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.794819:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794824:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.794836:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794842:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902b000/0x3e357265691e21d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e224 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794851:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.794854:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794859:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902be00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.794861:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794867:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.794873:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.794877:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.794890:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794895:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.794908:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794914:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902be00/0x3e357265691e20f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e216 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.794922:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.794924:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.794926:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497762.794941:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565061120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.794963:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.794981:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497762.794986:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565061248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.795005:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1777497762.795037:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e201 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795045:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e201 expref: 22 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795054:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061376:0@lo:104: 00000100:00100000:0.0:1777497762.795089:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.795136:0:6497:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1777497762.795145:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061376 00000100:00100000:0.0:1777497762.795148:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061376 00000100:00100000:0.0:1777497762.795164:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1777497762.795169:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061376:12345-0@lo:104: 00010000:00010000:0.0:1777497762.795176:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795218:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.795223:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86018450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061376:12345-0@lo:104: Request processed in 54us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.795229:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00010000:00010000:0.0:1777497762.795260:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.795264:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795270:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.795273:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795281:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.795287:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.795292:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.795308:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795313:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.795318:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795324:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff92409902a800/0x3e357265691e201 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e208 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795343:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795344:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795346:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795367:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795375:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 22 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795384:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061632:0@lo:104: 00000100:00100000:0.0:1777497762.795404:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.795421:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061632 00000100:00100000:0.0:1777497762.795424:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061632 00000100:00100000:0.0:1777497762.795438:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1777497762.795443:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061632:12345-0@lo:104: 00010000:00010000:0.0:1777497762.795450:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795476:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.795480:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061632:12345-0@lo:104: Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.795486:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:0.0:1777497762.795498:0:6503:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.795501:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795507:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.795510:0:6503:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795522:0:6503:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.795529:0:6503:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.795533:0:6503:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.795549:0:6503:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795554:0:6503:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.795559:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795564:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88a17000/0x3e357265691e1f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1fa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795573:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795574:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795576:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795596:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795604:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 22 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795613:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061888:0@lo:104: 00000100:00100000:0.0:1777497762.795632:0:91490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.795648:0:6497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061888 00000100:00100000:0.0:1777497762.795658:0:6497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061888 00000100:00100000:0.0:1777497762.795675:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1777497762.795680:0:6497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061888:12345-0@lo:104: 00010000:00010000:0.0:1777497762.795687:0:6497:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795716:0:6497:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1777497762.795720:0:6497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:91490:x1863837565061888:12345-0@lo:104: Request processed in 40us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.795726:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:0.0:1777497762.795738:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1777497762.795741:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795747:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eefc00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:0.0:1777497762.795750:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795757:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1777497762.795763:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497762.795768:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1777497762.795784:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795790:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1777497762.795800:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795812:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e1e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691e1ec expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.795824:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795825:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497762.795827:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497762.795840:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565062016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.795862:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497762.795887:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061120 00000100:00100000:0.0:1777497762.795890:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061120 00010000:00010000:0.0:1777497762.795904:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e21d expref: 23 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795921:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061248 00000100:00100000:0.0:1777497762.795923:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061248 00010000:00010000:0.0:1777497762.795932:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e20f expref: 24 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795944:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062016 00000100:00100000:0.0:1777497762.795946:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062016 00010000:00010000:0.0:1777497762.795953:0:6499:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 25 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.795967:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1777497762.795971:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3659:x1863837565061120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497762.795980:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497762.795985:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e21d expref: 25 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.796003:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e21d expref: 25 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.796016:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497762.796040:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3659:x1863837565061120:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.796047:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2589 00000100:00100000:0.0:1777497762.796060:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1777497762.796066:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3659:x1863837565061248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1777497762.796072:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1777497762.796500:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565060480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.796548:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497762.796573:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565061504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.796592:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497762.796605:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1777497762.796609:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565060992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.796627:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497762.796636:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565061760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.796653:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497762.796677:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060480 00000100:00100000:3.0:1777497762.796681:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060480 00010000:00010000:3.0:1777497762.796696:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e239 expref: 25 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497762.796710:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061504 00000100:00100000:3.0:1777497762.796713:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061504 00010000:00010000:3.0:1777497762.796736:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e201 expref: 26 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497762.796764:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565060992 00000100:00100000:3.0:1777497762.796767:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565060992 00010000:00010000:3.0:1777497762.796781:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e22b expref: 27 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497762.796789:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565061760 00000100:00100000:3.0:1777497762.796791:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565061760 00010000:00010000:3.0:1777497762.796801:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 28 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497762.796811:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1777497762.796817:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+28:3659:x1863837565062016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.796827:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.796831:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 28 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.796838:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 28 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.796853:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.796879:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+28:3659:x1863837565062016:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.796885:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2591 00000100:00100000:3.0:1777497762.796900:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1777497762.796907:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+27:3657:x1863837565060480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.796913:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.796918:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e239 expref: 27 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.796938:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e239 expref: 27 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.796947:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.796973:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+27:3657:x1863837565060480:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.796979:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2592 00000100:00100000:3.0:1777497762.796993:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1777497762.796999:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+26:3657:x1863837565061504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.797007:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.797010:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e201 expref: 26 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797017:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e201 expref: 26 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797026:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.797060:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+26:3657:x1863837565061504:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.797066:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2593 00000100:00100000:3.0:1777497762.797088:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1777497762.797115:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3657:x1863837565060992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.797124:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.797127:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e22b expref: 25 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797135:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e22b expref: 25 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797150:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.797172:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3657:x1863837565060992:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.797178:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2594 00000100:00100000:3.0:1777497762.797189:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1777497762.797194:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3657:x1863837565061760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.797201:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.797204:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 24 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797211:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 24 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.797219:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.797240:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+24:3657:x1863837565061760:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.797245:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2595 00000100:00100000:3.0:1777497762.797586:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565060992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.797595:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565061760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.797602:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565060480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497762.797608:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565061504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1777497762.800526:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497762.800541:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497762.801270:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.801289:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 8 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801306:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565062144:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497762.801392:0:91490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.801423:0:91490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801433:0:91490:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565062272:192.168.202.4@tcp:104: 00000100:00100000:2.0:1777497762.801460:0:91490:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2000 going to sleep for 11 seconds 00010000:00010000:2.0:1777497762.801500:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a000/0x3e357265691e25c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e255 expref: 23 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801528:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408a0ed180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565059840:0@lo:104: 00010000:00010000:2.0:1777497762.801542:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902a600/0x3e357265691e24e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e247 expref: 22 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801550:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565059968:0@lo:104: 00010000:00010000:2.0:1777497762.801572:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88a17c00/0x3e357265691e240 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e239 expref: 21 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801582:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060352:0@lo:104: 00010000:00010000:2.0:1777497762.801591:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f88a16000/0x3e357265691e232 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e22b expref: 20 pid: 90573 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801599:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060608:0@lo:104: 00010000:00010000:2.0:1777497762.801608:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89735a00/0x3e357265691e224 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e21d expref: 19 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801616:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060736:0@lo:104: 00000100:00100000:2.0:1777497762.801625:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565060864:0@lo:104: 00010000:00010000:2.0:1777497762.801645:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eeec00/0x3e357265691e208 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e201 expref: 18 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801653:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061376:0@lo:104: 00010000:00010000:2.0:1777497762.801662:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eef400/0x3e357265691e1fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e1f3 expref: 17 pid: 90580 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801668:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061632:0@lo:104: 00010000:00010000:2.0:1777497762.801678:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902ae00/0x3e357265691e1ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e1e5 expref: 16 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.801685:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf9a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565061888:0@lo:104: 00010000:00010000:0.0:1777497762.803187:0:6499:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691e20f expref: 24 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.803219:0:6499:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691e20f expref: 15 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.803244:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734c00/0x3e357265691e216 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691e20f expref: 15 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.803273:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1777497762.803352:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3659:x1863837565061248:12345-0@lo:103:ldlm_bl.0 Request processed in 7285us (8344us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497762.803362:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:0.0:1777497762.803464:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565062016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.803474:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565061248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1777497762.803482:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcf99500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565061120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497762.816175:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565062144:192.168.202.4@tcp:104: 00000100:00100000:2.0:1777497762.816193:0:91490:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91490:1863837565062272:192.168.202.4@tcp:104: 00010000:00010000:2.0:1777497762.816256:0:91490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497762.836481:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497762.843904:0:25500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367488 00000100:00100000:3.0:1777497762.843923:0:25500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367488 00010000:00010000:3.0:1777497762.843980:0:25500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497762.844040:0:25500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2596 00000100:00100000:3.0:1777497762.844051:0:25500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546367488:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1777497762.844068:0:25500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497762.844075:0:25500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.844547:0:25500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.844568:0:25500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92409902b400/0x3e357265691e1de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4be expref: 9 pid: 90575 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.844587:0:25500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497762.844709:0:25500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2414:x1863837546367488:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 660us (8239us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497762.844717:0:25500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2596 00000100:00100000:0.0:1777497762.861299:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497762.861480:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367616 00000100:00100000:2.0:1777497762.861491:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367616 00010000:00010000:2.0:1777497762.861540:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497762.861584:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2597 00000100:00100000:2.0:1777497762.861595:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2415:x1863837546367616:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1777497762.861609:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497762.861614:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861644:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861661:0:6500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734600/0x3e357265691e1d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4b7 expref: 8 pid: 90574 timeout: 3992 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861677:0:6500:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861684:0:6500:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861699:0:6500:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861705:0:6500:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861711:0:6500:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861717:0:6500:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861722:0:6500:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:2.0:1777497762.861726:0:6500:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861732:0:6500:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861763:0:6500:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497762.861774:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497762.861841:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:34a4158d-137e-4629-9769-4a4bd53f7f61+7:2415:x1863837546367616:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 241us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497762.861849:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2597 00010000:00010000:3.0:1777497762.862303:0:91490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.862311:0:91490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497762.862317:0:91490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89735400/0x3e357265691e263 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497762.978303:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497763.874481:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565062656:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874552:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874586:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565063168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874608:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874623:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565063680:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874640:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874660:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1777497763.874666:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565062528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874684:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874696:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565063040:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874716:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874729:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565063552:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.874746:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.874787:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062656 00000100:00100000:0.0:1777497763.874794:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062656 00000100:00100000:0.0:1777497763.874852:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062528 00000100:00100000:0.0:1777497763.874855:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062528 00000100:00100000:0.0:1777497763.874967:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1777497763.874978:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565062656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875028:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565062656:12345-0@lo:400:kworker.0 Request processed in 52us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875035:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1777497763.875051:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1777497763.875154:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565062528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875186:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565062528:12345-0@lo:400:kworker.0 Request processed in 117us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875192:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1777497763.875212:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063168 00000100:00100000:0.0:1777497763.875215:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063168 00000100:00100000:0.0:1777497763.875240:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063680 00000100:00100000:0.0:1777497763.875242:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063680 00000100:00100000:0.0:1777497763.875262:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1777497763.875270:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565063168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875299:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565063168:12345-0@lo:400:kworker.0 Request processed in 31us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875304:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2687 00000100:00100000:0.0:1777497763.875315:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1777497763.875320:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565063680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875344:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565063680:12345-0@lo:400:kworker.0 Request processed in 24us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875350:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2688 00000100:00100000:0.0:1777497763.875371:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063040 00000100:00100000:0.0:1777497763.875377:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063040 00000100:00100000:0.0:1777497763.875398:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063552 00000100:00100000:0.0:1777497763.875401:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063552 00000100:00100000:0.0:1777497763.875414:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4090 00000100:00100000:0.0:1777497763.875420:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565063040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875449:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565063040:12345-0@lo:400:kworker.0 Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875455:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4090 00000100:00100000:0.0:1777497763.875479:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4091 00000100:00100000:0.0:1777497763.875485:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565063552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875512:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565063552:12345-0@lo:400:kworker.0 Request processed in 28us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.875517:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4091 00000100:00080000:0.0:1777497763.875531:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1777497763.875535:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1777497763.875537:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497763.875580:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565062528:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875589:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565063040:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875595:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565063552:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875603:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565062656:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875610:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565063168:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.875618:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565063680:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875739:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565062400:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875789:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.875825:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565062912:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875846:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.875864:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565063424:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875897:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.875914:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565063936:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875930:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.875947:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1777497763.875953:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565062784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.875971:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.875987:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565063296:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876007:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.876021:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565063808:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876040:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.876064:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062912 00000100:00100000:2.0:1777497763.876078:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062912 00000100:00100000:2.0:1777497763.876155:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063424 00000100:00100000:2.0:1777497763.876159:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063424 00000100:00100000:2.0:1777497763.876173:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063936 00000100:00100000:2.0:1777497763.876175:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063936 00000100:00100000:2.0:1777497763.876184:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062784 00000100:00100000:2.0:1777497763.876186:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062784 00000100:00100000:2.0:1777497763.876200:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1777497763.876206:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565062912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876243:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1863837565062912:12345-0@lo:400:kworker.0 Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.876249:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1777497763.876263:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1777497763.876268:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565063424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876295:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565063424:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.876300:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:2.0:1777497763.876310:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1777497763.876315:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565063936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876338:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565063936:12345-0@lo:400:kworker.0 Request processed in 23us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.876343:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:2.0:1777497763.876353:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1777497763.876359:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565062784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876382:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565062784:12345-0@lo:400:kworker.0 Request processed in 23us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.876387:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00080000:2.0:1777497763.876411:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497763.876419:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497763.876438:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565062784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876449:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3660:1863837565062912:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876457:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565063424:0@lo:400:kworker.0 00000100:00100000:2.0:1777497763.876466:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565063936:0@lo:400:kworker.0 00000100:00100000:1.0:1777497763.877129:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063296 00000100:00100000:1.0:1777497763.877137:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063296 00000100:00100000:1.0:1777497763.877194:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565063808 00000100:00100000:1.0:1777497763.877198:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565063808 00000100:00100000:1.0:1777497763.877225:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1777497763.877233:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565063296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497763.877285:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565063296:12345-0@lo:400:kworker.0 Request processed in 54us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.877292:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2689 00000100:00100000:1.0:1777497763.877306:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1777497763.877312:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565063808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497763.877338:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565063808:12345-0@lo:400:kworker.0 Request processed in 27us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.877344:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2690 00000100:00100000:1.0:1777497763.877385:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086ea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565063296:0@lo:400:kworker.0 00000100:00100000:1.0:1777497763.877396:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565063808:0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.880510:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565062400 00000100:00100000:0.0:1777497763.880535:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565062400 00000100:00100000:0.0:1777497763.880619:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1777497763.880629:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3660:x1863837565062400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497763.880715:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:3660:x1863837565062400:12345-0@lo:400:kworker.0 Request processed in 88us (4925us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.880722:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1777497763.880848:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565062400:0@lo:400:kworker.0 00000100:00080000:2.0:1777497763.880922:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497763.892490:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565064064:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497763.892564:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.892611:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1777497763.892617:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565064192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497763.892638:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.892669:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064064 00000100:00100000:2.0:1777497763.892675:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064064 00000100:00100000:2.0:1777497763.892717:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064192 00000100:00100000:2.0:1777497763.892720:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064192 00000100:00100000:2.0:1777497763.892738:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4092 00000100:00100000:2.0:1777497763.892746:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565064064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497763.892778:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497763.892819:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565064064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.892838:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4092 00000100:00100000:2.0:1777497763.892856:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4093 00000100:00100000:2.0:1777497763.892863:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565064192:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497763.892892:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445183488 avail 1298944000 00000100:00100000:2.0:1777497763.892919:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565064192:12345-0@lo:41:osp-pre-0-1.0 Request processed in 57us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.892937:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4093 00000100:00100000:2.0:1777497763.892987:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565064192:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497763.892999:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565064064:0@lo:41:osp-pre-1-0.0 10000000:01000000:2.0:1777497763.938388:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1777497763.938396:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff92409c468800 from 61 10000000:01000000:2.0:1777497763.938401:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1777497763.938452:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.938464:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.938476:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497763.938504:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.938584:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.938630:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840c780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.938749:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064320 00000100:00100000:1.0:1777497763.938817:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064320 00000100:00100000:3.0:1777497763.938977:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1777497763.938990:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+14:6511:x1863837565064320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.939031:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497763.939044:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88a17400/0x3e357265691e271 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e26a expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.939077:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a17400/0x3e357265691e271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e26a expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.939088:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88a17400/0x3e357265691e271 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e26a expref: 15 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.939388:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17400, rc 0) 00000100:00100000:3.0:1777497763.939508:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 521us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.939515:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1777497763.939684:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497763.939701:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.939723:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497763.939795:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.939823:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.939920:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840c780 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.940271:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064448 00000100:00100000:0.0:1777497763.940277:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064448 00000100:00100000:0.0:1777497763.940360:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1777497763.940369:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.940513:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.940520:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1777497763.940593:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.940630:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.940671:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.942715:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840c780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.942830:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064576 00000100:00100000:1.0:1777497763.942839:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064576 00000100:00100000:0.0:1777497763.942906:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1777497763.942917:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.943089:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.943127:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1777497763.943221:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.943875:0:91495:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91495:1863837565064704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1777497763.943925:0:91495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.944359:0:91495:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.944597:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064704 00000100:00100000:3.0:1777497763.944605:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064704 00000100:00100000:3.0:1777497763.944639:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1777497763.944648:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91495:x1863837565064704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.944774:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91495:x1863837565064704:12345-0@lo:502:llog_process_th.0 Request processed in 128us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.944782:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1777497763.944844:0:91495:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91495:1863837565064704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.944898:0:91495:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91495:1863837565064832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.944935:0:91495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.944954:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064832 00000100:00100000:3.0:1777497763.944957:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064832 00000100:00100000:3.0:1777497763.944972:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1777497763.944985:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91495:x1863837565064832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.945054:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:91495:x1863837565064832:12345-0@lo:502:llog_process_th.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.945061:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1777497763.945129:0:91495:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.945143:0:91495:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91495:1863837565064832:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777497763.945162:0:91495:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1777497763.945947:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1777497763.945980:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497763.945992:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946017:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497763.946028:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1777497763.946030:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 56 10000000:01000000:3.0:1777497763.946033:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1777497763.946063:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946081:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946090:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.946150:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.946208:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.946224:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.946553:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565064960 00000100:00100000:3.0:1777497763.946560:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565064960 00000100:00100000:3.0:1777497763.946590:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1777497763.946597:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+15:6511:x1863837565064960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.946607:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497763.946618:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88a16e00/0x3e357265691e27f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e278 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946640:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a16e00/0x3e357265691e27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e278 expref: 16 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946649:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88a16e00/0x3e357265691e27f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e278 expref: 16 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946658:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a16e00, rc 0) 00000100:00100000:3.0:1777497763.946689:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565064960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.946696:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1777497763.946746:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565064960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.946759:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.946769:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.946822:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.946853:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.946866:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.946877:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065088 00000100:00100000:3.0:1777497763.946880:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065088 00000100:00100000:3.0:1777497763.946895:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1777497763.946901:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565065088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.947243:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565065088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 341us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.947426:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1777497763.947475:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.947507:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.947547:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.947562:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a540 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.947576:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065216 00000100:00100000:3.0:1777497763.947579:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065216 00000100:00100000:3.0:1777497763.947596:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1777497763.947601:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565065216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.947676:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565065216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.947682:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1777497763.948178:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.948885:0:91496:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91496:1863837565065344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.948939:0:91496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.948977:0:91496:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.949210:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065344 00000100:00100000:3.0:1777497763.949216:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065344 00000100:00100000:3.0:1777497763.949613:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1777497763.949623:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91496:x1863837565065344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.949760:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91496:x1863837565065344:12345-0@lo:502:llog_process_th.0 Request processed in 139us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.949767:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1777497763.949914:0:91496:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91496:1863837565065344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1777497763.949943:0:91496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497763.949953:0:91496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497763.949956:0:91496:0:(obd_config.c:1561:class_process_config()) marker 47 (0x1) lustre-MDT0000-m del lustre.pool_134 00000020:00000080:0.0:1777497763.949961:0:91496:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1777497763.950695:0:91496:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91496:1863837565065472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.950735:0:91496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497763.951545:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065472 00000100:00100000:1.0:1777497763.951552:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065472 00000100:00100000:1.0:1777497763.951595:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1777497763.951603:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91496:x1863837565065472:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497763.951718:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:91496:x1863837565065472:12345-0@lo:502:llog_process_th.0 Request processed in 102us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.951726:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1777497763.952510:0:91496:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a600 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.952537:0:91496:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91496:1863837565065472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1777497763.952568:0:91496:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1777497763.952574:0:91496:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1777497763.952577:0:91496:0:(obd_config.c:1561:class_process_config()) marker 47 (0x2) lustre-MDT0000-m del lustre.pool_134 00000040:00080000:1.0:1777497763.952581:0:91496:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 59 count 58 00000020:01000000:3.0:1777497763.952880:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 56-58 (rc=0) 10000000:01000000:3.0:1777497763.952900:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1777497763.952909:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.952921:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497763.952932:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497763.952935:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240b521d800 from 61 10000000:01000000:3.0:1777497763.952938:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497763.952968:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.952977:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.952986:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.953232:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.953297:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.953332:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.953553:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065600 00000100:00100000:1.0:1777497763.953559:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065600 00000100:00100000:1.0:1777497763.953603:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1777497763.953614:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+16:6511:x1863837565065600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497763.953627:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497763.953641:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735a00/0x3e357265691e28d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e286 expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.953664:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735a00/0x3e357265691e28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e286 expref: 17 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.953675:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735a00/0x3e357265691e28d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e286 expref: 17 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.953683:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735a00, rc 0) 00000100:00100000:1.0:1777497763.953731:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565065600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.953751:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1777497763.953951:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.953965:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.953981:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.954056:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.954139:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.954162:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.954177:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065728 00000100:00100000:3.0:1777497763.954180:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065728 00000100:00100000:3.0:1777497763.954202:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1777497763.954208:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565065728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.956615:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565065728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2398us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.956627:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1777497763.956752:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.956806:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.956856:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.956890:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409840ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.956900:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065856 00000100:00100000:1.0:1777497763.956908:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065856 00000100:00100000:1.0:1777497763.957005:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1777497763.957015:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565065856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.957172:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565065856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.957178:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1777497763.957224:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565065856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.960580:0:91497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91497:1863837565065984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.964455:0:91497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.964548:0:91497:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.964590:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565065984 00000100:00100000:0.0:1777497763.964600:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565065984 00000100:00100000:0.0:1777497763.964693:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1777497763.964714:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91497:x1863837565065984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.964915:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91497:x1863837565065984:12345-0@lo:502:llog_process_th.0 Request processed in 212us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.964923:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1777497763.965079:0:91497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91497:1863837565065984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.965554:0:91497:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91497:1863837565066112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.965601:0:91497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.965635:0:91497:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a000 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.965693:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066112 00000100:00100000:0.0:1777497763.965698:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066112 00000100:00100000:0.0:1777497763.965833:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1777497763.965842:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91497:x1863837565066112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.965936:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:91497:x1863837565066112:12345-0@lo:502:llog_process_th.0 Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.965941:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1777497763.966016:0:91497:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91497:1863837565066112:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1777497763.966037:0:91497:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:1.0:1777497763.966228:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:1.0:1777497763.966252:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1777497763.966262:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.966274:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497763.966284:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1777497763.966286:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 56 10000000:01000000:1.0:1777497763.966289:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1777497763.966313:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.966321:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.966331:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497763.966345:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.966383:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497763.968823:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497763.970552:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066240 00000100:00100000:2.0:1777497763.970566:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066240 00000100:00100000:2.0:1777497763.970633:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1777497763.970644:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+17:6511:x1863837565066240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497763.970662:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497763.970680:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a600/0x3e357265691e29b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e294 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.970718:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a600/0x3e357265691e29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e294 expref: 18 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.970728:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a600/0x3e357265691e29b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e294 expref: 18 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497763.970756:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a600, rc 0) 00000100:00100000:2.0:1777497763.970834:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (4451us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.970842:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1777497763.970981:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497763.970999:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.971009:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497763.971143:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.971183:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497763.971212:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066368 00000100:00100000:2.0:1777497763.971217:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066368 00000100:00100000:1.0:1777497763.971217:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497763.971270:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1777497763.971277:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.971549:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 272us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.971557:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1777497763.971579:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.971621:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.971667:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.971898:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066496 00000100:00100000:3.0:1777497763.971904:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066496 00000100:00100000:1.0:1777497763.971909:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f84fc2180 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.971981:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1777497763.971990:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.972246:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.972262:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1777497763.972512:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.972847:0:91498:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91498:1863837565066624:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.972887:0:91498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.972919:0:91498:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a600 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.972926:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066624 00000100:00100000:1.0:1777497763.972932:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066624 00000100:00100000:1.0:1777497763.973012:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1777497763.973021:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91498:x1863837565066624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497763.973198:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91498:x1863837565066624:12345-0@lo:502:llog_process_th.0 Request processed in 177us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.973207:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1777497763.973247:0:91498:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91498:1863837565066624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497763.973427:0:91498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1777497763.973439:0:91498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497763.973441:0:91498:0:(obd_config.c:1561:class_process_config()) marker 48 (0x1) lustre-MDT0001-m del lustre.pool_134 00000020:00000080:3.0:1777497763.973449:0:91498:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1777497763.973560:0:91498:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91498:1863837565066752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.973600:0:91498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.973632:0:91498:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.973643:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066752 00000100:00100000:0.0:1777497763.973649:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066752 00000100:00100000:0.0:1777497763.973690:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1777497763.973699:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91498:x1863837565066752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.973778:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:91498:x1863837565066752:12345-0@lo:502:llog_process_th.0 Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.973784:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1777497763.973809:0:91498:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91498:1863837565066752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1777497763.973833:0:91498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1777497763.973837:0:91498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497763.973839:0:91498:0:(obd_config.c:1561:class_process_config()) marker 48 (0x2) lustre-MDT0001-m del lustre.pool_134 00000040:00080000:3.0:1777497763.973842:0:91498:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 59 count 58 00000020:01000000:0.0:1777497763.974224:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 56-58 (rc=0) 10000000:01000000:0.0:1777497763.974245:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1777497763.974456:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.974468:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497763.974479:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1777497763.974489:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f818b6800 from 61 10000000:01000000:0.0:1777497763.974493:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1777497763.974519:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.974527:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.974536:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497763.974551:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.974584:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.974613:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67af00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.974630:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565066880 00000100:00100000:1.0:1777497763.974635:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565066880 00000100:00100000:1.0:1777497763.974727:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1777497763.974742:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+18:6511:x1863837565066880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497763.974752:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497763.974765:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89735800/0x3e357265691e2a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e2a2 expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.974787:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89735800/0x3e357265691e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e2a2 expref: 19 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.974798:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89735800/0x3e357265691e2a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2a2 expref: 19 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.974807:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735800, rc 0) 00000100:00100000:1.0:1777497763.974842:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565066880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.974848:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1777497763.974874:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565066880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497763.974887:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.974896:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497763.974940:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.974962:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.975151:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67af00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.975239:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067008 00000100:00100000:3.0:1777497763.975244:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067008 00000100:00100000:3.0:1777497763.975456:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1777497763.975466:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565067008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.975578:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565067008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.975585:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1777497763.976273:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.976318:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.976365:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.976393:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67af00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.976517:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067136 00000100:00100000:1.0:1777497763.976522:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067136 00000100:00100000:1.0:1777497763.976557:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1777497763.976566:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565067136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.976799:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565067136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.976807:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1777497763.976842:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.978638:0:91499:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91499:1863837565067264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.978716:0:91499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.978799:0:91499:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.978854:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067264 00000100:00100000:1.0:1777497763.978860:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067264 00000100:00100000:1.0:1777497763.978937:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1777497763.978946:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91499:x1863837565067264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497763.979092:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91499:x1863837565067264:12345-0@lo:502:llog_process_th.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.979175:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1777497763.979270:0:91499:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91499:1863837565067264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.979320:0:91499:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91499:1863837565067392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.979364:0:91499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.979737:0:91499:0:(client.c:2691:ptlrpc_set_wait()) set ffff924081377f00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.979820:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067392 00000100:00100000:3.0:1777497763.979825:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067392 00000100:00100000:3.0:1777497763.979868:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1777497763.979876:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91499:x1863837565067392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.979962:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:91499:x1863837565067392:12345-0@lo:502:llog_process_th.0 Request processed in 87us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.979968:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1777497763.980145:0:91499:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91499:1863837565067392:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1777497763.980170:0:91499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000020:01000000:3.0:1777497763.980544:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:3.0:1777497763.980564:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1777497763.980574:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.980585:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497763.980594:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1777497763.980596:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:3.0:1777497763.980598:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1777497763.980626:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.980634:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.980643:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.980656:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.980690:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.980721:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.980769:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067520 00000100:00100000:0.0:1777497763.980773:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067520 00000100:00100000:0.0:1777497763.980806:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1777497763.980813:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+19:6511:x1863837565067520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497763.980823:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497763.980835:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eeee00/0x3e357265691e2b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e2b0 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.980858:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eeee00/0x3e357265691e2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e2b0 expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.980867:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eeee00/0x3e357265691e2b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2b0 expref: 20 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.980876:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeee00, rc 0) 00000100:00100000:0.0:1777497763.980904:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.980917:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1777497763.980981:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.980993:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.981133:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.981187:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.981212:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.981228:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.981490:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067648 00000100:00100000:0.0:1777497763.981494:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067648 00000100:00100000:0.0:1777497763.981529:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1777497763.981536:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.981874:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.981882:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1777497763.981961:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.981994:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.982571:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.982607:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.982650:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067776 00000100:00100000:0.0:1777497763.982655:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067776 00000100:00100000:0.0:1777497763.982691:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1777497763.982699:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.982789:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.982796:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1777497763.982976:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1777497763.985872:0:91500:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 11 00000020:01000000:3.0:1777497763.986914:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:3.0:1777497763.986944:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1777497763.986956:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.986970:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497763.986981:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1777497763.986983:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff9240bcd94000 from 61 10000000:01000000:3.0:1777497763.986986:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1777497763.987585:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.987595:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.987606:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.987632:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.987696:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.987773:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1777497763.987823:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565067904 00000100:00100000:0.0:1777497763.987831:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565067904 00000100:00100000:0.0:1777497763.987919:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1777497763.987929:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:6511:x1863837565067904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497763.987943:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497763.987956:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924085eee200/0x3e357265691e2c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e2be expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.987980:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924085eee200/0x3e357265691e2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e2be expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.988435:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924085eee200/0x3e357265691e2c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2be expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.988446:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eee200, rc 0) 00000100:00100000:0.0:1777497763.988500:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565067904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 573us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497763.988514:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1777497763.988591:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565067904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.988606:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.988615:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.988673:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.988697:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.988953:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.989031:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068032 00000100:00100000:1.0:1777497763.989037:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068032 00000100:00100000:1.0:1777497763.989083:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1777497763.989091:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565068032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.989228:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565068032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 138us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.989234:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1777497763.989765:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.989802:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.989852:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.989873:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.990678:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068160 00000100:00100000:1.0:1777497763.990686:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068160 00000100:00100000:1.0:1777497763.990734:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1777497763.990742:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565068160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.990848:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565068160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.990855:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1777497763.990953:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.991831:0:91501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91501:1863837565068288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.991886:0:91501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.991954:0:91501:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f85c1a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.991984:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068288 00000100:00100000:1.0:1777497763.991989:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068288 00000100:00100000:1.0:1777497763.992502:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1777497763.992514:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91501:x1863837565068288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1777497763.992649:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91501:x1863837565068288:12345-0@lo:502:llog_process_th.0 Request processed in 137us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.992656:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1777497763.992776:0:91501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91501:1863837565068288:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.992828:0:91501:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91501:1863837565068416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1777497763.992863:0:91501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.992895:0:91501:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf000 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.992937:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068416 00000100:00100000:3.0:1777497763.992942:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068416 00000100:00100000:3.0:1777497763.992979:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1777497763.992986:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91501:x1863837565068416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1777497763.993086:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:91501:x1863837565068416:12345-0@lo:502:llog_process_th.0 Request processed in 100us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.993244:0:91501:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbe300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:91501:1863837565068416:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1777497763.993274:0:91501:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64 count 63 00000100:00100000:3.0:1777497763.993679:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000020:01000000:0.0:1777497763.993754:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 61-63 (rc=0) 10000000:01000000:0.0:1777497763.993775:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1777497763.993784:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.993795:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497763.993805:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1777497763.993807:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1777497763.993810:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1777497763.993836:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.993843:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.993863:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497763.993879:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.993909:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.993941:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.993982:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068544 00000100:00100000:1.0:1777497763.993992:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068544 00000100:00100000:1.0:1777497763.994208:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1777497763.994216:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565068544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497763.994225:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497763.994236:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f89734400/0x3e357265691e2d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e2cc expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.994267:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f89734400/0x3e357265691e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e2cc expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.994277:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f89734400/0x3e357265691e2d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2cc expref: 22 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497763.994286:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734400, rc 0) 00000100:00100000:1.0:1777497763.994318:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497763.994323:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1777497763.994516:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1777497763.994530:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.994539:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497763.994584:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.994606:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.994895:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.994944:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068672 00000100:00100000:3.0:1777497763.994948:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068672 00000100:00100000:3.0:1777497763.994976:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1777497763.994983:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.995354:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.995361:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1777497763.995406:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.995436:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.995473:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497763.995523:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67af00 going to sleep for 11 seconds 00000100:00100000:1.0:1777497763.995630:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068800 00000100:00100000:1.0:1777497763.995634:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068800 00000100:00100000:2.0:1777497763.995710:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1777497763.995720:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497763.995801:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497763.995808:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1777497763.995867:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1777497763.996927:0:91502:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 14 00000020:01000000:0.0:1777497763.997518:0:6511:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1777497763.997548:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1777497763.997557:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.997567:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497763.997577:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1777497763.997580:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-sptlrpc-ffff9240911f99c0 from 1 10000000:01000000:0.0:1777497763.997583:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1777497763.997627:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.997635:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497763.997643:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497763.997662:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1777497763.997715:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497763.997753:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bcfbf480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497763.997930:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565068928 00000100:00100000:3.0:1777497763.997944:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565068928 00000100:00100000:3.0:1777497763.997994:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1777497763.998153:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565068928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.998168:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497763.998182:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f88a16200/0x3e357265691e2e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691e2da expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.998210:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f88a16200/0x3e357265691e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691e2da expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.998223:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f88a16200/0x3e357265691e2e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2da expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.998231:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a16200, rc 0) 00000100:00100000:3.0:1777497763.998529:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565068928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 378us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497763.999277:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1777497763.999357:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565068928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497763.999379:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497763.999390:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497763.999462:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565069056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497763.999504:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497763.999746:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069056 00000100:00100000:1.0:1777497763.999753:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069056 00000100:00100000:1.0:1777497763.999790:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1777497763.999798:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565069056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1777497763.999878:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565069056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (373us total) trans 0 rc -2/-2 00000100:00100000:1.0:1777497763.999884:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1777497764.000519:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb67a9c0 going to sleep for 10 seconds 00000100:00100000:3.0:1777497764.000542:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82cb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565069056:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1777497764.000595:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1777497764.000604:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497764.000614:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497764.003410:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497764.386791:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497764.386815:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565069184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497764.386888:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497764.386943:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069184 00000100:00100000:3.0:1777497764.386952:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069184 00000100:00100000:3.0:1777497764.387009:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:3.0:1777497764.387019:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565069184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497764.387047:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497764.387069:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497764.387082:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565069312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497764.387145:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565069184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497764.387152:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1777497764.392253:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3adf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565069184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497764.401285:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497764.401405:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069312 00000100:00100000:3.0:1777497764.401416:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069312 00000100:00100000:3.0:1777497764.401496:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:3.0:1777497764.401506:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565069312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1777497764.401543:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497764.401601:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565069312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497764.401608:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:1.0:1777497764.401729:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3addf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565069312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497764.478664:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497764.480712:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367744 00000100:00100000:2.0:1777497764.480727:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367744 00000100:00100000:2.0:1777497764.480801:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:2.0:1777497764.480811:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+7:70262:x1863837546367744:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497764.480843:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497764.480860:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902a000/0x3e357265691e2e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4c5 expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.480890:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902a000/0x3e357265691e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4c5 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.480901:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902a000/0x3e357265691e2e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4c5 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.480910:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a000, rc 0) 00000100:00100000:2.0:1777497764.480977:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546367744:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 169us (2325us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497764.480984:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 170 00000100:00100000:1.0:1777497764.484911:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497764.485425:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546367872 00000100:00100000:0.0:1777497764.485437:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546367872 00000100:00100000:0.0:1777497764.485504:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:0.0:1777497764.485515:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546367872:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1777497764.485731:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546367872:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 218us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497764.485740:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 171 00000100:00100000:0.0:1777497764.498560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497764.498666:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368000 00000100:00100000:2.0:1777497764.498677:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368000 00000100:00100000:2.0:1777497764.498740:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:2.0:1777497764.498750:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546368000:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1777497764.498901:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546368000:12345-192.168.202.4@tcp:503:ll_cfg_requeue.0 Request processed in 152us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497764.498909:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 172 00000100:00100000:1.0:1777497764.510013:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497764.510318:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368128 00000100:00100000:0.0:1777497764.510327:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368128 00000100:00100000:0.0:1777497764.510392:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:0.0:1777497764.510402:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72636:x1863837546368128:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:0.0:1777497764.513187:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72636:x1863837546368128:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 2775us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497764.513203:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 173 00000100:00100000:1.0:1777497764.523259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497764.523555:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368256 00000100:00100000:3.0:1777497764.523566:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368256 00000100:00100000:3.0:1777497764.523625:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1777497764.523635:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72636:x1863837546368256:12345-192.168.202.4@tcp:502:llog_process_th.0 00000100:00100000:3.0:1777497764.523788:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+8:72636:x1863837546368256:12345-192.168.202.4@tcp:502:llog_process_th.0 Request processed in 154us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497764.523796:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 174 00000100:00100000:3.0:1777497764.530033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497764.530128:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368384 00000100:00100000:2.0:1777497764.530138:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368384 00000100:00100000:2.0:1777497764.530200:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:2.0:1777497764.530210:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546368384:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497764.530228:0:90574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497764.530259:0:90574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff92409902aa00/0x3e357265691e2ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4cc expref: -99 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.530286:0:90574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff92409902aa00/0x3e357265691e2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4cc expref: 9 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.530297:0:90574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff92409902aa00/0x3e357265691e2ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4cc expref: 9 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497764.530305:0:90574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902aa00, rc 0) 00000100:00100000:2.0:1777497764.530365:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546368384:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 157us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497764.530373:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 175 00000100:00100000:1.0:1777497764.537702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497764.537848:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368512 00000100:00100000:3.0:1777497764.537860:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368512 00000100:00100000:3.0:1777497764.537919:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:3.0:1777497764.537929:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546368512:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1777497764.538269:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546368512:12345-192.168.202.4@tcp:501:ll_cfg_requeue.0 Request processed in 340us (574us total) trans 0 rc -2/-2 00000100:00100000:3.0:1777497764.538277:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 176 00000100:00100000:1.0:1777497764.669660:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497764.669708:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497764.669740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497764.669784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497764.669823:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546369024 00000100:00100000:1.0:1777497764.669833:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546369024 00000100:00100000:1.0:1777497764.669888:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368896 00000100:00100000:1.0:1777497764.669891:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368896 00000100:00100000:1.0:1777497764.669916:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2691 00000100:00100000:1.0:1777497764.669927:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546369024:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497764.669996:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546369024:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497764.670003:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2691 00000100:00100000:1.0:1777497764.670033:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2692 00000100:00100000:1.0:1777497764.670040:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546368896:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497764.670077:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546368896:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497764.670083:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2692 00000100:00100000:2.0:1777497764.670381:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368768 00000100:00100000:2.0:1777497764.670386:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368768 00000100:00100000:2.0:1777497764.670437:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546368640 00000100:00100000:2.0:1777497764.670440:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546368640 00000100:00100000:2.0:1777497764.670462:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1426 00000100:00100000:2.0:1777497764.670470:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546368768:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497764.670505:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3addf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546368768:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 37us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497764.670512:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1426 00000100:00100000:2.0:1777497764.670524:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1427 00000100:00100000:2.0:1777497764.670529:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+10:2413:x1863837546368640:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497764.670548:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af59bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+10:2413:x1863837546368640:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 20us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497764.670554:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1427 00000100:00080000:2.0:1777497764.670582:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497764.670586:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497764.670588:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497764.670591:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1777497765.026450:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497765.926649:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497765.926671:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565069440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497765.926740:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497765.927201:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069440 00000100:00100000:3.0:1777497765.927209:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069440 00000100:00100000:3.0:1777497765.927261:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1777497765.927273:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565069440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497765.927300:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8619200 pending 0 free 3922481152 avail 3690958848 00000100:00100000:3.0:1777497765.927344:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565069440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497765.927348:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000100:00100000:3.0:1777497765.927386:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565069440:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1777497765.927555:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1777497765.931489:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565069568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497765.931549:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497765.932324:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069568 00000100:00100000:1.0:1777497765.932332:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069568 00000100:00100000:1.0:1777497765.932384:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:1.0:1777497765.932391:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565069568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497765.932415:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497765.932464:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565069568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497765.932469:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00000100:00100000:1.0:1777497765.932515:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565069568:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1777497765.932562:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1777497766.059712:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497767.075742:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497767.675052:0:91599:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: == replay-single test 135: Server failure in lock replay phase ========================================================== 17:22:46 (1777497766) 00000100:00100000:1.0:1777497767.912552:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497767.912589:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546369280 00000100:00100000:1.0:1777497767.912599:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546369280 00000100:00100000:1.0:1777497767.912662:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1454 00000100:00100000:1.0:1777497767.912673:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+10:72807:x1863837546369280:12345-192.168.202.4@tcp:36:mkdir.0 00010000:00010000:1.0:1777497767.912731:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497767.912759:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e105 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c471 expref: 10 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912779:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497767.912785:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497767.912842:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912857:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912867:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912882:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912890:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.912909:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915846:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915864:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915875:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497767.915894:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dda5839b reply state 000000008e9270d1 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915905:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915911:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:1.0:1777497767.915914:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497767.915918:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1777497767.915923:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:1.0:1777497767.915932:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915939:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915946:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915951:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915964:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497767.915968:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.915975:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.916936:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497767.916942:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497767.916948:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.916957:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e2f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497767.916972:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dda5839b reply state 000000008e9270d1 transno 120259084291 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.917491:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497767.917504:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9240817a3600) 00010000:00010000:1.0:1777497767.917506:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497767.917509:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1777497767.917619:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:72807:x1863837546369280:12345-192.168.202.4@tcp:36:mkdir.0 Request processed in 4945us (5074us total) trans 120259084291 rc 0/0 00000100:00100000:1.0:1777497767.917628:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1454 00000100:00080000:1.0:1777497767.917662:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497767.942381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.942468:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546369408 00000100:00100000:2.0:1777497767.942478:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546369408 00000100:00100000:2.0:1777497767.942561:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1455 00000100:00100000:2.0:1777497767.942571:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:72810:x1863837546369408:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497767.942595:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497767.942614:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e30b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4d3 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942674:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942688:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942700:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497767.942743:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497767.942747:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497767.942763:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942784:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e30b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4d3 expref: 13 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942822:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4d3 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.942830:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.942833:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497767.942836:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902bc00, rc 0) 00000100:00100000:2.0:1777497767.942895:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:72810:x1863837546369408:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 326us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497767.942902:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1455 00000100:00100000:1.0:1777497767.945788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.946399:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546369664 00000100:00100000:2.0:1777497767.946411:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546369664 00000100:00100000:2.0:1777497767.946473:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1456 00000100:00100000:2.0:1777497767.946483:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+12:72810:x1863837546369664:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497767.946503:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497767.946506:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1777497767.946532:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e312 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4d3 expref: 12 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946552:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.946558:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497767.946571:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e319 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4da expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946699:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946730:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946741:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946753:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946760:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946767:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946828:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946836:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946843:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497767.946852:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:2.0:1777497767.946864:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946871:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946877:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946889:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902a400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497767.946893:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946901:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946910:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497767.946913:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.946917:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946922:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e32e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946937:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946943:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946949:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946954:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946959:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ac00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497767.946962:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946978:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946986:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.946988:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.946991:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.946997:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e320 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947005:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947011:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947016:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947020:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497767.947022:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947027:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947048:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9240817a3600) 00010000:00010000:2.0:1777497767.947050:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.947053:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947068:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e327 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947126:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e319 lrc: 1/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4da expref: 12 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947136:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.947138:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.947142:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e319 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4da expref: 12 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.947151:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ba00, rc 0) 00000100:00100000:2.0:1777497767.947207:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:72810:x1863837546369664:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 726us (1428us total) trans 0 rc 301/301 00000100:00100000:2.0:1777497767.947214:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1456 00000100:00100000:1.0:1777497767.953193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.953347:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546369792 00000100:00100000:2.0:1777497767.953357:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546369792 00000100:00100000:2.0:1777497767.953417:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1457 00000100:00100000:2.0:1777497767.953428:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:72810:x1863837546369792:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:2.0:1777497767.953448:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497767.953468:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4e1 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953540:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953554:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953572:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497767.953615:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497767.953620:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497767.953639:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953664:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4e1 expref: 13 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953684:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4e1 expref: 12 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.953692:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.953695:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497767.953698:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b400, rc 0) 00000100:00100000:2.0:1777497767.953804:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+12:72810:x1863837546369792:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 378us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497767.953811:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1457 00000100:00100000:0.0:1777497767.957067:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.957334:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546370048 00000100:00100000:2.0:1777497767.957344:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546370048 00000100:00100000:3.0:1777497767.957580:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1458 00000100:00100000:3.0:1777497767.957604:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+12:72810:x1863837546370048:12345-192.168.202.4@tcp:101:lfs.0 00010000:00010000:3.0:1777497767.957625:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497767.957646:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4e8 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957729:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957746:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957759:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957772:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957779:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957786:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497767.957894:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00010000:00010000:3.0:1777497767.957972:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957980:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.957999:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958016:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958022:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497767.958026:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958043:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958056:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:3.0:1777497767.958059:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497767.958064:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958071:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958085:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958091:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958123:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958128:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497767.958132:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958148:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958157:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9240817a3600) 00010000:00010000:3.0:1777497767.958159:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497767.958162:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958168:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958202:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e343 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4e8 expref: 14 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958213:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:3.0:1777497767.958215:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1777497767.958219:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4e8 expref: 14 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.958228:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f88a17800, rc 0) 00000100:00100000:3.0:1777497767.958350:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+13:72810:x1863837546370048:12345-192.168.202.4@tcp:101:lfs.0 Request processed in 747us (1293us total) trans 120259084292 rc 301/301 00000100:00100000:3.0:1777497767.958358:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1458 00000100:00100000:1.0:1777497767.964265:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497767.964351:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546370304 00000100:00100000:3.0:1777497767.964361:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546370304 00000100:00100000:3.0:1777497767.964474:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1459 00000100:00100000:3.0:1777497767.964486:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+13:72810:x1863837546370304:12345-192.168.202.4@tcp:36:lfs.0 00010000:00010000:3.0:1777497767.964584:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.964601:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.964614:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497767.964754:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d1f74997 reply state 00000000413f3c0d transno 120259084293 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.964768:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497767.964777:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497767.964780:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:3.0:1777497767.964784:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1777497767.964791:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000100:00100000:3.0:1777497767.964867:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+15:72810:x1863837546370304:12345-192.168.202.4@tcp:36:lfs.0 Request processed in 383us (610us total) trans 120259084293 rc 0/0 00000100:00100000:3.0:1777497767.964875:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1459 00000100:00100000:1.0:1777497767.967445:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497767.967624:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546370560 00000100:00100000:0.0:1777497767.967634:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546370560 00000100:00100000:0.0:1777497767.967690:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 247 00000100:00100000:0.0:1777497767.967700:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+15:72810:x1863837546370560:12345-192.168.202.4@tcp:35:lfs.0 00000100:00100000:0.0:1777497767.968019:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+16:72810:x1863837546370560:12345-192.168.202.4@tcp:35:lfs.0 Request processed in 321us (581us total) trans 120259084294 rc 0/0 00000100:00100000:0.0:1777497767.968036:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 247 00000100:00100000:1.0:1777497767.983569:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.983660:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546370688 00000100:00100000:2.0:1777497767.983672:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546370688 00000100:00100000:2.0:1777497767.985586:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1460 00000100:00100000:2.0:1777497767.985598:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+16:72815:x1863837546370688:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497767.985626:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497767.985649:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4ef expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.985959:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.985974:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986111:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986130:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986139:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986146:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986222:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e37b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986232:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e37b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986239:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e37b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497767.986272:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x4:0x0]: returning size 4096 00000004:00200000:2.0:1777497767.986277:0:65418:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497767.986309:0:65418:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e37b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986334:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986340:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986346:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986352:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986359:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902ba00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497767.986363:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986370:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986382:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497767.986385:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.986477:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986485:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e36d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986500:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986506:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986518:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986523:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497767.986526:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986532:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986540:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9240817a3600) 00010000:00010000:2.0:1777497767.986543:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497767.986546:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986552:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e374 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986581:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4ef expref: 18 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986594:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ac00/0x3e357265691e37b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4ef expref: 17 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497767.986601:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497767.986603:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1777497767.986605:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ac00, rc 0) 00000100:00100000:2.0:1777497767.986719:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+17:72815:x1863837546370688:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1123us (3158us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497767.986736:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1460 00000100:00100000:3.0:1777497767.996078:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497767.996746:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546370944 00000100:00100000:2.0:1777497767.996758:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546370944 00000100:00100000:0.0:1777497767.996867:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1461 00000100:00100000:0.0:1777497767.996879:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+17:72815:x1863837546370944:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497767.996901:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497767.996928:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e382 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4f6 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997058:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997119:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997132:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997149:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997156:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997163:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497767.997451:0:73210:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x303:0x0], count =95 00000004:00080000:0.0:1777497767.997459:0:73210:0:(osp_object.c:1640:osp_create()) Writing gap [0x280000401:0x303:0x0]+95 in llog 00000004:00080000:0.0:1777497767.997479:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x362:0x0], index 0: 0 00010000:00010000:0.0:1777497767.997614:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e397 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997624:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e397 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997632:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e397 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997666:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997673:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997687:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997693:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497767.997697:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997705:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997716:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497767.997720:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497767.997724:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997731:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e389 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497767.997744:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000007d81bd5d reply state 000000008329ca72 transno 120259084295 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997756:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997762:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff924083cd1200) 00010000:00010000:0.0:1777497767.997764:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497767.997767:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497767.997798:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e382 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4f6 expref: 20 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997812:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e397 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4f6 expref: 19 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497767.997827:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1c00) 00010000:00010000:0.0:1777497767.997829:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497767.997831:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b600, rc 0) 00000100:00100000:0.0:1777497767.997903:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+20:72815:x1863837546370944:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1027us (1835us total) trans 120259084295 rc 0/0 00000100:00100000:0.0:1777497767.997911:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1461 00000100:00100000:1.0:1777497768.001041:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.001226:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546371200 00000100:00100000:0.0:1777497768.001236:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546371200 00000100:00100000:0.0:1777497768.001334:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1462 00000100:00100000:0.0:1777497768.001346:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+20:72815:x1863837546371200:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.001413:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.001440:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e397 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4f6 expref: 20 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.001458:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1c00) 00010000:00010000:0.0:1777497768.001468:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.001514:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.001527:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.001536:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.001639:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d7c40105 reply state 000000008ace0b22 transno 120259084296 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.001671:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.001678:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:0.0:1777497768.001680:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.001683:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.001776:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+21:72815:x1863837546371200:12345-192.168.202.4@tcp:36:touch.0 Request processed in 432us (752us total) trans 120259084296 rc 0/0 00000100:00100000:0.0:1777497768.001784:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1462 00000100:00100000:1.0:1777497768.014886:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.015050:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546371328 00000100:00100000:2.0:1777497768.015062:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546371328 00000100:00100000:2.0:1777497768.015163:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1463 00000100:00100000:2.0:1777497768.015175:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+21:72815:x1863837546371328:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.015200:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.015223:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e3ac lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c4fd expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.015282:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e3ac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4fd expref: 22 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.015299:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b600/0x3e357265691e3ac lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4fd expref: 22 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.015318:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:2.0:1777497768.015321:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.015325:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b600, rc 0) 00000100:00100000:2.0:1777497768.015376:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:72815:x1863837546371328:12345-192.168.202.4@tcp:101:touch.0 Request processed in 205us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.015384:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1463 00000100:00100000:1.0:1777497768.027002:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.027386:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546371456 00000100:00100000:0.0:1777497768.027592:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546371456 00000100:00100000:0.0:1777497768.027710:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5908 00000100:00100000:0.0:1777497768.027721:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+5:2415:x1863837546371456:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.027948:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546371456:12345-192.168.202.4@tcp:2:touch.0 Request processed in 229us (963us total) trans 4294969460 rc 0/0 00000100:00100000:0.0:1777497768.027957:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5908 00000100:00080000:1.0:1777497768.029091:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1777497768.038954:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.039179:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546371712 00000100:00100000:2.0:1777497768.039190:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546371712 00000100:00100000:2.0:1777497768.039284:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:2.0:1777497768.039295:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+22:72815:x1863837546371712:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.039632:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+23:72815:x1863837546371712:12345-192.168.202.4@tcp:35:touch.0 Request processed in 339us (686us total) trans 120259084297 rc 0/0 00000100:00100000:2.0:1777497768.039640:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 248 00000100:00100000:3.0:1777497768.045146:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.045310:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546371968 00000100:00100000:0.0:1777497768.045319:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546371968 00000100:00100000:0.0:1777497768.045378:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1464 00000100:00100000:0.0:1777497768.045389:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+23:72815:x1863837546371968:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.045414:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.045435:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e3b3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c504 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045552:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045581:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045594:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045610:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045616:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.045621:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.045885:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x363:0x0], index 0: 0 00010000:00010000:0.0:1777497768.046146:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3c8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046168:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046176:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3c8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046209:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046217:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046223:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046237:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.046241:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046249:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046261:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.046264:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.046269:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046275:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3ba lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.046291:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c5f3f19a reply state 00000000b4a99f50 transno 120259084298 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046301:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046308:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff924083cd1c00) 00010000:00010000:0.0:1777497768.046310:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.046312:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.046341:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e3b3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c504 expref: 26 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046355:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3c8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c504 expref: 25 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.046374:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff924083cd1500) 00010000:00010000:0.0:1777497768.046377:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.046379:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b600, rc 0) 00000100:00100000:0.0:1777497768.046437:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+26:72815:x1863837546371968:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1050us (1342us total) trans 120259084298 rc 0/0 00000100:00100000:0.0:1777497768.046444:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1464 00000100:00100000:1.0:1777497768.051571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.051695:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546372224 00000100:00100000:3.0:1777497768.051705:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546372224 00000100:00100000:3.0:1777497768.051761:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1465 00000100:00100000:3.0:1777497768.051771:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+26:72815:x1863837546372224:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.051826:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.051852:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3c8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c504 expref: 26 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.051887:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff924083cd1500) 00010000:00010000:3.0:1777497768.051897:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.051944:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.051957:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.051968:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.052081:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ebb317ce reply state 00000000bae4a1a9 transno 120259084299 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.052140:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.052148:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:3.0:1777497768.052151:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.052154:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.052240:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+27:72815:x1863837546372224:12345-192.168.202.4@tcp:36:touch.0 Request processed in 470us (678us total) trans 120259084299 rc 0/0 00000100:00100000:3.0:1777497768.052248:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1465 00000100:00100000:1.0:1777497768.056583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.056702:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546372352 00000100:00100000:2.0:1777497768.056712:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546372352 00000100:00100000:2.0:1777497768.056773:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1466 00000100:00100000:2.0:1777497768.056783:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+27:72815:x1863837546372352:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.056808:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.056828:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e3dd lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c50b expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.056881:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e3dd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c50b expref: 28 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.056896:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b200/0x3e357265691e3dd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c50b expref: 28 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.056915:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:2.0:1777497768.056919:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.056922:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b200, rc 0) 00000100:00100000:2.0:1777497768.056995:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+28:72815:x1863837546372352:12345-192.168.202.4@tcp:101:touch.0 Request processed in 204us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.057002:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1466 00000100:00100000:1.0:1777497768.059976:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.060079:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546372480 00000100:00100000:0.0:1777497768.060089:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546372480 00000100:00100000:0.0:1777497768.060190:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5909 00000100:00100000:0.0:1777497768.060200:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+6:2414:x1863837546372480:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.060392:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546372480:12345-192.168.202.4@tcp:2:touch.0 Request processed in 193us (423us total) trans 4294969461 rc 0/0 00000100:00100000:0.0:1777497768.060400:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5909 00000100:00100000:3.0:1777497768.066810:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.066911:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546372736 00000100:00100000:0.0:1777497768.066922:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546372736 00000100:00100000:0.0:1777497768.066983:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 249 00000100:00100000:0.0:1777497768.066995:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+28:72815:x1863837546372736:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1777497768.067324:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+29:72815:x1863837546372736:12345-192.168.202.4@tcp:35:touch.0 Request processed in 331us (522us total) trans 120259084300 rc 0/0 00000100:00100000:0.0:1777497768.067332:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 249 00000100:00100000:1.0:1777497768.071541:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.073774:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546372992 00000100:00100000:0.0:1777497768.073789:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546372992 00000100:00100000:0.0:1777497768.073864:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1467 00000100:00100000:0.0:1777497768.073876:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+29:72815:x1863837546372992:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.073919:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.073940:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e3e4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c512 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074064:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074080:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074091:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074144:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074151:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074158:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.074417:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x364:0x0], index 0: 0 00010000:00010000:0.0:1777497768.074540:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e3f9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074549:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e3f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074557:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e3f9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074597:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074604:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074611:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074616:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.074620:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074627:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074638:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.074640:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.074644:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074651:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e3eb lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.074662:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d4b3acfb reply state 0000000004f93e67 transno 120259084301 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074672:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074677:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff924083cd1a00) 00010000:00010000:0.0:1777497768.074684:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.074686:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.074713:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e3e4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c512 expref: 32 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074726:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e3f9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c512 expref: 31 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.074733:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff924083cd1100) 00010000:00010000:0.0:1777497768.074735:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.074737:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eef400, rc 0) 00000100:00100000:0.0:1777497768.074795:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+32:72815:x1863837546372992:12345-192.168.202.4@tcp:101:touch.0 Request processed in 923us (3263us total) trans 120259084301 rc 0/0 00000100:00100000:0.0:1777497768.074802:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1467 00000100:00100000:1.0:1777497768.077960:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.078071:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546373248 00000100:00100000:3.0:1777497768.078080:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546373248 00000100:00100000:3.0:1777497768.078318:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1468 00000100:00100000:3.0:1777497768.078331:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+32:72815:x1863837546373248:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.078410:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.078437:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e3f9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c512 expref: 32 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.078479:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff924083cd1100) 00010000:00010000:3.0:1777497768.078491:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.078544:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.078557:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.078567:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.078675:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000efbd6fc4 reply state 00000000569db055 transno 120259084302 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.078687:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.078693:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:3.0:1777497768.078696:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.078699:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.078840:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+33:72815:x1863837546373248:12345-192.168.202.4@tcp:36:touch.0 Request processed in 512us (888us total) trans 120259084302 rc 0/0 00000100:00100000:3.0:1777497768.078847:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1468 00000100:00100000:1.0:1777497768.083715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.083893:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546373376 00000100:00100000:2.0:1777497768.083904:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546373376 00000100:00100000:2.0:1777497768.084007:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1469 00000100:00100000:2.0:1777497768.084018:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+33:72815:x1863837546373376:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.084090:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.084142:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e40e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c519 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.084201:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e40e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c519 expref: 34 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.084217:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902ba00/0x3e357265691e40e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c519 expref: 34 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.084236:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:2.0:1777497768.084239:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.084243:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902ba00, rc 0) 00000100:00100000:2.0:1777497768.084300:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+34:72815:x1863837546373376:12345-192.168.202.4@tcp:101:touch.0 Request processed in 284us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.084308:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1469 00000100:00100000:1.0:1777497768.087328:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.087477:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546373504 00000100:00100000:0.0:1777497768.087487:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546373504 00000100:00100000:0.0:1777497768.087647:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5910 00000100:00100000:0.0:1777497768.087657:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546373504:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.087916:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+8:2415:x1863837546373504:12345-192.168.202.4@tcp:2:touch.0 Request processed in 260us (594us total) trans 4294969462 rc 0/0 00000100:00100000:0.0:1777497768.087923:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5910 00000100:00100000:3.0:1777497768.090815:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.090918:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546373760 00000100:00100000:2.0:1777497768.090928:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546373760 00000100:00100000:2.0:1777497768.091022:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 250 00000100:00100000:2.0:1777497768.091046:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+34:72815:x1863837546373760:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.091367:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+35:72815:x1863837546373760:12345-192.168.202.4@tcp:35:touch.0 Request processed in 323us (561us total) trans 120259084303 rc 0/0 00000100:00100000:2.0:1777497768.091376:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 250 00000100:00100000:1.0:1777497768.095793:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.095910:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546374016 00000100:00100000:0.0:1777497768.095921:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546374016 00000100:00100000:0.0:1777497768.096128:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1470 00000100:00100000:0.0:1777497768.096141:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+35:72815:x1863837546374016:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.096168:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.096190:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e415 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c520 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096309:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096326:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096340:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096356:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096364:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096372:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.096716:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x365:0x0], index 0: 0 00010000:00010000:0.0:1777497768.096853:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e42a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096862:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e42a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096869:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e42a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096902:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096919:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096925:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096931:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.096935:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096941:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096952:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.096955:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.096959:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.096965:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e41c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.096979:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003e94ed11 reply state 0000000010d9ff4f transno 120259084304 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.097357:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.097364:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff924083cd1100) 00010000:00010000:0.0:1777497768.097367:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.097370:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.097545:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e415 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c520 expref: 38 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.097568:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e42a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c520 expref: 37 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.097576:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924083cd1500) 00010000:00010000:0.0:1777497768.097579:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.097581:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150ae00, rc 0) 00000100:00100000:0.0:1777497768.097709:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+38:72815:x1863837546374016:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1571us (1924us total) trans 120259084304 rc 0/0 00000100:00100000:0.0:1777497768.097718:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1470 00010000:00010000:0.0:1777497768.098187:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497768.101773:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.101894:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546374272 00000100:00100000:0.0:1777497768.101904:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546374272 00000100:00100000:0.0:1777497768.102009:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1471 00000100:00100000:0.0:1777497768.102021:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+38:72815:x1863837546374272:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.102126:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.102153:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e42a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c520 expref: 38 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.102173:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924083cd1500) 00010000:00010000:0.0:1777497768.102185:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.102235:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.102248:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.102259:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.102389:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000004be66b08 reply state 000000002fa87538 transno 120259084305 ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.102402:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.102409:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:0.0:1777497768.102417:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.102420:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.102519:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+39:72815:x1863837546374272:12345-192.168.202.4@tcp:36:touch.0 Request processed in 500us (755us total) trans 120259084305 rc 0/0 00000100:00100000:0.0:1777497768.102526:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1471 00000100:00100000:1.0:1777497768.104860:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.104960:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546374400 00000100:00100000:2.0:1777497768.104969:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546374400 00000100:00100000:2.0:1777497768.105038:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1472 00000100:00100000:2.0:1777497768.105050:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+39:72815:x1863837546374400:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.105088:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.105140:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e43f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c527 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.105193:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e43f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c527 expref: 40 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.105208:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a400/0x3e357265691e43f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c527 expref: 40 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.105224:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:2.0:1777497768.105228:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.105231:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a400, rc 0) 00000100:00100000:2.0:1777497768.105286:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+40:72815:x1863837546374400:12345-192.168.202.4@tcp:101:touch.0 Request processed in 239us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.105293:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1472 00000100:00100000:1.0:1777497768.109143:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.109329:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546374528 00000100:00100000:2.0:1777497768.109338:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546374528 00000100:00100000:2.0:1777497768.109404:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5911 00000100:00100000:2.0:1777497768.109414:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+8:2414:x1863837546374528:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1777497768.109609:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+9:2414:x1863837546374528:12345-192.168.202.4@tcp:2:touch.0 Request processed in 197us (515us total) trans 4294969463 rc 0/0 00000100:00100000:2.0:1777497768.109617:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5911 00000100:00100000:0.0:1777497768.115627:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.115850:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546374784 00000100:00100000:2.0:1777497768.115860:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546374784 00000100:00100000:2.0:1777497768.115949:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 251 00000100:00100000:2.0:1777497768.115958:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+40:72815:x1863837546374784:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.116288:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+41:72815:x1863837546374784:12345-192.168.202.4@tcp:35:touch.0 Request processed in 331us (669us total) trans 120259084306 rc 0/0 00000100:00100000:2.0:1777497768.116296:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 251 00000100:00100000:1.0:1777497768.122793:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.122879:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546375040 00000100:00100000:3.0:1777497768.122890:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546375040 00000100:00100000:3.0:1777497768.122962:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1473 00000100:00100000:3.0:1777497768.122972:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+41:72815:x1863837546375040:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497768.122999:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497768.123018:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e446 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c52e expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124751:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124773:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124786:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124800:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124808:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.124814:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.125160:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x366:0x0], index 0: 0 00010000:00010000:2.0:1777497768.125283:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e45b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125292:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e45b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125300:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e45b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125348:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125355:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125361:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125367:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125373:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902bc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.125377:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125383:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125394:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.125397:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.125401:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125407:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e44d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.125419:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006a1273bf reply state 00000000b34d1973 transno 120259084307 ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125429:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125441:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff924090680e00) 00010000:00010000:2.0:1777497768.125444:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.125446:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.125491:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e446 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c52e expref: 44 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125506:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e45b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c52e expref: 43 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.125513:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff924090680600) 00010000:00010000:2.0:1777497768.125515:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.125517:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a800, rc 0) 00000100:00100000:2.0:1777497768.125579:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+44:72815:x1863837546375040:12345-192.168.202.4@tcp:101:touch.0 Request processed in 2609us (2795us total) trans 120259084307 rc 0/0 00000100:00100000:2.0:1777497768.125588:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1473 00000100:00100000:1.0:1777497768.138212:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.138339:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546375296 00000100:00100000:3.0:1777497768.138348:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546375296 00000100:00100000:3.0:1777497768.138410:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1474 00000100:00100000:3.0:1777497768.138420:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+44:72815:x1863837546375296:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.138476:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.138503:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e45b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c52e expref: 44 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.138521:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff924090680600) 00010000:00010000:3.0:1777497768.138529:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.138578:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.138590:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.138599:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.138694:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000244f6ea7 reply state 0000000086d42207 transno 120259084308 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.138705:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.138724:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:3.0:1777497768.138726:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.138728:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.138804:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+45:72815:x1863837546375296:12345-192.168.202.4@tcp:36:touch.0 Request processed in 387us (600us total) trans 120259084308 rc 0/0 00000100:00100000:3.0:1777497768.138811:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1474 00000100:00100000:0.0:1777497768.141364:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.141474:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546375424 00000100:00100000:2.0:1777497768.141485:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546375424 00000100:00100000:2.0:1777497768.141542:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1475 00000100:00100000:2.0:1777497768.141552:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+45:72815:x1863837546375424:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.141575:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.141592:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e470 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c535 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.141642:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e470 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c535 expref: 46 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.141657:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902bc00/0x3e357265691e470 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xa:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c535 expref: 46 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.141689:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:2.0:1777497768.141692:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.141696:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902bc00, rc 0) 00000100:00100000:2.0:1777497768.141754:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+46:72815:x1863837546375424:12345-192.168.202.4@tcp:101:touch.0 Request processed in 204us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.141761:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1475 00000100:00100000:1.0:1777497768.146401:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.146501:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546375552 00000100:00100000:0.0:1777497768.146512:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546375552 00000100:00100000:0.0:1777497768.146571:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5912 00000100:00100000:0.0:1777497768.146580:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+9:2415:x1863837546375552:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.146788:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+10:2415:x1863837546375552:12345-192.168.202.4@tcp:2:touch.0 Request processed in 208us (396us total) trans 4294969464 rc 0/0 00000100:00100000:0.0:1777497768.146796:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5912 00000100:00100000:3.0:1777497768.154748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.154861:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546375808 00000100:00100000:2.0:1777497768.154872:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546375808 00000100:00100000:2.0:1777497768.154935:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:2.0:1777497768.154945:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+46:72815:x1863837546375808:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.155268:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c5a4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+47:72815:x1863837546375808:12345-192.168.202.4@tcp:35:touch.0 Request processed in 324us (531us total) trans 120259084309 rc 0/0 00000100:00100000:2.0:1777497768.155276:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 252 00000100:00100000:1.0:1777497768.157776:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.157878:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546376064 00000100:00100000:0.0:1777497768.157887:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546376064 00000100:00100000:0.0:1777497768.157949:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1476 00000100:00100000:0.0:1777497768.157960:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+47:72815:x1863837546376064:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.157982:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.158016:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e477 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c53c expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158171:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158187:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158199:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158212:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158219:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158225:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.158494:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x367:0x0], index 0: 0 00010000:00010000:0.0:1777497768.158622:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e48c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158631:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e48c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158639:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e48c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158668:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158685:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158692:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158698:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.158702:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158710:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158720:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.158723:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.158727:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158733:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e47e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.158745:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000c72075d reply state 00000000b709630f transno 120259084310 ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158756:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158762:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff924093e6e300) 00010000:00010000:0.0:1777497768.158764:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.158766:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.158794:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e477 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c53c expref: 50 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158814:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e48c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c53c expref: 49 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.158821:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff924093e6e200) 00010000:00010000:0.0:1777497768.158823:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.158825:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078400, rc 0) 00000100:00100000:0.0:1777497768.158897:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+50:72815:x1863837546376064:12345-192.168.202.4@tcp:101:touch.0 Request processed in 939us (1130us total) trans 120259084310 rc 0/0 00000100:00100000:0.0:1777497768.158905:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1476 00000100:00100000:2.0:1777497768.163482:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.163719:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546376320 00000100:00100000:3.0:1777497768.163729:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546376320 00000100:00100000:3.0:1777497768.163789:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1477 00000100:00100000:3.0:1777497768.163800:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+50:72815:x1863837546376320:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.163863:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.163890:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e48c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c53c expref: 50 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.163909:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff924093e6e200) 00010000:00010000:3.0:1777497768.163922:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.163973:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.163986:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.163996:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.164144:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000058bc334a reply state 000000007467e570 transno 120259084311 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.164174:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.164181:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:3.0:1777497768.164183:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.164186:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.164271:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+51:72815:x1863837546376320:12345-192.168.202.4@tcp:36:touch.0 Request processed in 473us (811us total) trans 120259084311 rc 0/0 00000100:00100000:3.0:1777497768.164279:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1477 00000100:00100000:3.0:1777497768.172057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.172180:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546376448 00000100:00100000:2.0:1777497768.172191:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546376448 00000100:00100000:2.0:1777497768.172251:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1478 00000100:00100000:2.0:1777497768.172261:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:72815:x1863837546376448:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.172287:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.172305:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b000/0x3e357265691e4a1 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c543 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.172365:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b000/0x3e357265691e4a1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c543 expref: 52 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.172400:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b000/0x3e357265691e4a1 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c543 expref: 52 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.172418:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:2.0:1777497768.172421:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.172425:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902b000, rc 0) 00000100:00100000:2.0:1777497768.172509:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+52:72815:x1863837546376448:12345-192.168.202.4@tcp:101:touch.0 Request processed in 249us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.172516:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1478 00000100:00100000:2.0:1777497768.177965:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.178131:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546376576 00000100:00100000:1.0:1777497768.178141:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546376576 00000100:00100000:1.0:1777497768.178200:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5913 00000100:00100000:1.0:1777497768.178211:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+10:2414:x1863837546376576:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:1.0:1777497768.178437:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546376576:12345-192.168.202.4@tcp:2:touch.0 Request processed in 227us (480us total) trans 4294969465 rc 0/0 00000100:00100000:1.0:1777497768.178460:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5913 00000100:00100000:3.0:1777497768.183276:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.183361:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546376832 00000100:00100000:2.0:1777497768.183373:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546376832 00000100:00100000:2.0:1777497768.183441:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 253 00000100:00100000:2.0:1777497768.183452:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+52:72815:x1863837546376832:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.183920:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+53:72815:x1863837546376832:12345-192.168.202.4@tcp:35:touch.0 Request processed in 467us (650us total) trans 120259084312 rc 0/0 00000100:00100000:2.0:1777497768.183928:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 253 00000100:00100000:3.0:1777497768.195976:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.196153:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546377088 00000100:00100000:0.0:1777497768.196163:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546377088 00000100:00100000:0.0:1777497768.196482:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1479 00000100:00100000:0.0:1777497768.196493:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+53:72815:x1863837546377088:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.196529:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.196551:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e4a8 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c54a expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196655:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196672:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196684:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196699:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196722:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.196729:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.197014:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x368:0x0], index 0: 0 00010000:00010000:0.0:1777497768.197199:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e4bd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197210:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e4bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197217:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e4bd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197255:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197263:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197270:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197276:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.197281:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197290:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197470:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.197473:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.197479:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197485:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4af lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.197499:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000043b5a5a1 reply state 00000000ea3910d5 transno 120259084313 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197511:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197517:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff924093e6ee00) 00010000:00010000:0.0:1777497768.197519:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.197521:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.197552:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e4a8 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c54a expref: 56 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197566:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e4bd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c54a expref: 55 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.197571:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:0.0:1777497768.197573:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.197575:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079200, rc 0) 00000100:00100000:0.0:1777497768.197652:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+56:72815:x1863837546377088:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1161us (1686us total) trans 120259084313 rc 0/0 00000100:00100000:0.0:1777497768.197659:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1479 00000100:00100000:1.0:1777497768.208654:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.208739:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546377344 00000100:00100000:3.0:1777497768.208750:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546377344 00000100:00100000:3.0:1777497768.208816:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1480 00000100:00100000:3.0:1777497768.208826:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+56:72815:x1863837546377344:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.208912:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.208938:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e4bd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c54a expref: 56 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.208961:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:3.0:1777497768.208974:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.209023:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.209047:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.209066:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.209305:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000cfd616a6 reply state 000000009d432e05 transno 120259084314 ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.209316:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.209322:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:3.0:1777497768.209325:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.209328:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.209425:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+57:72815:x1863837546377344:12345-192.168.202.4@tcp:36:touch.0 Request processed in 600us (780us total) trans 120259084314 rc 0/0 00000100:00100000:3.0:1777497768.209432:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1480 00000100:00100000:3.0:1777497768.218233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.218372:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546377472 00000100:00100000:2.0:1777497768.218382:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546377472 00000100:00100000:2.0:1777497768.218442:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1481 00000100:00100000:2.0:1777497768.218453:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+57:72815:x1863837546377472:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.218479:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.218500:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a200/0x3e357265691e4d2 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c551 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.218578:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a200/0x3e357265691e4d2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c551 expref: 58 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.218593:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a200/0x3e357265691e4d2 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xc:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c551 expref: 58 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.218612:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:2.0:1777497768.218615:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.218619:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a200, rc 0) 00000100:00100000:2.0:1777497768.218688:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+58:72815:x1863837546377472:12345-192.168.202.4@tcp:101:touch.0 Request processed in 237us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.218695:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1481 00000100:00100000:1.0:1777497768.225210:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.225318:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546377600 00000100:00100000:0.0:1777497768.225329:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546377600 00000100:00100000:0.0:1777497768.225392:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5914 00000100:00100000:0.0:1777497768.225403:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546377600:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.225624:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+12:2414:x1863837546377600:12345-192.168.202.4@tcp:2:touch.0 Request processed in 222us (423us total) trans 4294969466 rc 0/0 00000100:00100000:0.0:1777497768.225632:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5914 00000100:00100000:3.0:1777497768.234795:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.235193:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546377856 00000100:00100000:0.0:1777497768.235204:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546377856 00000100:00100000:0.0:1777497768.235265:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 254 00000100:00100000:0.0:1777497768.235275:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+58:72815:x1863837546377856:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1777497768.235563:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+59:72815:x1863837546377856:12345-192.168.202.4@tcp:35:touch.0 Request processed in 289us (777us total) trans 120259084315 rc 0/0 00000100:00100000:0.0:1777497768.235571:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 254 00000100:00100000:2.0:1777497768.248529:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.248721:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546378112 00000100:00100000:0.0:1777497768.248732:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546378112 00000100:00100000:0.0:1777497768.248799:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1482 00000100:00100000:0.0:1777497768.248810:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+59:72815:x1863837546378112:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.248847:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.248869:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e4d9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c558 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.248992:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249008:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249046:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249061:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249069:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249075:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.249456:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x369:0x0], index 0: 0 00010000:00010000:0.0:1777497768.249582:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e4ee lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249591:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e4ee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249598:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e4ee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249631:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249638:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249644:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249650:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249662:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.249666:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249672:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249683:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.249686:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.249690:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249696:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e4e0 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.249709:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dd7d8ee6 reply state 00000000f1548c09 transno 120259084316 ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249719:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249724:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff924093e6e400) 00010000:00010000:0.0:1777497768.249727:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.249729:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.249756:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e4d9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c558 expref: 62 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249770:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e4ee lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c558 expref: 61 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.249789:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e600) 00010000:00010000:0.0:1777497768.249791:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.249794:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078e00, rc 0) 00000100:00100000:0.0:1777497768.249864:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408a0ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+62:72815:x1863837546378112:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1056us (1344us total) trans 120259084316 rc 0/0 00000100:00100000:0.0:1777497768.249871:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1482 00000100:00100000:3.0:1777497768.252927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.253058:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546378368 00000100:00100000:0.0:1777497768.253069:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546378368 00000100:00100000:0.0:1777497768.253141:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1483 00000100:00100000:0.0:1777497768.253150:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+62:72815:x1863837546378368:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.253223:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.253244:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e4ee lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c558 expref: 62 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.253263:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e600) 00010000:00010000:0.0:1777497768.253274:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.253318:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.253330:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.253339:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.253558:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a72a798f reply state 000000005d5dcbce transno 120259084317 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.253580:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.253587:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:0.0:1777497768.253590:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.253592:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.253716:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+63:72815:x1863837546378368:12345-192.168.202.4@tcp:36:touch.0 Request processed in 566us (798us total) trans 120259084317 rc 0/0 00000100:00100000:0.0:1777497768.253723:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1483 00000100:00100000:3.0:1777497768.271977:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.272344:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546378496 00000100:00100000:2.0:1777497768.272356:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546378496 00000100:00100000:2.0:1777497768.272417:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1484 00000100:00100000:2.0:1777497768.272426:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+63:72815:x1863837546378496:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.272451:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.272471:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e503 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c55f expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.272524:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e503 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c55f expref: 64 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.272539:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902a800/0x3e357265691e503 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c55f expref: 64 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.272574:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:2.0:1777497768.272577:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.272580:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92409902a800, rc 0) 00000100:00100000:2.0:1777497768.272641:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+64:72815:x1863837546378496:12345-192.168.202.4@tcp:101:touch.0 Request processed in 216us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.272647:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1484 00000100:00100000:3.0:1777497768.276587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.276661:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546378624 00000100:00100000:0.0:1777497768.276671:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546378624 00000100:00100000:0.0:1777497768.276744:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5915 00000100:00100000:0.0:1777497768.276754:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+12:2414:x1863837546378624:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.276976:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+13:2414:x1863837546378624:12345-192.168.202.4@tcp:2:touch.0 Request processed in 223us (398us total) trans 4294969467 rc 0/0 00000100:00100000:0.0:1777497768.276984:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5915 00000100:00100000:3.0:1777497768.280861:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.281510:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546378880 00000100:00100000:2.0:1777497768.281521:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546378880 00000100:00100000:2.0:1777497768.281583:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:2.0:1777497768.281593:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+64:72815:x1863837546378880:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.282198:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+65:72815:x1863837546378880:12345-192.168.202.4@tcp:35:touch.0 Request processed in 499us (1240us total) trans 120259084318 rc 0/0 00000100:00100000:2.0:1777497768.282208:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 255 00000100:00100000:3.0:1777497768.286787:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.292388:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546379136 00000100:00100000:0.0:1777497768.292407:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546379136 00000100:00100000:0.0:1777497768.292484:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1485 00000100:00100000:0.0:1777497768.292495:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+65:72815:x1863837546379136:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.292521:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.292541:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e50a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c566 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292649:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292685:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292698:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292713:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292720:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.292725:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.293043:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36a:0x0], index 0: 0 00010000:00010000:0.0:1777497768.293218:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e51f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293228:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e51f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293235:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e51f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293270:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293277:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293282:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293296:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293303:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.293306:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293313:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293323:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.293327:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.293333:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293339:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e511 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.293352:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000035f00c54 reply state 00000000d27481c7 transno 120259084319 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293362:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293368:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff924093e6e600) 00010000:00010000:0.0:1777497768.293371:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.293373:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.293402:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e50a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c566 expref: 68 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293416:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e51f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c566 expref: 67 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.293429:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497768.293432:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.293434:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079600, rc 0) 00000100:00100000:0.0:1777497768.293510:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+68:72815:x1863837546379136:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1016us (6733us total) trans 120259084319 rc 0/0 00000100:00100000:0.0:1777497768.293519:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1485 00000100:00100000:3.0:1777497768.299078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.299352:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546379392 00000100:00100000:2.0:1777497768.299362:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546379392 00000100:00100000:2.0:1777497768.299669:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1486 00000100:00100000:2.0:1777497768.299762:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+68:72815:x1863837546379392:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:2.0:1777497768.299823:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497768.299851:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e51f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c566 expref: 68 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.299872:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924093e6e700) 00010000:00010000:2.0:1777497768.299886:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497768.299940:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.299969:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.299979:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.300090:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001f0824a8 reply state 00000000f49c5877 transno 120259084320 ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.300126:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.300133:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:2.0:1777497768.300135:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.300139:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497768.300302:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+69:72815:x1863837546379392:12345-192.168.202.4@tcp:36:touch.0 Request processed in 544us (1233us total) trans 120259084320 rc 0/0 00000100:00100000:2.0:1777497768.300309:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1486 00000100:00100000:3.0:1777497768.306003:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.307161:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546379520 00000100:00100000:2.0:1777497768.307174:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546379520 00000100:00100000:2.0:1777497768.307238:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1487 00000100:00100000:2.0:1777497768.307250:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+69:72815:x1863837546379520:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.307275:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.307296:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691e534 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c56d expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.307351:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691e534 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c56d expref: 70 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.307667:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8800/0x3e357265691e534 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c56d expref: 70 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.307757:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:2.0:1777497768.307761:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.307764:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8800, rc 0) 00000100:00100000:2.0:1777497768.307874:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+70:72815:x1863837546379520:12345-192.168.202.4@tcp:101:touch.0 Request processed in 626us (1894us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.307883:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1487 00000100:00100000:3.0:1777497768.315870:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.316243:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546379648 00000100:00100000:1.0:1777497768.316254:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546379648 00000100:00100000:1.0:1777497768.316314:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5916 00000100:00100000:1.0:1777497768.316324:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+13:2414:x1863837546379648:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:1.0:1777497768.316526:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+14:2414:x1863837546379648:12345-192.168.202.4@tcp:2:touch.0 Request processed in 203us (665us total) trans 4294969468 rc 0/0 00000100:00100000:1.0:1777497768.316534:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5916 00000100:00100000:3.0:1777497768.319234:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.319410:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546379904 00000100:00100000:1.0:1777497768.319419:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546379904 00000100:00100000:1.0:1777497768.319527:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 256 00000100:00100000:1.0:1777497768.319538:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+70:72815:x1863837546379904:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.319823:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+71:72815:x1863837546379904:12345-192.168.202.4@tcp:35:touch.0 Request processed in 287us (596us total) trans 120259084321 rc 0/0 00000100:00100000:1.0:1777497768.319831:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 256 00000100:00100000:3.0:1777497768.323373:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.323481:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546380160 00000100:00100000:0.0:1777497768.323501:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546380160 00000100:00100000:0.0:1777497768.323565:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1488 00000100:00100000:0.0:1777497768.323575:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+71:72815:x1863837546380160:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.323598:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.323617:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e53b lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c574 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323711:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323727:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323740:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323753:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323760:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.323783:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.324056:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36b:0x0], index 0: 0 00010000:00010000:0.0:1777497768.324221:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e550 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324231:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e550 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324239:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e550 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324269:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324276:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324283:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324290:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324296:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.324300:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324308:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324330:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.324333:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.324338:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324345:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e542 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.324358:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c3fda73c reply state 00000000a75a9317 transno 120259084322 ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324369:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324375:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff924093e6ed00) 00010000:00010000:0.0:1777497768.324378:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.324380:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.324407:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e53b lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c574 expref: 74 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324420:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e550 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c574 expref: 73 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.324427:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924093e6e100) 00010000:00010000:0.0:1777497768.324429:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.324431:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078a00, rc 0) 00000100:00100000:0.0:1777497768.324821:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+74:72815:x1863837546380160:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1247us (1455us total) trans 120259084322 rc 0/0 00000100:00100000:0.0:1777497768.324829:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1488 00000100:00100000:3.0:1777497768.328896:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.329668:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546380416 00000100:00100000:2.0:1777497768.329727:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546380416 00000100:00100000:2.0:1777497768.329823:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1489 00000100:00100000:2.0:1777497768.329834:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+74:72815:x1863837546380416:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:2.0:1777497768.329891:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497768.329915:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e550 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c574 expref: 74 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.329934:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924093e6e100) 00010000:00010000:2.0:1777497768.329947:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497768.330009:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.330022:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.330042:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.330166:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ec27ed39 reply state 0000000040affcf7 transno 120259084323 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.330179:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.330186:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:2.0:1777497768.330189:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.330192:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497768.330275:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+75:72815:x1863837546380416:12345-192.168.202.4@tcp:36:touch.0 Request processed in 443us (1387us total) trans 120259084323 rc 0/0 00000100:00100000:2.0:1777497768.330283:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1489 00000100:00100000:3.0:1777497768.333222:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.333355:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546380544 00000100:00100000:2.0:1777497768.333364:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546380544 00000100:00100000:2.0:1777497768.333420:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1490 00000100:00100000:2.0:1777497768.333440:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+75:72815:x1863837546380544:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.333463:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.333482:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691e565 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c57b expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.333551:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691e565 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c57b expref: 76 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.333575:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8e00/0x3e357265691e565 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0xf:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c57b expref: 76 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.333594:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:2.0:1777497768.333610:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.333613:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8e00, rc 0) 00000100:00100000:2.0:1777497768.333676:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+76:72815:x1863837546380544:12345-192.168.202.4@tcp:101:touch.0 Request processed in 238us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.333683:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1490 00000100:00100000:3.0:1777497768.342581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.342673:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546380672 00000100:00100000:2.0:1777497768.342684:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546380672 00000100:00100000:2.0:1777497768.342740:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5917 00000100:00100000:2.0:1777497768.342750:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+14:2414:x1863837546380672:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1777497768.342965:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+15:2414:x1863837546380672:12345-192.168.202.4@tcp:2:touch.0 Request processed in 217us (391us total) trans 4294969469 rc 0/0 00000100:00100000:2.0:1777497768.342974:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5917 00000100:00100000:0.0:1777497768.346583:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.346655:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546380928 00000100:00100000:1.0:1777497768.346667:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546380928 00000100:00100000:1.0:1777497768.346776:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:1.0:1777497768.346788:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+76:72815:x1863837546380928:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.347126:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+77:72815:x1863837546380928:12345-192.168.202.4@tcp:35:touch.0 Request processed in 307us (517us total) trans 120259084324 rc 0/0 00000100:00100000:1.0:1777497768.347135:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 257 00000100:00100000:3.0:1777497768.350262:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.351045:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546381184 00000100:00100000:2.0:1777497768.351057:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546381184 00000100:00100000:2.0:1777497768.351151:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1491 00000100:00100000:2.0:1777497768.351162:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+77:72815:x1863837546381184:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.351186:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.351207:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e56c lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c582 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351301:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351317:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351328:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351360:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351368:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351375:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.351651:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36c:0x0], index 0: 0 00010000:00010000:2.0:1777497768.351795:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e581 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351804:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e581 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351812:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e581 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351847:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351853:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351859:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351865:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.351869:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351887:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351899:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.351902:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.351907:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351914:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e573 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.351927:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000a45e8104 reply state 000000001a27fd66 transno 120259084325 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351938:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351944:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff924090680600) 00010000:00010000:2.0:1777497768.351947:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.351950:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.351979:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e56c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c582 expref: 80 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.351993:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e581 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c582 expref: 79 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.352000:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924090680d00) 00010000:00010000:2.0:1777497768.352003:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.352005:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8600, rc 0) 00000100:00100000:2.0:1777497768.352089:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+80:72815:x1863837546381184:12345-192.168.202.4@tcp:101:touch.0 Request processed in 928us (1836us total) trans 120259084325 rc 0/0 00000100:00100000:2.0:1777497768.352139:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1491 00000100:00100000:3.0:1777497768.356573:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.356807:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546381440 00000100:00100000:0.0:1777497768.356817:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546381440 00000100:00100000:0.0:1777497768.356872:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1492 00000100:00100000:0.0:1777497768.356882:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+80:72815:x1863837546381440:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.356934:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.356958:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e581 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c582 expref: 80 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.356977:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924090680d00) 00010000:00010000:0.0:1777497768.357000:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.357060:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.357074:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.357084:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.357212:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000072b46c5 reply state 000000006ed0cd04 transno 120259084326 ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.357224:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.357230:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:0.0:1777497768.357233:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.357236:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.357326:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+81:72815:x1863837546381440:12345-192.168.202.4@tcp:36:touch.0 Request processed in 444us (762us total) trans 120259084326 rc 0/0 00000100:00100000:0.0:1777497768.357349:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1492 00000100:00100000:3.0:1777497768.360736:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.360895:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546381568 00000100:00100000:2.0:1777497768.360905:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546381568 00000100:00100000:2.0:1777497768.360963:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1493 00000100:00100000:2.0:1777497768.360972:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+81:72815:x1863837546381568:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.361003:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.361035:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691e596 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c589 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.361088:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691e596 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c589 expref: 82 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.361140:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9200/0x3e357265691e596 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c589 expref: 82 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.361157:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:2.0:1777497768.361160:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.361164:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9200, rc 0) 00000100:00100000:2.0:1777497768.361212:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+82:72815:x1863837546381568:12345-192.168.202.4@tcp:101:touch.0 Request processed in 241us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.361218:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1493 00000100:00100000:3.0:1777497768.366043:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.366136:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546381696 00000100:00100000:2.0:1777497768.366146:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546381696 00000100:00100000:2.0:1777497768.366199:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5918 00000100:00100000:2.0:1777497768.366209:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+15:2415:x1863837546381696:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1777497768.366437:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+16:2415:x1863837546381696:12345-192.168.202.4@tcp:2:touch.0 Request processed in 229us (411us total) trans 4294969470 rc 0/0 00000100:00100000:2.0:1777497768.366446:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5918 00000100:00100000:1.0:1777497768.370353:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.370444:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546381952 00000100:00100000:2.0:1777497768.370454:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546381952 00000100:00100000:2.0:1777497768.370500:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 258 00000100:00100000:2.0:1777497768.370510:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+82:72815:x1863837546381952:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.370785:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+83:72815:x1863837546381952:12345-192.168.202.4@tcp:35:touch.0 Request processed in 275us (441us total) trans 120259084327 rc 0/0 00000100:00100000:2.0:1777497768.370793:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 258 00000100:00100000:3.0:1777497768.374829:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.374931:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546382208 00000100:00100000:2.0:1777497768.374941:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546382208 00000100:00100000:2.0:1777497768.375067:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1494 00000100:00100000:2.0:1777497768.375078:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+83:72815:x1863837546382208:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.375139:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.375161:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e59d lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c590 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375259:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375276:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375288:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375303:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375321:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375329:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.375808:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36d:0x0], index 0: 0 00010000:00010000:2.0:1777497768.375935:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e5b2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375946:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e5b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375956:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e5b2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375986:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.375994:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376001:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376007:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.376011:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376019:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376055:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.376058:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.376063:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376069:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5a4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.376083:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008f6adcc0 reply state 000000003c29591c transno 120259084328 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376135:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376143:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff924090680800) 00010000:00010000:2.0:1777497768.376145:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.376148:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.376178:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e59d lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c590 expref: 86 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376194:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e5b2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c590 expref: 85 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.376201:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497768.376204:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.376206:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8a00, rc 0) 00000100:00100000:2.0:1777497768.376281:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+86:72815:x1863837546382208:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1204us (1461us total) trans 120259084328 rc 0/0 00000100:00100000:2.0:1777497768.376289:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1494 00000100:00100000:3.0:1777497768.379994:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.380748:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546382464 00000100:00100000:0.0:1777497768.380759:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546382464 00000100:00100000:0.0:1777497768.380820:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1495 00000100:00100000:0.0:1777497768.380831:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+86:72815:x1863837546382464:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.380887:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.380912:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e5b2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c590 expref: 86 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.380931:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924090680f00) 00010000:00010000:0.0:1777497768.380941:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.381010:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.381031:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.381042:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.381165:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c127b7d0 reply state 0000000093ae4569 transno 120259084329 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.381177:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.381183:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:0.0:1777497768.381185:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.381202:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.381287:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+87:72815:x1863837546382464:12345-192.168.202.4@tcp:36:touch.0 Request processed in 458us (1313us total) trans 120259084329 rc 0/0 00000100:00100000:0.0:1777497768.381294:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1495 00000100:00100000:3.0:1777497768.383934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.384396:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546382592 00000100:00100000:2.0:1777497768.384406:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546382592 00000100:00100000:2.0:1777497768.384461:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1496 00000100:00100000:2.0:1777497768.384471:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+87:72815:x1863837546382592:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.384495:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.384515:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691e5c7 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c597 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.384571:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691e5c7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c597 expref: 88 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.384587:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9a00/0x3e357265691e5c7 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x11:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c597 expref: 88 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.384605:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:2.0:1777497768.384608:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.384612:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9a00, rc 0) 00000100:00100000:2.0:1777497768.384685:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+88:72815:x1863837546382592:12345-192.168.202.4@tcp:101:touch.0 Request processed in 215us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.384692:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1496 00000100:00100000:2.0:1777497768.388190:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.388273:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546382720 00000100:00100000:0.0:1777497768.388283:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546382720 00000100:00100000:0.0:1777497768.388341:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5919 00000100:00100000:0.0:1777497768.388352:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+16:2414:x1863837546382720:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.388558:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+17:2414:x1863837546382720:12345-192.168.202.4@tcp:2:touch.0 Request processed in 208us (377us total) trans 4294969471 rc 0/0 00000100:00100000:0.0:1777497768.388565:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5919 00000100:00100000:0.0:1777497768.392341:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.392436:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546382976 00000100:00100000:1.0:1777497768.392447:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546382976 00000100:00100000:1.0:1777497768.392501:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 259 00000100:00100000:1.0:1777497768.392511:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+88:72815:x1863837546382976:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.392817:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+89:72815:x1863837546382976:12345-192.168.202.4@tcp:35:touch.0 Request processed in 307us (483us total) trans 120259084330 rc 0/0 00000100:00100000:1.0:1777497768.392825:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 259 00000100:00100000:3.0:1777497768.396730:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.396899:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546383232 00000100:00100000:0.0:1777497768.396908:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546383232 00000100:00100000:0.0:1777497768.396964:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1497 00000100:00100000:0.0:1777497768.396973:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+89:72815:x1863837546383232:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.397005:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.397032:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e5ce lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c59e expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397148:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397165:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397177:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397206:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397212:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397219:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1777497768.397480:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36e:0x0], index 0: 0 00010000:00010000:0.0:1777497768.397592:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e5e3 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397600:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e5e3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397607:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e5e3 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397636:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397643:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397650:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397656:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.397661:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497768.397671:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398084:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398125:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497768.398129:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497768.398134:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398140:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e5d5 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.398154:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000633c0e99 reply state 0000000013ba2a19 transno 120259084331 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398164:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398169:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff924093e6e100) 00010000:00010000:0.0:1777497768.398171:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.398173:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.398212:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e5ce lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c59e expref: 92 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398225:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e5e3 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c59e expref: 91 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.398232:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497768.398234:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.398245:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079600, rc 0) 00000100:00100000:0.0:1777497768.398317:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+92:72815:x1863837546383232:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1345us (1596us total) trans 120259084331 rc 0/0 00000100:00100000:0.0:1777497768.398325:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1497 00000100:00100000:3.0:1777497768.403244:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.403476:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546383488 00000100:00100000:2.0:1777497768.403487:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546383488 00000100:00100000:2.0:1777497768.403538:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1498 00000100:00100000:2.0:1777497768.403548:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+92:72815:x1863837546383488:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:2.0:1777497768.403634:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497768.403666:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e5e3 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c59e expref: 92 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.403806:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924093e6e700) 00010000:00010000:2.0:1777497768.403822:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497768.403883:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.403896:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.403905:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.404016:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ffb76aac reply state 00000000b6c5ab38 transno 120259084332 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.404044:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.404051:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:2.0:1777497768.404053:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.404056:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.404556:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+93:72815:x1863837546383488:12345-192.168.202.4@tcp:36:touch.0 Request processed in 1005us (1317us total) trans 120259084332 rc 0/0 00000100:00100000:3.0:1777497768.404564:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1498 00000100:00100000:3.0:1777497768.407891:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.407977:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546383616 00000100:00100000:2.0:1777497768.407998:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546383616 00000100:00100000:2.0:1777497768.408067:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1499 00000100:00100000:2.0:1777497768.408077:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+93:72815:x1863837546383616:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.408146:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.408168:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5f8 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5a5 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.408227:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5f8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5a5 expref: 94 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.408259:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9400/0x3e357265691e5f8 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x12:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5a5 expref: 94 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.408280:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:2.0:1777497768.408282:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.408286:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9400, rc 0) 00000100:00100000:2.0:1777497768.408333:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+94:72815:x1863837546383616:12345-192.168.202.4@tcp:101:touch.0 Request processed in 258us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.408340:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1499 00000100:00100000:1.0:1777497768.412440:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.412585:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546383744 00000100:00100000:0.0:1777497768.412595:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546383744 00000100:00100000:0.0:1777497768.412653:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5920 00000100:00100000:0.0:1777497768.412663:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+17:2415:x1863837546383744:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.412884:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+18:2415:x1863837546383744:12345-192.168.202.4@tcp:2:touch.0 Request processed in 222us (452us total) trans 4294969472 rc 0/0 00000100:00100000:0.0:1777497768.412892:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5920 00000100:00100000:3.0:1777497768.416427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.416955:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546384000 00000100:00100000:0.0:1777497768.416966:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546384000 00000100:00100000:0.0:1777497768.417041:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 260 00000100:00100000:0.0:1777497768.417052:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+94:72815:x1863837546384000:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1777497768.417369:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+95:72815:x1863837546384000:12345-192.168.202.4@tcp:35:touch.0 Request processed in 318us (950us total) trans 120259084333 rc 0/0 00000100:00100000:0.0:1777497768.417378:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 260 00000100:00100000:3.0:1777497768.421454:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.421563:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546384256 00000100:00100000:2.0:1777497768.421574:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546384256 00000100:00100000:2.0:1777497768.421635:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1500 00000100:00100000:2.0:1777497768.421646:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+95:72815:x1863837546384256:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.421672:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.421691:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e5ff lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5ac expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421793:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421809:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421822:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421836:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421858:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.421865:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.422237:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x36f:0x0], index 0: 0 00010000:00010000:2.0:1777497768.422360:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e614 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422370:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e614 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422378:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e614 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422409:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422416:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422423:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422430:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.422435:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422442:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422467:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.422470:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.422476:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422482:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e606 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.422496:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000042c4ec3b reply state 00000000a9d440c7 transno 120259084334 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422506:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422513:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff924090680700) 00010000:00010000:2.0:1777497768.422515:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.422518:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.422548:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e5ff lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ac expref: 98 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422562:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e614 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ac expref: 97 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.422570:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff924090680900) 00010000:00010000:2.0:1777497768.422572:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.422574:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9c00, rc 0) 00000100:00100000:2.0:1777497768.422646:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+98:72815:x1863837546384256:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1002us (1200us total) trans 120259084334 rc 0/0 00000100:00100000:2.0:1777497768.422653:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1500 00000100:00100000:3.0:1777497768.426552:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.426892:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546384512 00000100:00100000:1.0:1777497768.426905:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546384512 00000100:00100000:1.0:1777497768.427085:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1501 00000100:00100000:1.0:1777497768.427139:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+98:72815:x1863837546384512:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:1.0:1777497768.427230:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497768.427260:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e614 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ac expref: 98 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.427280:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff924090680900) 00010000:00010000:1.0:1777497768.427292:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497768.427349:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.427362:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.427373:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497768.427498:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009c224a51 reply state 00000000c7b7d38d transno 120259084335 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.427517:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.427523:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:1.0:1777497768.427525:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497768.427527:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497768.427632:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+99:72815:x1863837546384512:12345-192.168.202.4@tcp:36:touch.0 Request processed in 538us (1089us total) trans 120259084335 rc 0/0 00000100:00100000:1.0:1777497768.427639:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1501 00000100:00100000:3.0:1777497768.432000:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.432174:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546384640 00000100:00100000:0.0:1777497768.432185:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546384640 00000100:00100000:0.0:1777497768.432243:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1502 00000100:00100000:0.0:1777497768.432252:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+99:72815:x1863837546384640:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.432275:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.432293:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e629 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5b3 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.432364:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e629 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5b3 expref: 100 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.432379:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078a00/0x3e357265691e629 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x13:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5b3 expref: 100 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.432488:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:0.0:1777497768.432491:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497768.432495:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078a00, rc 0) 00000100:00100000:0.0:1777497768.432623:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+100:72815:x1863837546384640:12345-192.168.202.4@tcp:101:touch.0 Request processed in 372us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497768.432631:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1502 00000100:00100000:0.0:1777497768.436403:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.436678:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546384768 00000100:00100000:3.0:1777497768.436689:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546384768 00000100:00100000:3.0:1777497768.436773:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5921 00000100:00100000:3.0:1777497768.436783:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+18:2415:x1863837546384768:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:3.0:1777497768.436982:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+19:2415:x1863837546384768:12345-192.168.202.4@tcp:2:touch.0 Request processed in 199us (599us total) trans 4294969473 rc 0/0 00000100:00100000:3.0:1777497768.436998:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5921 00000100:00100000:3.0:1777497768.439846:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.440292:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546385024 00000100:00100000:2.0:1777497768.440302:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546385024 00000100:00100000:2.0:1777497768.440353:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 261 00000100:00100000:2.0:1777497768.440363:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+100:72815:x1863837546385024:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:2.0:1777497768.440650:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+101:72815:x1863837546385024:12345-192.168.202.4@tcp:35:touch.0 Request processed in 287us (810us total) trans 120259084336 rc 0/0 00000100:00100000:2.0:1777497768.440659:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 261 00000100:00100000:2.0:1777497768.445017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.445180:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546385280 00000100:00100000:3.0:1777497768.445190:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546385280 00000100:00100000:3.0:1777497768.445247:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1503 00000100:00100000:3.0:1777497768.445257:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+101:72815:x1863837546385280:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497768.445284:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497768.445307:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e630 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5ba expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445416:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445433:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445445:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445460:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445467:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445475:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497768.445755:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x370:0x0], index 0: 0 00010000:00010000:3.0:1777497768.445878:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e645 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445887:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e645 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445909:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e645 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445941:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445949:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445956:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445961:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497768.445965:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445971:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.445996:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497768.445999:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497768.446004:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.446009:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e637 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.446032:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000006f5cd901 reply state 000000008e430201 transno 120259084337 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.446042:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.446055:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9240a6e49400) 00010000:00010000:3.0:1777497768.446057:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.446060:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1777497768.446091:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e630 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ba expref: 104 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.446312:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e645 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ba expref: 103 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.446320:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9240a6e49f00) 00010000:00010000:3.0:1777497768.446322:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497768.446324:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ff400, rc 0) 00000100:00100000:3.0:1777497768.446510:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+104:72815:x1863837546385280:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1254us (1501us total) trans 120259084337 rc 0/0 00000100:00100000:3.0:1777497768.446519:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1503 00000100:00100000:3.0:1777497768.452057:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.452174:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546385536 00000100:00100000:0.0:1777497768.452183:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546385536 00000100:00100000:0.0:1777497768.452242:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1504 00000100:00100000:0.0:1777497768.452252:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+104:72815:x1863837546385536:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.452306:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.452331:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e645 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5ba expref: 104 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.452348:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff9240a6e49f00) 00010000:00010000:0.0:1777497768.452359:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.452406:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.452438:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.452449:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.452562:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000009707e631 reply state 000000002f9610ef transno 120259084338 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.452573:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.452579:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:0.0:1777497768.452582:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.452584:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.452670:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+105:72815:x1863837546385536:12345-192.168.202.4@tcp:36:touch.0 Request processed in 418us (621us total) trans 120259084338 rc 0/0 00000100:00100000:0.0:1777497768.452686:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1504 00000100:00100000:1.0:1777497768.456757:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.456873:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546385664 00000100:00100000:0.0:1777497768.456885:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546385664 00000100:00100000:0.0:1777497768.456947:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1505 00000100:00100000:0.0:1777497768.456957:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+105:72815:x1863837546385664:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.456993:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.457014:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e65a lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5c1 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.457078:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e65a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5c1 expref: 106 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.457148:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078400/0x3e357265691e65a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x14:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5c1 expref: 106 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.457167:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:0.0:1777497768.457170:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497768.457173:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078400, rc 0) 00000100:00100000:0.0:1777497768.457229:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+106:72815:x1863837546385664:12345-192.168.202.4@tcp:101:touch.0 Request processed in 274us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497768.457236:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1505 00000100:00100000:2.0:1777497768.461239:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.461885:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546385792 00000100:00100000:0.0:1777497768.461896:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546385792 00000100:00100000:0.0:1777497768.462010:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5922 00000100:00100000:0.0:1777497768.462020:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+19:2415:x1863837546385792:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.462262:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+20:2415:x1863837546385792:12345-192.168.202.4@tcp:2:touch.0 Request processed in 243us (1032us total) trans 4294969474 rc 0/0 00000100:00100000:0.0:1777497768.462270:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5922 00000100:00100000:3.0:1777497768.465661:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.465767:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546386048 00000100:00100000:1.0:1777497768.465780:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546386048 00000100:00100000:1.0:1777497768.465866:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 262 00000100:00100000:1.0:1777497768.465877:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+106:72815:x1863837546386048:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.466298:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+107:72815:x1863837546386048:12345-192.168.202.4@tcp:35:touch.0 Request processed in 422us (645us total) trans 120259084339 rc 0/0 00000100:00100000:1.0:1777497768.466306:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 262 00000100:00100000:3.0:1777497768.469871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.469946:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546386304 00000100:00100000:2.0:1777497768.469955:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546386304 00000100:00100000:2.0:1777497768.470015:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1506 00000100:00100000:2.0:1777497768.470032:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+107:72815:x1863837546386304:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.470057:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.470080:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691e661 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5c8 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470206:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470222:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470234:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470248:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470275:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470282:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.470611:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x371:0x0], index 0: 0 00010000:00010000:2.0:1777497768.470740:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e676 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470750:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e676 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470758:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e676 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470790:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470797:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470802:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470807:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.470811:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470818:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470838:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.470841:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.470845:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470850:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e668 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.470862:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000098feafbb reply state 000000002ae78ea0 transno 120259084340 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470872:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470877:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff924090680b00) 00010000:00010000:2.0:1777497768.470879:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.470882:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.470910:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691e661 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5c8 expref: 110 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470923:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e676 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5c8 expref: 109 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.470930:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924090680500) 00010000:00010000:2.0:1777497768.470932:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.470934:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00000100:00100000:2.0:1777497768.471010:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+110:72815:x1863837546386304:12345-192.168.202.4@tcp:101:touch.0 Request processed in 986us (1146us total) trans 120259084340 rc 0/0 00000100:00100000:2.0:1777497768.471018:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1506 00000100:00100000:3.0:1777497768.476224:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.476350:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546386560 00000100:00100000:0.0:1777497768.476360:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546386560 00000100:00100000:0.0:1777497768.476416:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1507 00000100:00100000:0.0:1777497768.476425:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+110:72815:x1863837546386560:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.476481:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.476506:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e676 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5c8 expref: 110 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.476524:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924090680500) 00010000:00010000:0.0:1777497768.476557:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.476610:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.476622:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.476632:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.476742:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000077582cfc reply state 000000005efb3557 transno 120259084341 ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.476754:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.476760:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:0.0:1777497768.476763:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.476765:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.476849:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+111:72815:x1863837546386560:12345-192.168.202.4@tcp:36:touch.0 Request processed in 424us (633us total) trans 120259084341 rc 0/0 00000100:00100000:0.0:1777497768.476856:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1507 00000100:00100000:3.0:1777497768.480198:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.480305:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546386688 00000100:00100000:0.0:1777497768.480316:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546386688 00000100:00100000:0.0:1777497768.480374:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1508 00000100:00100000:0.0:1777497768.480393:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+111:72815:x1863837546386688:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.480418:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.480438:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078000/0x3e357265691e68b lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5cf expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.480494:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078000/0x3e357265691e68b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5cf expref: 112 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.480523:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078000/0x3e357265691e68b lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x15:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5cf expref: 112 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.480555:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:0.0:1777497768.480558:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497768.480562:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078000, rc 0) 00000100:00100000:0.0:1777497768.480629:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+112:72815:x1863837546386688:12345-192.168.202.4@tcp:101:touch.0 Request processed in 246us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497768.480636:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1508 00000100:00100000:3.0:1777497768.485430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.485649:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546386816 00000100:00100000:2.0:1777497768.485661:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546386816 00000100:00100000:2.0:1777497768.485740:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5923 00000100:00100000:2.0:1777497768.485750:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+20:2414:x1863837546386816:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:2.0:1777497768.485956:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+21:2414:x1863837546386816:12345-192.168.202.4@tcp:2:touch.0 Request processed in 208us (535us total) trans 4294969475 rc 0/0 00000100:00100000:2.0:1777497768.485964:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5923 00000100:00100000:2.0:1777497768.491068:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.491264:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546387072 00000100:00100000:1.0:1777497768.491273:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546387072 00000100:00100000:1.0:1777497768.491327:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 263 00000100:00100000:1.0:1777497768.491337:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+112:72815:x1863837546387072:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.491733:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+113:72815:x1863837546387072:12345-192.168.202.4@tcp:35:touch.0 Request processed in 397us (672us total) trans 120259084342 rc 0/0 00000100:00100000:1.0:1777497768.491741:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 263 00000100:00100000:3.0:1777497768.496215:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.496328:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546387328 00000100:00100000:2.0:1777497768.496338:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546387328 00000100:00100000:2.0:1777497768.496410:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1509 00000100:00100000:2.0:1777497768.496421:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+113:72815:x1863837546387328:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.496447:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.496467:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e692 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5d6 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496841:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496856:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496867:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496881:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496887:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.496909:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.497334:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x372:0x0], index 0: 0 00010000:00010000:2.0:1777497768.497473:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e6a7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497483:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e6a7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497490:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e6a7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497521:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497758:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497767:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497773:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.497777:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497784:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497795:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.497798:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.497810:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497817:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e699 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.497831:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c2e62475 reply state 000000002595308a transno 120259084343 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497841:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497848:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff924090680500) 00010000:00010000:2.0:1777497768.497850:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.497853:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.497883:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e692 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5d6 expref: 116 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497897:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e6a7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5d6 expref: 115 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.497904:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924090680900) 00010000:00010000:2.0:1777497768.497907:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.497909:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00000100:00100000:2.0:1777497768.497982:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+116:72815:x1863837546387328:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1563us (1780us total) trans 120259084343 rc 0/0 00000100:00100000:2.0:1777497768.497996:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1509 00000100:00100000:3.0:1777497768.502463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.502573:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546387584 00000100:00100000:0.0:1777497768.502584:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546387584 00000100:00100000:0.0:1777497768.502646:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1510 00000100:00100000:0.0:1777497768.502656:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+116:72815:x1863837546387584:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.502732:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.502757:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e6a7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5d6 expref: 116 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.502775:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924090680900) 00010000:00010000:0.0:1777497768.502785:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.502833:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.502845:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.502855:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.502962:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000002ce9b551 reply state 0000000092e6e678 transno 120259084344 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.502975:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.502989:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497768.502991:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.502994:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.503135:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+117:72815:x1863837546387584:12345-192.168.202.4@tcp:36:touch.0 Request processed in 480us (680us total) trans 120259084344 rc 0/0 00000100:00100000:0.0:1777497768.503143:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1510 00000100:00100000:1.0:1777497768.506359:0:90588:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565069696:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1777497768.506441:0:90588:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497768.506471:0:90588:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a69fff00 going to sleep for 11 seconds 00000100:00100000:3.0:1777497768.506574:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069696 00000100:00100000:3.0:1777497768.506582:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069696 00000100:00100000:3.0:1777497768.506654:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5924 00000100:00100000:3.0:1777497768.506663:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:90588:x1863837565069696:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1777497768.506719:0:25497:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 898 00000100:00100000:3.0:1777497768.508072:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+6:90588:x1863837565069696:12345-0@lo:5:osp-pre-0-0.0 Request processed in 1407us (1628us total) trans 4294969476 rc 0/0 00000100:00100000:3.0:1777497768.508082:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5924 00000100:00080000:1.0:1777497768.508344:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497768.509021:0:90588:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:90588:1863837565069696:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1777497768.509048:0:90588:0:(osp_precreate.c:702:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x372:0x0]-[0x280000401:0x3a1:0x0] 00000100:00100000:3.0:1777497768.509859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.510265:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546387712 00000100:00100000:0.0:1777497768.510275:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546387712 00000100:00100000:0.0:1777497768.510373:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1511 00000100:00100000:0.0:1777497768.510395:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+117:72815:x1863837546387712:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.510419:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.510440:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e6bc lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5dd expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.510499:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e6bc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5dd expref: 118 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.510514:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079600/0x3e357265691e6bc lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x16:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5dd expref: 118 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.510542:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497768.510559:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1777497768.510564:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079600, rc 0) 00000100:00100000:0.0:1777497768.510626:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+118:72815:x1863837546387712:12345-192.168.202.4@tcp:101:touch.0 Request processed in 245us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497768.510633:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1511 00000100:00100000:1.0:1777497768.514726:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.514812:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546387840 00000100:00100000:3.0:1777497768.514821:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546387840 00000100:00100000:3.0:1777497768.514898:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5925 00000100:00100000:3.0:1777497768.514908:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+21:2414:x1863837546387840:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:3.0:1777497768.515203:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546387840:12345-192.168.202.4@tcp:2:touch.0 Request processed in 296us (485us total) trans 4294969477 rc 0/0 00000100:00100000:3.0:1777497768.515212:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5925 00000100:00100000:1.0:1777497768.519368:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.519527:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546388096 00000100:00100000:0.0:1777497768.519614:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546388096 00000100:00100000:0.0:1777497768.519719:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 264 00000100:00100000:0.0:1777497768.519730:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+118:72815:x1863837546388096:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:0.0:1777497768.520265:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+119:72815:x1863837546388096:12345-192.168.202.4@tcp:35:touch.0 Request processed in 535us (905us total) trans 120259084345 rc 0/0 00000100:00100000:0.0:1777497768.520274:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 264 00000100:00100000:2.0:1777497768.526893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.527181:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546388352 00000100:00100000:0.0:1777497768.527193:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546388352 00000100:00100000:0.0:1777497768.527257:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1512 00000100:00100000:0.0:1777497768.527268:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+119:72815:x1863837546388352:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:0.0:1777497768.527295:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497768.527317:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e6c3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5e4 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527427:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527443:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527455:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527481:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527489:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.527496:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.528805:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x373:0x0], index 0: 0 00010000:00010000:2.0:1777497768.528961:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e6d8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529064:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e6d8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529076:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e6d8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529147:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529155:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529161:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529168:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529174:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeec00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.529178:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529185:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529197:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.529201:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.529206:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529229:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e6ca lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.529244:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000000edfb130 reply state 0000000068e259cf transno 120259084346 ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529254:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529259:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff924083cd1500) 00010000:00010000:2.0:1777497768.529262:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.529264:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.529299:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e6c3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5e4 expref: 122 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529314:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e6d8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5e4 expref: 121 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.529322:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497768.529324:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.529326:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8a00, rc 0) 00000100:00100000:2.0:1777497768.529634:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+122:72815:x1863837546388352:12345-192.168.202.4@tcp:101:touch.0 Request processed in 2366us (2751us total) trans 120259084346 rc 0/0 00000100:00100000:2.0:1777497768.529642:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1512 00000100:00100000:1.0:1777497768.534446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.534522:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546388608 00000100:00100000:0.0:1777497768.534543:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546388608 00000100:00100000:0.0:1777497768.534608:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1513 00000100:00100000:0.0:1777497768.534618:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+122:72815:x1863837546388608:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:0.0:1777497768.534685:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497768.534712:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e6d8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5e4 expref: 122 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.534732:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924090680f00) 00010000:00010000:0.0:1777497768.534742:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497768.534796:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.534810:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.534820:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1777497768.534926:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000099674fcf reply state 0000000007ca3c69 transno 120259084347 ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.534954:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.534960:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:0.0:1777497768.534963:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497768.534966:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497768.535068:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+123:72815:x1863837546388608:12345-192.168.202.4@tcp:36:touch.0 Request processed in 452us (631us total) trans 120259084347 rc 0/0 00000100:00100000:0.0:1777497768.535076:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1513 00000100:00100000:1.0:1777497768.538950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.543946:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546388736 00000100:00100000:3.0:1777497768.543962:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546388736 00000100:00100000:2.0:1777497768.544770:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1514 00000100:00100000:2.0:1777497768.544783:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+123:72815:x1863837546388736:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.544809:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.544845:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691e6ed lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5eb expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.544906:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691e6ed lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5eb expref: 124 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.544921:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9800/0x3e357265691e6ed lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x17:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5eb expref: 124 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.544940:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:2.0:1777497768.544943:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.544947:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9800, rc 0) 00000100:00100000:2.0:1777497768.545035:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+124:72815:x1863837546388736:12345-192.168.202.4@tcp:101:touch.0 Request processed in 255us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.545042:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1514 00000100:00100000:0.0:1777497768.548802:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.548884:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546388864 00000100:00100000:3.0:1777497768.548895:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546388864 00000100:00100000:3.0:1777497768.548990:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5926 00000100:00100000:3.0:1777497768.549002:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546388864:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:3.0:1777497768.549240:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+23:2414:x1863837546388864:12345-192.168.202.4@tcp:2:touch.0 Request processed in 240us (447us total) trans 4294969478 rc 0/0 00000100:00100000:3.0:1777497768.549248:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5926 00000100:00100000:3.0:1777497768.552699:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.555318:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546389120 00000100:00100000:1.0:1777497768.555331:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546389120 00000100:00100000:1.0:1777497768.555505:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 265 00000100:00100000:1.0:1777497768.555517:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+124:72815:x1863837546389120:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.555803:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+125:72815:x1863837546389120:12345-192.168.202.4@tcp:35:touch.0 Request processed in 287us (3110us total) trans 120259084348 rc 0/0 00000100:00100000:1.0:1777497768.555811:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 265 00000100:00100000:0.0:1777497768.559844:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.560003:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546389376 00000100:00100000:3.0:1777497768.560014:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546389376 00000100:00100000:3.0:1777497768.560088:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1515 00000100:00100000:3.0:1777497768.560126:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+125:72815:x1863837546389376:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:3.0:1777497768.560172:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497768.560199:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e6f4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5f2 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560313:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560332:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560343:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560357:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560363:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560370:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1777497768.560860:0:73210:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x374:0x0], index 0: 0 00010000:00010000:3.0:1777497768.560983:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e709 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.560993:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e709 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561000:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e709 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561062:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561069:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 2/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561075:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561080:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497768.561085:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561092:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561630:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497768.561633:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497768.561639:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561645:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e6fb lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.561661:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000ab119b0c reply state 000000002c59b776 transno 120259084349 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561672:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.561678:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9240a6e49f00) 00010000:00010000:3.0:1777497768.561687:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.561690:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1777497768.562847:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e6f4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5f2 expref: 128 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.562872:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e709 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5f2 expref: 127 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497768.562880:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49700) 00010000:00010000:0.0:1777497768.562883:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497768.562886:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe400, rc 0) 00000100:00100000:0.0:1777497768.563000:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+128:72815:x1863837546389376:12345-192.168.202.4@tcp:101:touch.0 Request processed in 2875us (3164us total) trans 120259084349 rc 0/0 00000100:00100000:0.0:1777497768.563009:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1515 00000100:00100000:0.0:1777497768.567859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.567945:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546389632 00000100:00100000:3.0:1777497768.567955:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546389632 00000100:00100000:3.0:1777497768.568206:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1516 00000100:00100000:3.0:1777497768.568218:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+128:72815:x1863837546389632:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:3.0:1777497768.568276:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497768.568303:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e709 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5f2 expref: 128 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.568323:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49700) 00010000:00010000:3.0:1777497768.568335:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497768.568396:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.568411:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.568422:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497768.568523:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008a9eae9f reply state 00000000dfa0fa7b transno 120259084350 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.568547:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497768.568554:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:3.0:1777497768.568557:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497768.568559:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497768.568646:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84700e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+129:72815:x1863837546389632:12345-192.168.202.4@tcp:36:touch.0 Request processed in 430us (795us total) trans 120259084350 rc 0/0 00000100:00100000:3.0:1777497768.568666:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1516 00000100:00100000:2.0:1777497768.572746:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.572850:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546389760 00000100:00100000:1.0:1777497768.572862:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546389760 00000100:00100000:1.0:1777497768.572920:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1517 00000100:00100000:1.0:1777497768.572932:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+129:72815:x1863837546389760:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:1.0:1777497768.572959:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497768.572992:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734200/0x3e357265691e71e lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c5f9 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.573059:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734200/0x3e357265691e71e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5f9 expref: 130 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.573077:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734200/0x3e357265691e71e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x18:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c5f9 expref: 130 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.573345:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:1.0:1777497768.573348:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1777497768.573353:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734200, rc 0) 00000100:00100000:1.0:1777497768.573483:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+130:72815:x1863837546389760:12345-192.168.202.4@tcp:101:touch.0 Request processed in 553us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.573491:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1517 00000100:00100000:0.0:1777497768.577201:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497768.577501:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546389888 00000100:00100000:3.0:1777497768.577511:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546389888 00000100:00100000:3.0:1777497768.577654:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5927 00000100:00100000:3.0:1777497768.577665:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+23:2415:x1863837546389888:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:3.0:1777497768.577969:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+24:2415:x1863837546389888:12345-192.168.202.4@tcp:2:touch.0 Request processed in 306us (778us total) trans 4294969479 rc 0/0 00000100:00100000:3.0:1777497768.577986:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5927 00000100:00100000:0.0:1777497768.581652:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.581748:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546390144 00000100:00100000:1.0:1777497768.581759:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546390144 00000100:00100000:1.0:1777497768.581851:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 266 00000100:00100000:1.0:1777497768.581863:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+130:72815:x1863837546390144:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.582342:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+131:72815:x1863837546390144:12345-192.168.202.4@tcp:35:touch.0 Request processed in 481us (699us total) trans 120259084351 rc 0/0 00000100:00100000:1.0:1777497768.582352:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 266 00000100:00100000:0.0:1777497768.586336:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.586449:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546390400 00000100:00100000:2.0:1777497768.586459:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546390400 00000100:00100000:2.0:1777497768.586514:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1518 00000100:00100000:2.0:1777497768.586523:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+131:72815:x1863837546390400:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.586557:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.586576:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e725 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c600 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586681:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 3/0,1 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586698:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586716:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 3/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586732:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586739:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.586746:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1777497768.587079:0:64885:0:(osp_object.c:1657:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x375:0x0], index 0: 0 00010000:00010000:2.0:1777497768.587247:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e73a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587257:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e73a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587266:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e73a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587299:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587307:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 4/0,1 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587314:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 3/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587321:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587334:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497768.587339:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 4/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587347:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 5/0,0 mode: CW/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587359:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497768.587362:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497768.587367:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 3/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587374:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e72c lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497768.587389:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003a6072b6 reply state 00000000c557c52c transno 120259084352 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587399:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587405:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff924090680d00) 00010000:00010000:2.0:1777497768.587408:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497768.587410:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1777497768.587438:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e725 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c600 expref: 134 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587452:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e73a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c600 expref: 133 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.587472:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff924090680f00) 00010000:00010000:2.0:1777497768.587474:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497768.587477:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150ae00, rc 0) 00000100:00100000:2.0:1777497768.587553:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+134:72815:x1863837546390400:12345-192.168.202.4@tcp:101:touch.0 Request processed in 1031us (1225us total) trans 120259084352 rc 0/0 00000100:00100000:2.0:1777497768.587561:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1518 00000100:00100000:0.0:1777497768.593092:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.593431:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546390656 00000100:00100000:1.0:1777497768.593441:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546390656 00000100:00100000:1.0:1777497768.593497:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1519 00000100:00100000:1.0:1777497768.593507:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+134:72815:x1863837546390656:12345-192.168.202.4@tcp:36:touch.0 00010000:00010000:1.0:1777497768.593574:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497768.593598:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691e73a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c600 expref: 134 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.593619:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff924090680f00) 00010000:00010000:1.0:1777497768.593630:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497768.593694:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.593720:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.593731:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497768.593826:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000001b9b60ac reply state 00000000ec296524 transno 120259084353 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.593838:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497768.593845:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:1.0:1777497768.593848:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497768.593850:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497768.593937:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+135:72815:x1863837546390656:12345-192.168.202.4@tcp:36:touch.0 Request processed in 432us (855us total) trans 120259084353 rc 0/0 00000100:00100000:1.0:1777497768.593946:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1519 00000100:00100000:0.0:1777497768.599523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497768.599675:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546390784 00000100:00100000:2.0:1777497768.599685:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546390784 00000100:00100000:2.0:1777497768.599743:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1520 00000100:00100000:2.0:1777497768.599752:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+135:72815:x1863837546390784:12345-192.168.202.4@tcp:101:touch.0 00010000:00010000:2.0:1777497768.599775:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497768.599796:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e74f lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c607 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.599848:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e74f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c607 expref: 136 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.599863:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeec00/0x3e357265691e74f lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x19:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c607 expref: 136 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497768.599879:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:2.0:1777497768.599883:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1777497768.599887:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924085eeec00, rc 0) 00000100:00100000:2.0:1777497768.599941:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+136:72815:x1863837546390784:12345-192.168.202.4@tcp:101:touch.0 Request processed in 190us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.599964:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1520 00000100:00100000:2.0:1777497768.603963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497768.604125:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546390912 00000100:00100000:0.0:1777497768.604134:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546390912 00000100:00100000:0.0:1777497768.604188:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5928 00000100:00100000:0.0:1777497768.604196:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+24:2414:x1863837546390912:12345-192.168.202.4@tcp:2:touch.0 00000100:00100000:0.0:1777497768.604652:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546390912:12345-192.168.202.4@tcp:2:touch.0 Request processed in 455us (694us total) trans 4294969480 rc 0/0 00000100:00100000:0.0:1777497768.604661:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5928 00000100:00100000:0.0:1777497768.609291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497768.609464:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391168 00000100:00100000:1.0:1777497768.609474:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391168 00000100:00100000:1.0:1777497768.609644:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 267 00000100:00100000:1.0:1777497768.609657:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+136:72815:x1863837546391168:12345-192.168.202.4@tcp:35:touch.0 00000100:00100000:1.0:1777497768.609951:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+137:72815:x1863837546391168:12345-192.168.202.4@tcp:35:touch.0 Request processed in 295us (668us total) trans 120259084354 rc 0/0 00000100:00100000:1.0:1777497768.609960:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 267 00000100:00100000:2.0:1777497768.995878:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565069824:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497768.995947:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497768.996000:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497768.996007:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565069952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497768.996043:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497768.996079:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069824 00000100:00100000:2.0:1777497768.996087:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069824 00000100:00100000:2.0:1777497768.996144:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565069952 00000100:00100000:2.0:1777497768.996147:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565069952 00000100:00100000:2.0:1777497768.996167:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1777497768.996175:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565069824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497768.996207:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:2.0:1777497768.996251:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcf98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565069824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.996259:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4094 00000100:00100000:2.0:1777497768.996277:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4095 00000100:00100000:2.0:1777497768.996283:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565069952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497768.996301:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497768.996328:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565069952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497768.996334:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4095 00000100:00100000:2.0:1777497768.996390:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565069952:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497768.996404:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565069824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497768.996989:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565070208:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997039:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997059:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565070720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997084:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997122:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071232:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997143:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997163:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1777497768.997168:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565070080:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997194:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997217:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565070592:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997240:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997256:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071104:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997275:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997302:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070720 00000100:00100000:3.0:1777497768.997306:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070720 00000100:00100000:3.0:1777497768.997344:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071232 00000100:00100000:3.0:1777497768.997355:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071232 00000100:00100000:3.0:1777497768.997397:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071104 00000100:00100000:3.0:1777497768.997400:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071104 00000100:00100000:3.0:1777497768.997417:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1777497768.997423:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565070720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997464:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565070720:12345-0@lo:400:kworker.0 Request processed in 41us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497768.997470:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2693 00000100:00100000:3.0:1777497768.997484:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1777497768.997490:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565071232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997514:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565071232:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497768.997519:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2694 00000100:00100000:3.0:1777497768.997543:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1777497768.997549:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565071104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997577:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f841a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3658:x1863837565071104:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497768.997582:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2695 00000100:00100000:3.0:1777497768.997603:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565070464:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997626:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997643:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565070976:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997663:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997680:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1777497768.997686:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565070336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997705:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997721:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565070848:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997753:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997788:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565071360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997809:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497768.997837:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070848 00000100:00100000:3.0:1777497768.997841:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070848 00000100:00100000:3.0:1777497768.997867:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1777497768.997874:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565070848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997911:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565070848:12345-0@lo:400:kworker.0 Request processed in 38us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497768.997917:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2696 00000100:00100000:3.0:1777497768.997951:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071104:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997962:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565070720:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.997971:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071232:0@lo:400:kworker.0 00000100:00100000:3.0:1777497768.998009:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565070848:0@lo:400:kworker.0 00000100:00080000:1.0:1777497768.998233:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497768.998238:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497768.998252:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070208 00000100:00100000:1.0:1777497768.998263:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070208 00000100:00100000:1.0:1777497768.998300:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070592 00000100:00100000:1.0:1777497768.998303:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070592 00000100:00100000:1.0:1777497768.998314:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070464 00000100:00100000:1.0:1777497768.998317:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070464 00000100:00100000:1.0:1777497768.998328:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070976 00000100:00100000:1.0:1777497768.998331:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070976 00000100:00100000:1.0:1777497768.998340:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070336 00000100:00100000:1.0:1777497768.998342:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070336 00000100:00100000:1.0:1777497768.998351:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071360 00000100:00100000:1.0:1777497768.998354:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071360 00000100:00100000:1.0:1777497768.998364:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1777497768.998370:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565070208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998412:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565070208:12345-0@lo:400:kworker.0 Request processed in 43us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998418:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1777497768.998445:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565070208:0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998465:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1777497768.998471:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565070592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998502:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565070592:12345-0@lo:400:kworker.0 Request processed in 32us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998507:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1777497768.998530:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565070592:0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998546:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1777497768.998553:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565070464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998582:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565070464:12345-0@lo:400:kworker.0 Request processed in 30us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998595:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1777497768.998609:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1777497768.998614:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565070976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998641:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565070976:12345-0@lo:400:kworker.0 Request processed in 28us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998647:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:1.0:1777497768.998659:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1777497768.998665:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565070336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998690:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1863837565070336:12345-0@lo:400:kworker.0 Request processed in 26us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998695:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1777497768.998706:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:1.0:1777497768.998711:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565071360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497768.998735:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565071360:12345-0@lo:400:kworker.0 Request processed in 24us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497768.998740:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:2.0:1777497768.999935:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565070080 00000100:00100000:2.0:1777497768.999945:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565070080 00000100:00100000:2.0:1777497768.999990:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1777497768.999998:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565070080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497769.000069:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3658:x1863837565070080:12345-0@lo:400:kworker.0 Request processed in 72us (2873us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497769.000075:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1777497769.000157:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565070080:0@lo:400:kworker.0 00000100:00080000:3.0:1777497769.003794:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497769.003805:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1777497769.003876:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3660:1863837565070336:0@lo:400:kworker.0 00000100:00100000:3.0:1777497769.003894:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565071360:0@lo:400:kworker.0 00000100:00100000:3.0:1777497769.003905:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565070464:0@lo:400:kworker.0 00000100:00100000:3.0:1777497769.003916:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565070976:0@lo:400:kworker.0 00010000:00010000:0.0:1777497769.122264:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497769.508357:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565071488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497769.508432:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497769.508590:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497769.508650:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071488 00000100:00100000:2.0:1777497769.508660:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071488 00000100:00100000:2.0:1777497769.508715:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1777497769.508724:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565071488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1777497769.508755:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497769.508802:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565071488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497769.508809:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1777497769.508867:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bb162d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565071488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497769.511813:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497769.511886:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497769.513813:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071616 00000100:00100000:1.0:1777497769.513826:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071616 00000100:00100000:1.0:1777497769.513963:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:1.0:1777497769.513986:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565071616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497769.514032:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497769.514132:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565071616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497769.514139:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:3.0:1777497769.514228:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565071616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497769.789945:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497769.790002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497769.790048:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497769.790076:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391552 00000100:00100000:1.0:1777497769.790134:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391552 00000100:00100000:1.0:1777497769.790206:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1434 00000100:00100000:1.0:1777497769.790218:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546391552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497769.790228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497769.790298:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546391552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 83us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497769.790306:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1434 00000100:00100000:3.0:1777497769.790322:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391296 00000100:00100000:1.0:1777497769.790326:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391424 00000100:00100000:3.0:1777497769.790328:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391296 00000100:00100000:1.0:1777497769.790331:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391424 00000100:00100000:3.0:1777497769.790379:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 178 00000100:00100000:3.0:1777497769.790387:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546391296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497769.793904:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1435 00000100:00100000:1.0:1777497769.793929:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+137:2412:x1863837546391424:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:0.0:1777497769.796169:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391808 00000100:00100000:0.0:1777497769.796183:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391808 00000100:00100000:0.0:1777497769.796274:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2697 00000100:00100000:0.0:1777497769.796285:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546391808:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497769.797642:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00080000:2.0:1777497769.797892:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497769.797898:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1777497769.797901:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1777497769.797921:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391680 00000100:00100000:2.0:1777497769.797941:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391680 00000100:00100000:2.0:1777497769.797992:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2698 00000100:00100000:2.0:1777497769.798002:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546391680:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497769.798079:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546391680:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497769.798087:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2698 00000100:00100000:3.0:1777497769.801204:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546391296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 10805us (11255us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497769.801218:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 178 00000100:00100000:1.0:1777497769.801670:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb161500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+137:2412:x1863837546391424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 7750us (11439us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497769.801881:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1435 00000100:00100000:0.0:1777497769.802717:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bb162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546391808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 6428us (12663us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497769.802727:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2697 00010000:00010000:0.0:1777497770.146282:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497770.602273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497770.602456:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546391936 00000100:00100000:0.0:1777497770.602476:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546391936 00000100:00100000:0.0:1777497770.602545:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1521 00000100:00100000:0.0:1777497770.602556:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+137:72846:x1863837546391936:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497770.602593:0:63728:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:0.0:1777497770.602673:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+137:72846:x1863837546391936:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497770.602698:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1521 00000100:00100000:2.0:1777497770.606734:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497770.606845:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392064 00000100:00100000:0.0:1777497770.606893:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392064 00000100:00100000:0.0:1777497770.606956:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1522 00000100:00100000:0.0:1777497770.606968:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:72846:x1863837546392064:12345-192.168.202.4@tcp:41:lfs.0 00000004:00000024:0.0:1777497770.607017:0:64885:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:0.0:1777497770.607089:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+11:72846:x1863837546392064:12345-192.168.202.4@tcp:41:lfs.0 Request processed in 124us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497770.607134:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1522 00000100:00100000:3.0:1777497770.610489:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497770.611297:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392192 00000100:00100000:2.0:1777497770.611308:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392192 00000100:00080000:3.0:1777497770.611552:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497770.611602:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2196 00000100:00100000:2.0:1777497770.611615:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+25:72846:x1863837546392192:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:2.0:1777497770.611649:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:2.0:1777497770.611740:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+25:72846:x1863837546392192:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 129us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497770.611747:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2196 00000100:00100000:3.0:1777497770.614572:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497770.615737:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392320 00000100:00100000:1.0:1777497770.615752:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392320 00000100:00100000:1.0:1777497770.615840:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2197 00000100:00100000:1.0:1777497770.615851:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+7:72846:x1863837546392320:12345-192.168.202.4@tcp:13:lfs.0 00002000:00000024:1.0:1777497770.615879:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497770.615947:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d146155b-4321-4b14-9284-f644ed9631fb+7:72846:x1863837546392320:12345-192.168.202.4@tcp:13:lfs.0 Request processed in 98us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497770.615954:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2197 00000100:00100000:0.0:1777497771.051366:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1777497771.051392:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565071744:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497771.051474:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497771.051708:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071744 00000100:00100000:1.0:1777497771.051716:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071744 00000100:00100000:1.0:1777497771.051789:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1777497771.051800:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565071744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497771.051833:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497771.051887:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565071744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497771.051895:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:1.0:1777497771.051947:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565071744:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1777497771.052078:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497771.052082:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565071872:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1777497771.052135:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497771.052368:0:25316:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565071872 00000100:00100000:0.0:1777497771.052373:0:25316:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565071872 00000100:00100000:0.0:1777497771.052424:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1777497771.052432:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565071872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1777497771.052445:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00000100:00100000:0.0:1777497771.052478:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565071872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497771.052484:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1777497771.052510:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924088f85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565071872:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1777497771.052541:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1777497771.170794:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1777497771.405929:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084354 is committed 00010000:00010000:3.0:1777497771.406265:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406279:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406286:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406292:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406296:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406304:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406334:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1134d0c6 (ffff9240817a3600) 00010000:00010000:3.0:1777497771.406337:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406342:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406349:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e2fd lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x1134d0c6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406371:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406376:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406382:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406388:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406390:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406396:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406404:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497771.406406:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406408:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406415:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e304 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406441:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406446:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406451:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406455:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406457:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406463:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406470:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497771.406473:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497771.406475:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406481:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17c00/0x3e357265691e35f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406492:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406498:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406504:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406514:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eeea00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406518:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406523:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406531:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff924083cd1200) 00010000:00010000:3.0:1777497771.406534:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406537:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406543:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eeea00/0x3e357265691e390 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406558:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406564:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406570:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406575:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406578:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406584:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406602:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:3.0:1777497771.406605:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406608:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406614:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691e3a5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406627:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406634:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406640:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406646:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406649:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406655:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406662:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff924083cd1c00) 00010000:00010000:3.0:1777497771.406665:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406667:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406673:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e3c1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406700:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406706:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406712:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406717:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406733:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406740:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406749:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:3.0:1777497771.406751:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406754:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406759:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17800/0x3e357265691e3d6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406770:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406776:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406782:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406793:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150b600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406796:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406800:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406808:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff924083cd1a00) 00010000:00010000:3.0:1777497771.406810:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.406813:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406819:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e3f2 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406836:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406842:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406846:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406851:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.406853:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.406858:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407087:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:3.0:1777497771.407090:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407125:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407133:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16000/0x3e357265691e407 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407145:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407151:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407157:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407161:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407164:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407168:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407176:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff924083cd1100) 00010000:00010000:3.0:1777497771.407179:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407182:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407187:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e423 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407213:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407219:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407224:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407229:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407232:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407237:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407245:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:3.0:1777497771.407248:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407251:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407255:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924085eef400/0x3e357265691e438 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407264:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407268:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407273:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407284:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902b800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407286:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407291:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407298:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff924090680e00) 00010000:00010000:3.0:1777497771.407300:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407302:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407307:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b800/0x3e357265691e454 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407322:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407327:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407332:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407336:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407339:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407344:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407363:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:3.0:1777497771.407365:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407368:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407373:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16800/0x3e357265691e469 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407384:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407389:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407395:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407399:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407402:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407406:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407412:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff924093e6e300) 00010000:00010000:3.0:1777497771.407414:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407417:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407422:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078c00/0x3e357265691e485 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407449:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407455:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407461:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407466:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a16400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407469:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407475:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407483:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:3.0:1777497771.407485:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407488:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407492:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a16400/0x3e357265691e49a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407503:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407509:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407515:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407525:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407528:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407534:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407541:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff924093e6ee00) 00010000:00010000:3.0:1777497771.407543:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407545:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407550:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691e4b6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407565:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407571:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407576:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407580:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407582:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407587:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407602:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:3.0:1777497771.407604:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407607:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407612:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f88a17000/0x3e357265691e4cb lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407623:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407629:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407634:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407637:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407640:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407645:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407651:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff924093e6e400) 00010000:00010000:3.0:1777497771.407653:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407655:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407660:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691e4e7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407684:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407689:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407694:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407699:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407702:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407708:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407715:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:3.0:1777497771.407717:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407720:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407724:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079400/0x3e357265691e4fc lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407734:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407739:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407744:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407755:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407758:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407764:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407772:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff924093e6e600) 00010000:00010000:3.0:1777497771.407774:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407776:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407781:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079000/0x3e357265691e518 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407795:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407801:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407806:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407810:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92409902be00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407812:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407818:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407835:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:3.0:1777497771.407836:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407839:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407843:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902be00/0x3e357265691e52d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407853:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407858:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407863:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407867:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407870:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407892:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407899:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff924093e6ed00) 00010000:00010000:3.0:1777497771.407901:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407903:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407908:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691e549 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407933:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407938:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407943:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407947:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.407949:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407954:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407960:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:3.0:1777497771.407962:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.407965:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407969:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e55e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407977:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407981:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.407986:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408006:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408010:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408015:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408023:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff924090680600) 00010000:00010000:3.0:1777497771.408024:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408027:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408031:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e57a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408044:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408049:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408054:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408057:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408060:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408065:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408080:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:3.0:1777497771.408082:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408085:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408090:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691e58f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408123:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408128:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408133:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408137:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408139:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408143:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408149:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff924090680800) 00010000:00010000:3.0:1777497771.408151:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408153:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408157:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e5ab lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408177:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408182:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408187:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408191:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408193:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408197:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408203:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:3.0:1777497771.408205:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408207:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408211:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691e5c0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408219:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408223:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408229:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408237:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408240:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408246:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408253:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff924093e6e100) 00010000:00010000:3.0:1777497771.408255:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408257:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408262:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691e5dc lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408277:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408283:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408288:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408293:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408296:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408302:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408320:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:3.0:1777497771.408322:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408325:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408330:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e5f1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408340:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408346:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408351:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408356:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408359:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408364:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408371:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff924090680700) 00010000:00010000:3.0:1777497771.408373:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408376:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408380:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e60d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408403:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408408:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408414:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408419:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408422:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408428:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408436:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:3.0:1777497771.408438:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408441:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408446:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e622 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408455:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408459:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408465:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408476:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408479:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408485:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408493:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9240a6e49400) 00010000:00010000:3.0:1777497771.408496:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408498:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408503:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e63e lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408517:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408523:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408528:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408532:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408535:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408539:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408555:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:3.0:1777497771.408557:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408560:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408565:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691e653 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408575:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408580:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408584:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408588:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408590:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408595:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408600:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff924090680b00) 00010000:00010000:3.0:1777497771.408601:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408603:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408607:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e66f lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408626:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408632:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408637:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408640:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408643:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408648:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408654:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:3.0:1777497771.408656:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408658:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408662:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691e684 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408670:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408675:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408679:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408689:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408691:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408696:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408703:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff924090680500) 00010000:00010000:3.0:1777497771.408705:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408707:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408712:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e6a0 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408724:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408730:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408736:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408740:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408743:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408747:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408764:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:3.0:1777497771.408765:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408768:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408773:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691e6b5 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408783:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408788:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408794:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408799:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408801:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408807:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408814:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff924083cd1500) 00010000:00010000:3.0:1777497771.408816:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408819:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408824:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691e6d1 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408848:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408853:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408859:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408863:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408866:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408871:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408879:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:3.0:1777497771.408881:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408883:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408889:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691e6e6 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408899:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408904:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408909:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408920:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408923:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408929:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408935:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9240a6e49f00) 00010000:00010000:3.0:1777497771.408937:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.408940:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408945:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e702 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408957:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408963:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408968:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408972:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.408974:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.408980:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409009:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:3.0:1777497771.409011:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.409016:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409020:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e717 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409031:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409035:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409040:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409044:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.409047:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409052:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409072:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff924090680d00) 00010000:00010000:3.0:1777497771.409074:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.409076:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409082:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e733 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409132:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409139:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409144:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409148:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.409151:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409157:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409165:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:3.0:1777497771.409167:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497771.409169:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.409175:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e748 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497771.414410:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969480 is committed 00000001:00080000:1.0:1777497771.414431:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969476 is committed 00000100:00100000:0.0:1777497771.631292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497771.631399:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392576 00000100:00100000:2.0:1777497771.631410:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392576 00000100:00100000:2.0:1777497771.631489:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1523 00000100:00100000:2.0:1777497771.631501:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+31:72887:x1863837546392576:12345-192.168.202.4@tcp:36:mcreate.0 00010000:00010000:2.0:1777497771.631561:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497771.631599:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92409902b400/0x3e357265691e33c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4e1 expref: 31 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631619:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497771.631624:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497771.631684:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631698:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631708:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631724:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631731:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.631736:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1777497771.632323:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1777497771.633558:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633573:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633581:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633588:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633602:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497771.633607:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633615:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633632:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497771.633635:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497771.633640:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633647:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e756 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1777497771.633661:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000927b45ac reply state 000000009a59b932 transno 120259084355 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633674:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.633681:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215a00) 00010000:00010000:2.0:1777497771.633684:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497771.633687:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497771.633798:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+32:72887:x1863837546392576:12345-192.168.202.4@tcp:36:mcreate.0 Request processed in 2296us (2512us total) trans 120259084355 rc 0/0 00000100:00100000:2.0:1777497771.633807:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1523 00000100:00100000:2.0:1777497771.668899:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497771.668975:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392704 00000100:00100000:1.0:1777497771.668986:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392704 00000100:00100000:1.0:1777497771.669055:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1524 00000100:00100000:1.0:1777497771.669065:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+32:72890:x1863837546392704:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:1.0:1777497771.669089:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497771.669147:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e764 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c60e expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669216:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669238:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669252:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497771.669610:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1777497771.669614:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1777497771.669635:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669660:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e764 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c60e expref: 34 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669691:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c60e expref: 33 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.669701:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497771.669704:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1777497771.669707:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734e00, rc 0) 00000100:00100000:1.0:1777497771.669803:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+33:72890:x1863837546392704:12345-192.168.202.4@tcp:101:rm.0 Request processed in 739us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497771.669809:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1524 00000100:00100000:3.0:1777497771.680186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497771.680259:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546392832 00000100:00100000:2.0:1777497771.680269:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546392832 00000100:00100000:2.0:1777497771.680395:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1525 00000100:00100000:2.0:1777497771.680407:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+33:72890:x1863837546392832:12345-192.168.202.4@tcp:101:rm.0 00010000:00010000:2.0:1777497771.680429:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497771.680450:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c615 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680511:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680526:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680539:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680551:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680558:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680564:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680633:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680640:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680647:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497771.680708:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x1a:0x0]: returning size 0 00000004:00200000:2.0:1777497771.680712:0:64885:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497771.680732:0:64885:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680744:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680753:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680759:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680765:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680771:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680776:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497771.680781:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680788:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680799:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497771.680803:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497771.680808:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680823:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e779 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680837:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680843:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680849:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680853:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497771.680856:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680861:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680868:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215a00) 00010000:00010000:2.0:1777497771.680871:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497771.680874:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680880:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e780 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680902:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c615 expref: 35 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680915:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c615 expref: 34 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497771.680928:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff923f85215900) 00010000:00010000:2.0:1777497771.680930:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497771.680932:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9000, rc 0) 00000100:00100000:2.0:1777497771.681008:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+34:72890:x1863837546392832:12345-192.168.202.4@tcp:101:rm.0 Request processed in 604us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497771.681015:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1525 00000100:00100000:3.0:1777497771.691337:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497771.692153:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393088 00000100:00100000:1.0:1777497771.692164:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393088 00000100:00100000:1.0:1777497771.692229:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1526 00000100:00100000:1.0:1777497771.692240:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+34:72890:x1863837546393088:12345-192.168.202.4@tcp:36:rm.0 00010000:00010000:1.0:1777497771.692302:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1777497771.692334:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e787 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x1a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c615 expref: 34 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692353:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff923f85215900) 00010000:00010000:1.0:1777497771.692371:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e76b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c60e expref: 33 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692389:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497771.692393:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497771.692415:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692444:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692454:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692466:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692474:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692480:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692560:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,1 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692568:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692575:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692754:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692763:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692771:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692788:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692794:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 4/0,1 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692799:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692818:0:63727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497771.692834:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,1 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692839:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 2/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692840:0:16604:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497771.692848:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692849:0:16604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692862:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497771.692865:0:16604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497771.692867:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 3/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692877:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 4/0,0 mode: EX/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692878:0:16604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 2/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692896:0:16604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 3/0,0 mode: PW/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692896:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9240aefbb000) 00010000:00010000:1.0:1777497771.692901:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1777497771.692906:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 2/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692911:0:16604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x1a:0x0].0x0 (ffff9240aefbb000) 00010000:00010000:3.0:1777497771.692915:0:16604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1777497771.692918:0:16604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 1/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692928:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e79c lrc: 0/0,0 mode: --/EX res: [0x20000cf21:0x1a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692931:0:16604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e7a3 lrc: 0/0,0 mode: --/PW res: [0x20000cf21:0x1a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692951:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692954:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1777497771.692957:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497771.692960:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497771.692961:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497771.692969:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692975:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692980:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497771.692983:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.692988:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 5/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.693006:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497771.693009:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497771.693011:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 3/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.693016:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e78e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1777497771.693026:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000adb77298 reply state 000000007f0afbf2 transno 120259084356 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.693043:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497771.693049:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215a00) 00010000:00010000:1.0:1777497771.693052:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497771.693054:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497771.693156:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+34:72890:x1863837546393088:12345-192.168.202.4@tcp:36:rm.0 Request processed in 917us (1826us total) trans 120259084356 rc 0/0 00000100:00100000:1.0:1777497771.693163:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1526 00010000:00010000:0.0:1777497772.195338:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497773.218604:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497774.114780:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565072384:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.114848:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.114878:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565072896:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.114905:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.114923:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565073408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.114941:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.114964:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1777497774.114979:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565072000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115006:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115029:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565072512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115047:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115061:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565073024:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115078:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115107:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565073536:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115127:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115152:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565072256:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115173:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115210:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565072768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115230:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115245:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115262:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115277:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1777497774.115283:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565072128:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115302:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115315:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565072640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115337:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115352:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115369:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.115421:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072384 00000100:00100000:2.0:1777497774.115428:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072384 00000100:00100000:2.0:1777497774.115590:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072512 00000100:00100000:2.0:1777497774.115594:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072512 00000100:00100000:2.0:1777497774.115609:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073024 00000100:00100000:2.0:1777497774.115611:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073024 00000100:00100000:2.0:1777497774.115622:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073536 00000100:00100000:2.0:1777497774.115624:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073536 00000100:00100000:2.0:1777497774.115633:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072256 00000100:00100000:2.0:1777497774.115635:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072256 00000100:00100000:2.0:1777497774.115645:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072128 00000100:00100000:2.0:1777497774.115647:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072128 00000100:00100000:2.0:1777497774.115660:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1777497774.115668:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565072384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115721:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565072384:12345-0@lo:400:kworker.0 Request processed in 54us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115728:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:2.0:1777497774.115751:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1777497774.115757:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565072512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115787:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565072512:12345-0@lo:400:kworker.0 Request processed in 31us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115792:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1777497774.115803:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1777497774.115808:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565073024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115832:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565073024:12345-0@lo:400:kworker.0 Request processed in 23us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115838:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1777497774.115848:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1777497774.115853:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565073536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115876:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565073536:12345-0@lo:400:kworker.0 Request processed in 24us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115881:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1777497774.115891:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1777497774.115895:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565072256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115919:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565072256:12345-0@lo:400:kworker.0 Request processed in 24us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115925:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:2.0:1777497774.115935:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1777497774.115940:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565072128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.115964:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1863837565072128:12345-0@lo:400:kworker.0 Request processed in 25us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.115980:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:2.0:1777497774.116008:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072896 00000100:00100000:2.0:1777497774.116012:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072896 00000100:00100000:2.0:1777497774.116038:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073408 00000100:00100000:2.0:1777497774.116041:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073408 00000100:00100000:2.0:1777497774.116059:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072768 00000100:00100000:2.0:1777497774.116061:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072768 00000100:00100000:2.0:1777497774.116078:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073280 00000100:00100000:2.0:1777497774.116081:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073280 00000100:00100000:2.0:1777497774.116120:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2699 00000100:00100000:2.0:1777497774.116127:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565072896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116158:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565072896:12345-0@lo:400:kworker.0 Request processed in 32us (1253us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116164:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2699 00000100:00100000:2.0:1777497774.116174:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1777497774.116180:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565073408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116205:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565073408:12345-0@lo:400:kworker.0 Request processed in 26us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116210:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2700 00000100:00100000:2.0:1777497774.116220:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1777497774.116226:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565072768:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497774.116238:0:25485:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6de1180 x1863837565072768/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:530/0 lens 224/224 e 0 to 0 dl 1777497785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497774.116264:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565072768:12345-0@lo:400:kworker.0 Request processed in 39us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116269:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2701 00000100:00100000:2.0:1777497774.116279:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1777497774.116285:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073280:12345-0@lo:400:kworker.0 00010000:00000080:2.0:1777497774.116304:0:25485:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6de2680 x1863837565073280/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/224 e 0 to 0 dl 1777497785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497774.116331:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073280:12345-0@lo:400:kworker.0 Request processed in 46us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116336:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2702 00000100:00100000:2.0:1777497774.116357:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072000 00000100:00100000:2.0:1777497774.116361:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072000 00000100:00100000:2.0:1777497774.116387:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1777497774.116392:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565072000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116419:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565072000:12345-0@lo:400:kworker.0 Request processed in 27us (1413us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116424:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1777497774.116479:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565072640 00000100:00100000:2.0:1777497774.116483:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565072640 00000100:00100000:2.0:1777497774.116507:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073152 00000100:00100000:2.0:1777497774.116509:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073152 00000100:00100000:2.0:1777497774.116525:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4096 00000100:00100000:2.0:1777497774.116531:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565072640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116560:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565072640:12345-0@lo:400:kworker.0 Request processed in 30us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116565:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4096 00000100:00100000:2.0:1777497774.116576:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1777497774.116582:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116606:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073152:12345-0@lo:400:kworker.0 Request processed in 25us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.116612:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4097 00000100:00100000:2.0:1777497774.116661:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3658:1863837565072128:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116671:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565072640:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116681:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073152:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116690:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565072256:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116700:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565072768:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116709:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073280:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116736:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1777497774.116743:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497774.116770:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1777497774.116795:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1777497774.116799:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497774.116801:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497774.116803:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497774.116818:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565072000:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116830:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565072512:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116839:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565073024:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116850:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565073536:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116861:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565072384:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116871:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565072896:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116882:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565073408:0@lo:400:kworker.0 00000100:00100000:2.0:1777497774.116925:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073664 00000100:00100000:2.0:1777497774.116934:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073664 00000100:00100000:2.0:1777497774.116956:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4098 00000100:00100000:2.0:1777497774.116962:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073664:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497774.117248:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497774.117259:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565073792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497774.117289:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1777497774.117393:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497774.117427:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565073664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 464us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.117434:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4098 00000100:00100000:2.0:1777497774.117448:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073792 00000100:00100000:2.0:1777497774.117451:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073792 00000100:00100000:2.0:1777497774.117541:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1777497774.117640:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565073792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497774.117661:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:2.0:1777497774.117743:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565073792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 195us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.117751:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4099 00000100:00100000:2.0:1777497774.117795:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565073664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497774.119535:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565073792:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1777497774.242256:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497774.628292:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497774.628312:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565073920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497774.628379:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497774.628419:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565073920 00000100:00100000:2.0:1777497774.628426:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565073920 00000100:00100000:2.0:1777497774.628475:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1777497774.628484:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565073920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497774.628513:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497774.628552:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565073920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.628568:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1777497774.628618:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565073920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497774.631264:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1777497774.631285:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f839fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565074048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497774.631345:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497774.631386:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074048 00000100:00100000:0.0:1777497774.631392:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074048 00000100:00100000:0.0:1777497774.631428:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1777497774.631437:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565074048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497774.631464:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:0.0:1777497774.631476:0:8399:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924088f85500 x1863837565074048/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:530/0 lens 224/368 e 0 to 0 dl 1777497785 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497774.631516:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565074048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497774.631523:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1777497774.631572:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f839fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565074048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1777497774.912215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497774.912246:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497774.912279:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497774.912300:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497774.912323:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497774.912489:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393472 00000100:00100000:3.0:1777497774.912500:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393472 00000100:00100000:3.0:1777497774.912562:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393344 00000100:00100000:3.0:1777497774.912565:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393344 00000100:00100000:3.0:1777497774.912588:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1442 00000100:00100000:3.0:1777497774.912597:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546393472:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497774.912674:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546393472:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497774.912681:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1442 00000100:00100000:3.0:1777497774.912696:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1443 00000100:00100000:3.0:1777497774.912702:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+34:2413:x1863837546393344:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497774.912727:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+34:2413:x1863837546393344:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497774.912738:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1443 00000100:00100000:3.0:1777497774.912756:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393728 00000100:00100000:3.0:1777497774.912759:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393728 00000100:00100000:3.0:1777497774.912781:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393600 00000100:00100000:3.0:1777497774.912783:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393600 00000100:00100000:3.0:1777497774.912799:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2703 00000100:00100000:3.0:1777497774.912804:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546393728:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497774.912827:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546393728:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497774.912832:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2703 00000100:00100000:3.0:1777497774.912841:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2704 00000100:00100000:3.0:1777497774.912845:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546393600:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:3.0:1777497774.912857:0:25492:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bc2ece00 x1863837546393600/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:530/0 lens 224/224 e 0 to 0 dl 1777497785 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497774.912876:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+5:2413:x1863837546393600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497774.912881:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2704 00000100:00100000:2.0:1777497774.913138:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393216 00000100:00100000:2.0:1777497774.913145:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393216 00000100:00100000:2.0:1777497774.913178:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00100000:2.0:1777497774.913185:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546393216:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497774.913216:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546393216:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497774.913223:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 180 00000100:00080000:1.0:1777497774.913366:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497774.913371:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497774.913373:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1777497774.913375:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1777497775.266232:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497776.162820:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1777497776.162843:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565074176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497776.162910:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497776.162975:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074176 00000100:00100000:3.0:1777497776.162982:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074176 00000100:00100000:3.0:1777497776.163040:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:3.0:1777497776.163050:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565074176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497776.163080:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497776.163159:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565074176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497776.163166:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000100:00080000:3.0:1777497776.163185:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497776.163221:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565074176:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497776.167230:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497776.167255:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565074304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1777497776.167350:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497776.168035:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074304 00000100:00100000:3.0:1777497776.168046:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074304 00000100:00100000:3.0:1777497776.168145:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:3.0:1777497776.168167:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565074304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1777497776.168199:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8618304 pending 0 free 3922481152 avail 3690958848 00010000:00000080:3.0:1777497776.168215:0:8399:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bc2efb80 x1863837565074304/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:532/0 lens 224/368 e 0 to 0 dl 1777497787 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497776.168269:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565074304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497776.168276:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00080000:3.0:1777497776.168312:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1777497776.168478:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565074304:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1777497776.295083:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497777.314770:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777497777.707803:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084356 is committed 00010000:00010000:0.0:1777497777.708074:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708089:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708128:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708134:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497777.708138:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708146:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708177:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215a00) 00010000:00010000:0.0:1777497777.708181:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497777.708185:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708191:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e75d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708210:0:3644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708217:0:3644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708222:0:3644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708228:0:3644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497777.708231:0:3644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708236:0:3644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708242:0:3644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5ae2e1fd (ffff923f85215a00) 00010000:00010000:0.0:1777497777.708244:0:3644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497777.708247:0:3644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497777.708251:0:3644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e795 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x5ae2e1fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:02000400:3.0:1777497778.014853:0:91995:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: ost1 REPLAY BARRIER on lustre-OST0000 00000100:00100000:1.0:1777497778.296154:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.296851:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393856 00000100:00100000:2.0:1777497778.296861:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393856 00000100:00100000:2.0:1777497778.296949:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1527 00000100:00080000:3.0:1777497778.296952:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497778.296963:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+30:72968:x1863837546393856:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.296984:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.297007:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c61c expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297089:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e7b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297139:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297153:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.297196:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497778.297213:0:63728:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497778.297251:0:63728:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297274:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c61c expref: 32 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297291:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8000/0x3e357265691e7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c61c expref: 31 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.297300:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497778.297303:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497778.297306:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8000, rc 0) 00000100:00100000:2.0:1777497778.297367:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+31:72968:x1863837546393856:12345-192.168.202.4@tcp:101:dd.0 Request processed in 409us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.297374:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1527 00000100:00100000:3.0:1777497778.299797:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.303750:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546393984 00000100:00100000:2.0:1777497778.303768:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546393984 00000100:00100000:2.0:1777497778.303839:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1528 00000100:00100000:2.0:1777497778.303851:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+31:72969:x1863837546393984:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.303873:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.303906:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e7b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c623 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.303990:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.304005:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.304035:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.304080:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1777497778.304084:0:73210:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1777497778.304121:0:73210:0:(mdt_handler.c:2510:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.304145:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e7b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c623 expref: 33 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.304163:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c623 expref: 32 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.304172:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:2.0:1777497778.304175:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1777497778.304178:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8a00, rc 0) 00000100:00100000:2.0:1777497778.304261:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+32:72969:x1863837546393984:12345-192.168.202.4@tcp:101:dd.0 Request processed in 412us (4470us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.304268:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1528 00000100:00100000:0.0:1777497778.313634:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.313738:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.313822:0:6499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546394368 00000100:00100000:1.0:1777497778.313832:0:6499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546394368 00000100:00100000:1.0:1777497778.313897:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 733 00000100:00100000:1.0:1777497778.313906:0:6499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d146155b-4321-4b14-9284-f644ed9631fb+32:2414:x1863837546394368:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497778.313921:0:6499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.313956:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e7bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c623 expref: 32 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.313977:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff92409f6ded00) 00010000:00010000:1.0:1777497778.313982:0:6499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497778.314033:0:6499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8410f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d146155b-4321-4b14-9284-f644ed9631fb+31:2414:x1863837546394368:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.314040:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 733 00000100:00100000:3.0:1777497778.315024:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546394240 00000100:00100000:3.0:1777497778.315033:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546394240 00000100:00100000:3.0:1777497778.315120:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1529 00000100:00100000:3.0:1777497778.315128:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+31:72968:x1863837546394240:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.315145:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.315161:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e7c6 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c62a expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315309:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315324:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315334:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315523:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315530:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315537:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315588:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e7db lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315596:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e7db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315602:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e7db lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497778.315612:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x6:0x0]: returning size 0 00010000:00010000:3.0:1777497778.315692:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315699:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315711:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315718:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315723:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.315727:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315734:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.315744:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497778.315747:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.315751:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316191:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e7cd lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316207:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316213:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316218:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316223:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.316232:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316237:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316245:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x9beb5ca3 (ffff923f847c8900) 00010000:00010000:3.0:1777497778.316246:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.316249:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316254:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e7d4 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x9beb5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316485:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e7c6 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c62a expref: 34 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316500:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e7db lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c62a expref: 33 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.316508:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:3.0:1777497778.316510:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497778.316512:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe400, rc 0) 00000100:00100000:3.0:1777497778.316631:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+33:72968:x1863837546394240:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1503us (3008us total) trans 120259084357 rc 0/0 00000100:00100000:3.0:1777497778.316640:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1529 00000100:00100000:0.0:1777497778.326702:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.326755:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.326869:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546394624 00000100:00100000:2.0:1777497778.326880:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546394624 00000100:00100000:2.0:1777497778.326941:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546394752 00000100:00100000:2.0:1777497778.326944:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546394752 00000100:00100000:2.0:1777497778.326973:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1530 00000100:00100000:2.0:1777497778.326984:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+34:72969:x1863837546394624:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.327010:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.327032:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e7e9 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c631 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327208:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327222:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327232:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327245:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327251:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327257:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327311:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e7fe lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327319:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e7fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327326:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e7fe lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.327349:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x7:0x0]: returning size 0 00010000:00010000:2.0:1777497778.327425:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327432:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327445:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327451:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327458:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.327462:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327469:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327480:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497778.327483:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.327487:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327493:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8400/0x3e357265691e7f0 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327506:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327512:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327517:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327521:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.327529:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327535:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327542:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe44515a3 (ffff923f85215600) 00010000:00010000:2.0:1777497778.327544:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.327547:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327552:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9e00/0x3e357265691e7f7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe44515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327593:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8200/0x3e357265691e7e9 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c631 expref: 37 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327605:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e7fe lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c631 expref: 36 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327612:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:2.0:1777497778.327615:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497778.327617:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9c00, rc 0) 00000100:00100000:2.0:1777497778.327671:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+36:72969:x1863837546394624:12345-192.168.202.4@tcp:101:dd.0 Request processed in 690us (980us total) trans 120259084358 rc 0/0 00000100:00100000:2.0:1777497778.327679:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1530 00000100:00100000:2.0:1777497778.327698:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1531 00000100:00100000:2.0:1777497778.327706:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+35:72968:x1863837546394752:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.327714:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.327728:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e80c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c638 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327747:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e813 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327756:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e813 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327763:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e813 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327829:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8c00/0x3e357265691e80c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c638 expref: 37 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327841:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9600/0x3e357265691e813 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c638 expref: 36 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.327847:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:2.0:1777497778.327849:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.327851:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9600, rc 0) 00000100:00100000:2.0:1777497778.327878:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240af503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+36:72968:x1863837546394752:12345-192.168.202.4@tcp:101:dd.0 Request processed in 173us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.327884:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1531 00000100:00100000:0.0:1777497778.336557:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.336902:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395008 00000100:00100000:2.0:1777497778.336914:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395008 00000100:00100000:2.0:1777497778.336991:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1532 00000100:00100000:2.0:1777497778.337002:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+36:72968:x1863837546395008:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:2.0:1777497778.337063:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497778.337122:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e7db lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c62a expref: 36 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.337141:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:2.0:1777497778.337145:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497778.337312:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.337326:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.337336:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777497778.337381:0:63729:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084359 00000004:00010000:2.0:1777497778.337403:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000000031dc7 reply state 00000000bf3e8b73 transno 120259084360 ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.337415:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.337421:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:2.0:1777497778.337423:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497778.337426:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497778.337727:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408788b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+38:72968:x1863837546395008:12345-192.168.202.4@tcp:36:dd.0 Request processed in 726us (1177us total) trans 120259084360 rc 0/0 00000100:00100000:2.0:1777497778.337735:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1532 00000020:00080000:2.0:1777497778.337740:0:63729:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1777497778.338362:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497778.340012:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.340271:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395264 00000100:00100000:2.0:1777497778.340280:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395264 00000100:00100000:2.0:1777497778.340534:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1533 00000100:00100000:2.0:1777497778.340546:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+38:72970:x1863837546395264:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.340578:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.340600:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e821 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c63f expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340787:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340802:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340814:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340830:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340837:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340843:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.340995:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691e836 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341004:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691e836 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341012:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691e836 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.341023:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x8:0x0]: returning size 0 00010000:00010000:2.0:1777497778.341186:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341194:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341199:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341205:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341210:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.341214:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341220:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341231:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497778.341234:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.341237:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341243:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8a00/0x3e357265691e828 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341258:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341263:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341269:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341280:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.341283:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341300:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341308:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2c9ecea3 (ffff923f85215000) 00010000:00010000:2.0:1777497778.341311:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.341314:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341319:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e82f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2c9ecea3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1777497778.341579:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00010000:00010000:2.0:1777497778.341632:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd8600/0x3e357265691e821 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c63f expref: 41 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341646:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691e836 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c63f expref: 40 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.341653:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:2.0:1777497778.341655:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497778.341658:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38a00, rc 0) 00000100:00100000:2.0:1777497778.341718:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087889c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+40:72970:x1863837546395264:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1175us (1712us total) trans 120259084361 rc 0/0 00000100:00100000:2.0:1777497778.341725:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1533 00000100:00100000:0.0:1777497778.343286:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.343516:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395520 00000100:00100000:0.0:1777497778.343526:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395520 00000100:00100000:0.0:1777497778.343592:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5929 00000100:00100000:0.0:1777497778.343603:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+5:72968:x1863837546395520:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.343623:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.343646:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fa5cf5d/0x3e357265691e844 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c64d expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.343672:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x362:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.343692:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.343695:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.343702:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fa5cf5d/0x3e357265691e844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c64d expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.343720:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007fa5cf5d/0x3e357265691e844 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c64d expref: 6 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.343752:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375e00, rc 0) 00010000:00000080:0.0:1777497778.343761:0:8398:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc92d80 x1863837546395520/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.343814:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+6:72968:x1863837546395520:12345-192.168.202.4@tcp:101:dd.0 Request processed in 214us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.343820:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5929 00000100:00080000:0.0:1777497778.343845:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1777497778.344525:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395392 00000100:00100000:2.0:1777497778.344541:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395392 00000100:00100000:2.0:1777497778.344581:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1534 00000100:00100000:2.0:1777497778.344589:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+40:72969:x1863837546395392:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.344602:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.344620:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e84b lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c646 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344653:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691e852 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344666:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691e852 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344677:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691e852 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344779:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e84b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c646 expref: 42 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344797:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38400/0x3e357265691e852 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c646 expref: 41 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.344804:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:2.0:1777497778.344807:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.344810:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38400, rc 0) 00000100:00100000:2.0:1777497778.345750:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924087888380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+41:72969:x1863837546395392:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1156us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.345760:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1534 00000100:00100000:0.0:1777497778.345897:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.346026:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.346398:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395648 00000100:00100000:2.0:1777497778.346417:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395648 00000100:00100000:2.0:1777497778.346453:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546395904 00000100:00100000:2.0:1777497778.346456:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546395904 00000100:00100000:2.0:1777497778.346472:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1535 00000100:00100000:2.0:1777497778.346481:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+42:72970:x1863837546395648:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.346500:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.346518:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691e859 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c654 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346548:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691e860 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346561:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691e860 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346571:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691e860 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346665:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691e859 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c654 expref: 44 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346683:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39c00/0x3e357265691e860 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c654 expref: 43 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346692:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:2.0:1777497778.346695:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.346699:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39c00, rc 0) 00000100:00100000:2.0:1777497778.346750:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+43:72970:x1863837546395648:12345-192.168.202.4@tcp:101:dd.0 Request processed in 271us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.346757:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1535 00000100:00100000:2.0:1777497778.346780:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1536 00000100:00100000:2.0:1777497778.346787:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+42:72972:x1863837546395904:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.346796:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.346805:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e867 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c65b expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346920:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346938:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346947:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346960:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346967:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.346973:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347022:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691e87c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347030:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691e87c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347037:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691e87c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.347057:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xa:0x0]: returning size 0 00010000:00010000:2.0:1777497778.347155:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347162:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347168:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347173:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347178:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.347182:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347189:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347198:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497778.347201:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.347204:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347210:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691e86e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347220:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347224:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347236:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347240:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.347243:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347248:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347254:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xbd5240a3 (ffff923f85215600) 00010000:00010000:2.0:1777497778.347257:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.347259:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347264:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39000/0x3e357265691e875 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xbd5240a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347306:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e867 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c65b expref: 45 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347317:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691e87c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c65b expref: 44 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.347324:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:2.0:1777497778.347326:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497778.347328:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39400, rc 0) 00000100:00100000:2.0:1777497778.347363:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+44:72972:x1863837546395904:12345-192.168.202.4@tcp:101:dd.0 Request processed in 576us (1337us total) trans 120259084362 rc 0/0 00000100:00100000:2.0:1777497778.347376:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1536 00000100:00100000:2.0:1777497778.349084:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.349267:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396032 00000100:00100000:1.0:1777497778.349276:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396032 00000100:00100000:2.0:1777497778.349786:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.350125:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396288 00000100:00100000:3.0:1777497778.350131:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396288 00000100:00100000:3.0:1777497778.350177:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1537 00000100:00100000:3.0:1777497778.350186:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+44:72969:x1863837546396288:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497778.350249:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497778.350275:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691e7fe lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c631 expref: 44 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.350307:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:3.0:1777497778.350312:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497778.350627:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.350642:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.350653:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777497778.350697:0:63729:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084363 00000004:00010000:3.0:1777497778.350723:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000057c956c3 reply state 0000000042876a75 transno 120259084364 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.350735:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.350741:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:3.0:1777497778.350744:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497778.350747:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497778.350842:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+46:72969:x1863837546396288:12345-192.168.202.4@tcp:36:dd.0 Request processed in 656us (1055us total) trans 120259084364 rc 0/0 00000100:00100000:3.0:1777497778.350849:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1537 00000020:00080000:3.0:1777497778.350854:0:63729:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00002000:00010000:1.0:1777497778.351599:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/866 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.351605:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82f44e00 with x1863837546396032 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.351614:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f82f44e00. 00000100:00100000:1.0:1777497778.351642:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1008 00000100:00100000:1.0:1777497778.351653:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+6:2415:x1863837546396032:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.351781:0:24658:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.351785:0:24658:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.351788:0:24658:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.351790:0:24658:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.351804:0:24658:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.351813:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f82f44e00 x1863837546396032/t4294969481(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.351867:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546396032:12345-192.168.202.4@tcp:10:dd.0 Request processed in 217us (2789us total) trans 4294969481 rc 0/0 00000100:00100000:1.0:1777497778.351874:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1008 00002000:00010000:1.0:1777497778.351877:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/866 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.351880:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f82f44e00 with x1863837546396032 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.351885:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f82f44e00. 00000100:00100000:2.0:1777497778.354727:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.355751:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.357446:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396416 00000100:00100000:3.0:1777497778.357477:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396416 00000100:00100000:0.0:1777497778.357638:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396672 00000100:00100000:0.0:1777497778.357643:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396672 00000100:00100000:0.0:1777497778.357709:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1538 00000100:00100000:0.0:1777497778.357721:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+47:72970:x1863837546396672:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.357784:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.357811:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691e836 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x8:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c63f expref: 47 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.357832:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:0.0:1777497778.357837:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.358170:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.358188:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.358199:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.358253:0:63727:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084365 00000004:00010000:0.0:1777497778.358275:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000058bf9d75 reply state 0000000017d0b82e transno 120259084366 ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.358287:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.358980:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:0.0:1777497778.358983:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.358986:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497778.359122:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+49:72970:x1863837546396672:12345-192.168.202.4@tcp:36:dd.0 Request processed in 1402us (3371us total) trans 120259084366 rc 0/0 00000100:00100000:0.0:1777497778.359130:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1538 00000020:00080000:0.0:1777497778.359136:0:63727:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777497778.359247:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1539 00000100:00100000:2.0:1777497778.359257:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+48:72972:x1863837546396416:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.359270:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.359284:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e898 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c662 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359312:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691e89f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359322:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691e89f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359331:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691e89f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359412:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e898 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c662 expref: 50 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359431:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38800/0x3e357265691e89f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c662 expref: 49 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.359439:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:2.0:1777497778.359441:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.359450:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38800, rc 0) 00000100:00100000:2.0:1777497778.359524:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+49:72972:x1863837546396416:12345-192.168.202.4@tcp:101:dd.0 Request processed in 269us (4805us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.359531:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1539 00000100:00100000:2.0:1777497778.363298:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.363337:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.363366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.363393:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.363451:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397056 00000100:00100000:1.0:1777497778.363453:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397312 00000100:00100000:1.0:1777497778.363460:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397312 00000100:00100000:0.0:1777497778.363460:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397056 00000100:00100000:1.0:1777497778.363504:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 268 00000100:00100000:0.0:1777497778.363505:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397440 00000100:00100000:0.0:1777497778.363508:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397440 00000100:00100000:1.0:1777497778.363513:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+49:72968:x1863837546397312:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:0.0:1777497778.363528:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5930 00000100:00100000:0.0:1777497778.363535:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+8:72969:x1863837546397056:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.363548:0:25487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.363566:0:25487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb6fba19/0x3e357265691e8a6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c670 expref: -99 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.363587:0:25487:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x363:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.363614:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.363616:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.363623:0:25487:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb6fba19/0x3e357265691e8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c670 expref: 9 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.363651:0:25487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cb6fba19/0x3e357265691e8a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c670 expref: 9 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.363662:0:25487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375a00, rc 0) 00010000:00000080:0.0:1777497778.363670:0:25487:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6de1500 x1863837546397056/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.363723:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+9:72969:x1863837546397056:12345-192.168.202.4@tcp:101:dd.0 Request processed in 188us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.363729:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5930 00000100:00100000:0.0:1777497778.363746:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5931 00000100:00100000:0.0:1777497778.363751:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+8:72970:x1863837546397440:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.363758:0:25487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1777497778.363759:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+50:72968:x1863837546397312:12345-192.168.202.4@tcp:35:dd.0 Request processed in 248us (422us total) trans 120259084367 rc 0/0 00000100:00100000:1.0:1777497778.363766:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 268 00010000:00010000:0.0:1777497778.363767:0:25487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a671882/0x3e357265691e8ad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c677 expref: -99 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.363778:0:25487:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x364:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.363787:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.363789:0:25487:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.363792:0:25487:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a671882/0x3e357265691e8ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c677 expref: 9 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.363802:0:25487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a671882/0x3e357265691e8ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c677 expref: 9 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.363824:0:25487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375400, rc 0) 00010000:00000080:0.0:1777497778.363828:0:25487:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d81f80 x1863837546397440/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.363871:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+9:72970:x1863837546397440:12345-192.168.202.4@tcp:101:dd.0 Request processed in 119us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.363878:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5931 00000100:00100000:0.0:1777497778.363903:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396928 00000100:00100000:0.0:1777497778.363906:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396928 00000100:00100000:0.0:1777497778.363940:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1540 00000100:00100000:0.0:1777497778.363948:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+50:72975:x1863837546396928:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.363956:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.363969:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374600/0x3e357265691e8b4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c669 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364069:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364081:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364091:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364130:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364138:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364151:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364193:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691e8c9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364201:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691e8c9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364208:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691e8c9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.364219:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xd:0x0]: returning size 0 00010000:00010000:0.0:1777497778.364261:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364267:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364271:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364275:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364278:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.364281:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364285:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364303:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.364306:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.364310:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364316:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e8bb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364327:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364333:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364338:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364343:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84374a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.364346:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364351:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364358:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x965f6ba3 (ffff92409c15e700) 00010000:00010000:0.0:1777497778.364360:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.364362:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364367:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8c2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x965f6ba3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364411:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374600/0x3e357265691e8b4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c669 expref: 53 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364423:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691e8c9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c669 expref: 52 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.364430:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:0.0:1777497778.364432:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.364435:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375c00, rc 0) 00000100:00100000:0.0:1777497778.364465:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+52:72975:x1863837546396928:12345-192.168.202.4@tcp:101:dd.0 Request processed in 519us (1071us total) trans 120259084368 rc 0/0 00000100:00100000:0.0:1777497778.364472:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1540 00000100:00100000:1.0:1777497778.365788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.365872:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397696 00000100:00100000:3.0:1777497778.365878:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397696 00000100:00100000:3.0:1777497778.365993:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1541 00000100:00100000:3.0:1777497778.366001:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+52:72972:x1863837546397696:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497778.366039:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497778.366058:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39400/0x3e357265691e87c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xa:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c65b expref: 52 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.366074:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:3.0:1777497778.366078:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497778.366212:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.366225:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.366234:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777497778.366271:0:64885:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084369 00000004:00010000:3.0:1777497778.366289:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c7a62389 reply state 00000000ef77c0eb transno 120259084370 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.366439:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.366446:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:3.0:1777497778.366449:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497778.366451:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497778.366629:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+54:72972:x1863837546397696:12345-192.168.202.4@tcp:36:dd.0 Request processed in 628us (844us total) trans 120259084370 rc 0/0 00000100:00100000:3.0:1777497778.366648:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1541 00000020:00080000:3.0:1777497778.366653:0:64885:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1777497778.371781:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.371827:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397824 00000100:00100000:0.0:1777497778.371838:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397824 00000100:00100000:0.0:1777497778.372042:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5932 00000100:00100000:0.0:1777497778.372052:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+9:72972:x1863837546397824:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.372070:0:8717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.372120:0:8717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000350bc77f/0x3e357265691e8de lrc: 2/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c67e expref: -99 pid: 8717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.372148:0:8717:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x366:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.372171:0:8717:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.372173:0:8717:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.372181:0:8717:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000350bc77f/0x3e357265691e8de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c67e expref: 10 pid: 8717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.372220:0:8717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000350bc77f/0x3e357265691e8de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c67e expref: 10 pid: 8717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.372332:0:8717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374400, rc 0) 00010000:00000080:0.0:1777497778.372342:0:8717:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b0000 x1863837546397824/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.372414:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+10:72972:x1863837546397824:12345-192.168.202.4@tcp:101:dd.0 Request processed in 363us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.372421:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5932 00000100:00100000:3.0:1777497778.372852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.373141:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546397952 00000100:00100000:2.0:1777497778.373148:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546397952 00000100:00100000:2.0:1777497778.373186:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1542 00000100:00100000:2.0:1777497778.373194:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+54:72975:x1863837546397952:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.373210:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.373227:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e8e5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c685 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373255:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e8ec lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373266:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e8ec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373275:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e8ec lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373379:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e8e5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c685 expref: 56 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373396:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38000/0x3e357265691e8ec lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c685 expref: 55 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.373410:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:2.0:1777497778.373413:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.373416:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38000, rc 0) 00000100:00100000:2.0:1777497778.373455:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+55:72975:x1863837546397952:12345-192.168.202.4@tcp:101:dd.0 Request processed in 262us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.373461:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1542 00000100:00100000:3.0:1777497778.375997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.376179:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398208 00000100:00100000:0.0:1777497778.376188:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398208 00000100:00100000:0.0:1777497778.376238:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1543 00000100:00100000:0.0:1777497778.376248:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+55:72971:x1863837546398208:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.376267:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.376284:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374600/0x3e357265691e8f3 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c68c expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376406:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376420:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376430:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376459:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376466:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376473:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376532:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691e908 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376541:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691e908 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376547:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691e908 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.376558:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x9:0x0]: returning size 0 00010000:00010000:0.0:1777497778.376652:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376660:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376664:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376670:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376676:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84374a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.376686:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376693:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376704:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.376708:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.376712:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376718:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374a00/0x3e357265691e8fa lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376731:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376736:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376741:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376746:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.376748:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376753:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376759:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x74f887a3 (ffff92409c15e700) 00010000:00010000:0.0:1777497778.376762:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.376771:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376777:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691e901 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x74f887a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376817:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374600/0x3e357265691e8f3 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c68c expref: 58 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376831:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691e908 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c68c expref: 57 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.376838:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:0.0:1777497778.376840:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.376842:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374e00, rc 0) 00000100:00100000:0.0:1777497778.376907:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+57:72971:x1863837546398208:12345-192.168.202.4@tcp:101:dd.0 Request processed in 660us (916us total) trans 120259084371 rc 0/0 00000100:00100000:0.0:1777497778.376914:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1543 00000100:00100000:1.0:1777497778.377849:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.378005:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398336 00000100:00100000:2.0:1777497778.378013:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398336 00002000:00010000:2.0:1777497778.378041:0:24910:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/867 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.378046:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc8f100 with x1863837546398336 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.378055:0:24910:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc8f100. 00000100:00100000:2.0:1777497778.378083:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1009 00000100:00100000:2.0:1777497778.378091:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+10:2415:x1863837546398336:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497778.378255:0:24910:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777497778.378258:0:24910:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.378261:0:24910:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:2.0:1777497778.378263:0:24910:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.378265:0:24910:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1777497778.378274:0:24910:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc8f100 x1863837546398336/t4294969482(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.378312:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546398336:12345-192.168.202.4@tcp:10:dd.0 Request processed in 222us (466us total) trans 4294969482 rc 0/0 00000100:00100000:2.0:1777497778.378319:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1009 00002000:00010000:2.0:1777497778.378322:0:24910:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/867 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.378335:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc8f100 with x1863837546398336 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.378340:0:24910:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc8f100. 00000100:00100000:2.0:1777497778.382768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.382806:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.382844:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.382917:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398848 00000100:00100000:0.0:1777497778.382927:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398848 00002000:00010000:0.0:1777497778.382981:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/868 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.382986:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a6d82d80 with x1863837546398848 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.382998:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a6d82d80. 00000100:00100000:0.0:1777497778.383037:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1010 00000100:00100000:0.0:1777497778.383048:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546398848:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:0.0:1777497778.383230:0:24902:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1777497778.383235:0:24902:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.383237:0:24902:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:0.0:1777497778.383252:0:24902:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.383254:0:24902:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1777497778.383263:0:24902:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d82d80 x1863837546398848/t4294969483(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.383319:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+12:2414:x1863837546398848:12345-192.168.202.4@tcp:10:dd.0 Request processed in 273us (511us total) trans 4294969483 rc 0/0 00000100:00100000:0.0:1777497778.383326:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1010 00002000:00010000:0.0:1777497778.383330:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/868 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.383333:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a6d82d80 with x1863837546398848 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.383339:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a6d82d80. 00000100:00100000:3.0:1777497778.383521:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398720 00000100:00100000:3.0:1777497778.383526:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398720 00000100:00100000:3.0:1777497778.383552:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398464 00000100:00100000:3.0:1777497778.383554:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398464 00000100:00100000:3.0:1777497778.383569:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1544 00000100:00100000:3.0:1777497778.383576:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+58:72974:x1863837546398720:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.383593:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.383612:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e916 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c693 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383720:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383736:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383749:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383763:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383813:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383834:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383893:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e92b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383901:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e92b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.383908:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e92b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497778.383918:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xc:0x0]: returning size 0 00010000:00010000:3.0:1777497778.383992:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384000:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384006:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384013:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384018:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fee00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.384021:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384028:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384048:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497778.384052:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.384057:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384063:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e91d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384076:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384080:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384085:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384089:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffa00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.384124:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384130:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384137:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x4e05b2a3 (ffff923f847c8900) 00010000:00010000:3.0:1777497778.384139:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.384142:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384147:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffa00/0x3e357265691e924 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x4e05b2a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384195:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e916 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c693 expref: 61 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384208:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e92b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c693 expref: 60 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384215:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:3.0:1777497778.384217:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497778.384220:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fe800, rc 0) 00000100:00100000:3.0:1777497778.384250:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+60:72974:x1863837546398720:12345-192.168.202.4@tcp:101:dd.0 Request processed in 675us (1493us total) trans 120259084372 rc 0/0 00000100:00100000:3.0:1777497778.384257:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1544 00000100:00100000:3.0:1777497778.384276:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1545 00000100:00100000:3.0:1777497778.384283:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+59:72971:x1863837546398464:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.384292:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.384302:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e939 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c69a expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384319:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e940 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384329:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e940 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384335:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e940 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384412:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e939 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c69a expref: 61 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384425:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fea00/0x3e357265691e940 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c69a expref: 60 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.384432:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:3.0:1777497778.384434:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497778.384436:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7fea00, rc 0) 00000100:00100000:3.0:1777497778.384464:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+60:72971:x1863837546398464:12345-192.168.202.4@tcp:101:dd.0 Request processed in 182us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.384470:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1545 00000100:00100000:0.0:1777497778.384587:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.384797:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399104 00000100:00100000:2.0:1777497778.384803:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399104 00000100:00100000:2.0:1777497778.384846:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1546 00000100:00100000:2.0:1777497778.384854:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+60:72975:x1863837546399104:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:2.0:1777497778.384887:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1777497778.384904:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691e8c9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c669 expref: 60 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.384916:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:2.0:1777497778.384920:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1777497778.385062:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.385071:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.385079:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777497778.385148:0:65418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084373 00000004:00010000:2.0:1777497778.385172:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005af04823 reply state 00000000362ac7b8 transno 120259084374 ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.385184:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.385198:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:2.0:1777497778.385201:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1777497778.385203:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497778.385259:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+62:72975:x1863837546399104:12345-192.168.202.4@tcp:36:dd.0 Request processed in 405us (670us total) trans 120259084374 rc 0/0 00000100:00100000:2.0:1777497778.385266:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1546 00000020:00080000:2.0:1777497778.385270:0:65418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777497778.389180:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.389629:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399232 00000100:00100000:3.0:1777497778.389642:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399232 00002000:00010000:3.0:1777497778.389682:0:25314:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/870 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.389687:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f861ced80 with x1863837546399232 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.389698:0:25314:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f861ced80. 00000100:00100000:3.0:1777497778.389731:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1011 00000100:00100000:3.0:1777497778.389740:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+12:2412:x1863837546399232:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:3.0:1777497778.389898:0:25314:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777497778.389902:0:25314:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.389904:0:25314:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:3.0:1777497778.389906:0:25314:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.389908:0:25314:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1777497778.389917:0:25314:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f861ced80 x1863837546399232/t4294969484(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.390020:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+13:2412:x1863837546399232:12345-192.168.202.4@tcp:10:dd.0 Request processed in 280us (846us total) trans 4294969484 rc 0/0 00000100:00100000:3.0:1777497778.390027:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1011 00002000:00010000:3.0:1777497778.390031:0:25314:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/870 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.390034:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f861ced80 with x1863837546399232 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.390038:0:25314:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f861ced80. 00000100:00100000:0.0:1777497778.407736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407819:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407852:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407884:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407907:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.407975:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.408009:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546400512 00000100:00100000:0.0:1777497778.408019:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546400512 00000100:00100000:3.0:1777497778.408060:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399744 00000100:00100000:3.0:1777497778.408064:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399744 00000100:00100000:0.0:1777497778.408073:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5933 00000100:00100000:0.0:1777497778.408083:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+13:72975:x1863837546400512:12345-192.168.202.4@tcp:101:dd.0 00000100:00100000:3.0:1777497778.408088:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399872 00000100:00100000:3.0:1777497778.408090:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399872 00000100:00100000:3.0:1777497778.408140:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546400128 00010000:00010000:0.0:1777497778.408141:0:25490:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1777497778.408143:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546400128 00000100:00100000:3.0:1777497778.408160:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1547 00010000:00010000:0.0:1777497778.408162:0:25490:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9539a9a/0x3e357265691e94e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6af expref: -99 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497778.408167:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+64:72971:x1863837546399744:12345-192.168.202.4@tcp:36:dd.0 00002000:00010000:0.0:1777497778.408193:0:25490:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x369:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.408221:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.408222:0:25490:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.408225:0:25490:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.408247:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691e908 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c68c expref: 64 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.408267:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:3.0:1777497778.408272:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497778.408427:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.408439:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497778.408442:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399488 00000100:00100000:1.0:1777497778.408446:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399488 00010000:00010000:3.0:1777497778.408450:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497778.408465:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546400384 00000100:00100000:1.0:1777497778.408467:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546400384 00000100:00100000:1.0:1777497778.408475:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546400768 00000100:00100000:1.0:1777497778.408477:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546400768 00000100:00100000:1.0:1777497778.408488:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 269 00000100:00100000:1.0:1777497778.408494:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+67:72969:x1863837546399488:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:1.0:1777497778.408655:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+68:72969:x1863837546399488:12345-192.168.202.4@tcp:35:dd.0 Request processed in 160us (927us total) trans 120259084376 rc 0/0 00000100:00100000:1.0:1777497778.408669:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 269 00000100:00100000:1.0:1777497778.408687:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 270 00000100:00100000:1.0:1777497778.408695:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+67:72970:x1863837546400384:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:1.0:1777497778.408794:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+68:72970:x1863837546400384:12345-192.168.202.4@tcp:35:dd.0 Request processed in 100us (908us total) trans 120259084377 rc 0/0 00000100:00100000:1.0:1777497778.408800:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 270 00000100:00100000:1.0:1777497778.408834:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 271 00000100:00100000:1.0:1777497778.408840:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+67:72972:x1863837546400768:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:1.0:1777497778.408953:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+68:72972:x1863837546400768:12345-192.168.202.4@tcp:35:dd.0 Request processed in 112us (977us total) trans 120259084378 rc 0/0 00000100:00100000:1.0:1777497778.408961:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 271 00000100:00100000:2.0:1777497778.409049:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1548 00000100:00100000:2.0:1777497778.409060:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+67:72974:x1863837546399872:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.409074:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.409087:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691e95c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6a1 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409129:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e963 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409138:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e963 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409147:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e963 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409216:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691e95c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6a1 expref: 69 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409233:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38c00/0x3e357265691e963 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6a1 expref: 68 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.409251:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:2.0:1777497778.409254:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.409257:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38c00, rc 0) 00000001:00080000:3.0:1777497778.409495:0:64885:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084375 00010000:00010000:0.0:1777497778.409503:0:25490:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9539a9a/0x3e357265691e94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6af expref: 14 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1777497778.409521:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000050428497 reply state 00000000bdf0189d transno 120259084379 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.409522:0:25490:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e9539a9a/0x3e357265691e94e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6af expref: 14 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.409532:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.409534:0:25490:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374600, rc 0) 00010000:00010000:3.0:1777497778.409538:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:3.0:1777497778.409540:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00000080:0.0:1777497778.409540:0:25490:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2f480 x1863837546400512/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.409543:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.409670:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1549 00000100:00100000:1.0:1777497778.409680:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+70:72973:x1863837546400128:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.409689:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.409701:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e96a lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6a8 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409796:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409807:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409815:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409840:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409846:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409852:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409890:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e97f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409898:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e97f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409910:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e97f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497778.409919:0:63727:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xb:0x0]: returning size 0 00010000:00010000:1.0:1777497778.409979:0:63727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.409987:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410000:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410009:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410015:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.410024:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410032:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410041:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:1.0:1777497778.410043:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.410046:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410052:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691e971 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410065:0:63727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410070:0:63727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410075:0:63727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410080:0:63727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.410082:0:63727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410087:0:63727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410111:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x5abf9a3 (ffff9240aefbb500) 00010000:00010000:1.0:1777497778.410114:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.410121:0:63727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410127:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691e978 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x5abf9a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410155:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691e96a lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6a8 expref: 73 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410165:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e97f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6a8 expref: 72 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.410171:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:1.0:1777497778.410174:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497778.410175:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734600, rc 0) 00000100:00100000:2.0:1777497778.411308:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+72:72974:x1863837546399872:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2244us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.411317:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1548 00000100:00100000:0.0:1777497778.412154:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:d146155b-4321-4b14-9284-f644ed9631fb+14:72975:x1863837546400512:12345-192.168.202.4@tcp:101:dd.0 Request processed in 4067us (4239us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.412162:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5933 00000100:00100000:3.0:1777497778.418018:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+71:72971:x1863837546399744:12345-192.168.202.4@tcp:36:dd.0 Request processed in 9837us (10215us total) trans 120259084379 rc 0/0 00000100:00100000:3.0:1777497778.418031:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1547 00000020:00080000:3.0:1777497778.418039:0:64885:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777497778.418114:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.418137:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401024 00000100:00100000:3.0:1777497778.418144:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401024 00000100:00100000:3.0:1777497778.418180:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1550 00000100:00100000:3.0:1777497778.418186:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+71:72974:x1863837546401024:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497778.418240:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497778.418267:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e92b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xc:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c693 expref: 71 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.418286:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:3.0:1777497778.418304:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497778.418460:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.418474:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.418498:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777497778.418541:0:65418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084381 00000004:00010000:3.0:1777497778.418566:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000099f3c1ff reply state 00000000b5044013 transno 120259084382 ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.418578:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.418584:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:3.0:1777497778.418587:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497778.418589:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497778.418678:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+73:72974:x1863837546401024:12345-192.168.202.4@tcp:36:dd.0 Request processed in 490us (582us total) trans 120259084382 rc 0/0 00000100:00100000:3.0:1777497778.418684:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1550 00000020:00080000:3.0:1777497778.418688:0:65418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777497778.418878:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+72:72973:x1863837546400128:12345-192.168.202.4@tcp:101:dd.0 Request processed in 9199us (11023us total) trans 120259084380 rc 0/0 00000100:00100000:1.0:1777497778.418887:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1549 00000100:00100000:2.0:1777497778.426027:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.426079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.426147:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.426182:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.426283:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401152 00000100:00100000:1.0:1777497778.426293:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401152 00002000:00010000:1.0:1777497778.426331:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/873 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.426336:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f844cf800 with x1863837546401152 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.426349:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f844cf800. 00000100:00100000:1.0:1777497778.426372:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1012 00000100:00100000:1.0:1777497778.426382:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+14:2413:x1863837546401152:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.426535:0:24168:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.426539:0:24168:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.426541:0:24168:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.426556:0:24168:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.426558:0:24168:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.426568:0:24168:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f844cf800 x1863837546401152/t4294969485(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.426626:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+15:2413:x1863837546401152:12345-192.168.202.4@tcp:10:dd.0 Request processed in 247us (444us total) trans 4294969485 rc 0/0 00000100:00100000:1.0:1777497778.426634:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1012 00002000:00010000:1.0:1777497778.426638:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/873 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.426640:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f844cf800 with x1863837546401152 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.426645:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f844cf800. 00000100:00100000:1.0:1777497778.426753:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401408 00000100:00100000:1.0:1777497778.426758:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401408 00000100:00100000:1.0:1777497778.426781:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401664 00000100:00100000:1.0:1777497778.426784:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401664 00000100:00100000:1.0:1777497778.426803:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1551 00000100:00100000:1.0:1777497778.426810:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+73:72973:x1863837546401408:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.426829:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.426845:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e994 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6bd expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.426875:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e99b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.426889:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e99b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.426900:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e99b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427013:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691e994 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6bd expref: 75 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427032:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735600/0x3e357265691e99b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6bd expref: 74 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427042:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:1.0:1777497778.427045:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777497778.427048:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735600, rc 0) 00000100:00100000:1.0:1777497778.427075:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+74:72973:x1863837546401408:12345-192.168.202.4@tcp:101:dd.0 Request processed in 266us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.427081:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1551 00000100:00100000:1.0:1777497778.427118:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1552 00000100:00100000:1.0:1777497778.427126:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+73:72976:x1863837546401664:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.427133:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.427143:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e9a2 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6c4 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427242:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427251:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427258:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427283:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427290:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427297:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427343:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e9b7 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427351:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e9b7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427358:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e9b7 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497778.427368:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xe:0x0]: returning size 0 00010000:00010000:1.0:1777497778.427427:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427435:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427441:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427447:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427453:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.427463:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427471:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427480:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:1.0:1777497778.427483:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.427486:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427493:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691e9a9 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427503:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427508:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427514:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427518:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.427521:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427526:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427533:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xdeb924a3 (ffff9240aefbbe00) 00010000:00010000:1.0:1777497778.427535:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.427545:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427550:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691e9b0 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xdeb924a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427592:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691e9a2 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6c4 expref: 76 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427603:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e9b7 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6c4 expref: 75 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.427610:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:1.0:1777497778.427612:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497778.427614:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150a000, rc 0) 00000100:00100000:1.0:1777497778.427642:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+75:72976:x1863837546401664:12345-192.168.202.4@tcp:101:dd.0 Request processed in 517us (1494us total) trans 120259084383 rc 0/0 00000100:00100000:1.0:1777497778.427648:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1552 00000100:00100000:0.0:1777497778.427760:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401280 00000100:00100000:0.0:1777497778.427766:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401280 00000100:00100000:0.0:1777497778.427810:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5934 00000100:00100000:0.0:1777497778.427819:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+15:72971:x1863837546401280:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.427827:0:25494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.427839:0:25494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b2c31be/0x3e357265691e9c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6b6 expref: -99 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.427859:0:25494:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x365:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.427872:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.427875:0:25494:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.427881:0:25494:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2c31be/0x3e357265691e9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6b6 expref: 16 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.427906:0:25494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b2c31be/0x3e357265691e9c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6b6 expref: 16 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.427917:0:25494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374a00, rc 0) 00010000:00000080:0.0:1777497778.427923:0:25494:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924086d41880 x1863837546401280/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.427960:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+16:72971:x1863837546401280:12345-192.168.202.4@tcp:101:dd.0 Request processed in 143us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.427966:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5934 00000100:00100000:2.0:1777497778.428176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.428204:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401792 00000100:00100000:0.0:1777497778.428209:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401792 00000100:00100000:0.0:1777497778.428234:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5935 00000100:00100000:0.0:1777497778.428296:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+16:72974:x1863837546401792:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.428305:0:25496:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.428319:0:25496:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e48ec24/0x3e357265691e9cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6cb expref: -99 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.428332:0:25496:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x368:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.428340:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.428342:0:25496:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.428346:0:25496:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e48ec24/0x3e357265691e9cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6cb expref: 17 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.428356:0:25496:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001e48ec24/0x3e357265691e9cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6cb expref: 17 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.428373:0:25496:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374c00, rc 0) 00010000:00000080:0.0:1777497778.428378:0:25496:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f844cf100 x1863837546401792/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.428416:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+17:72974:x1863837546401792:12345-192.168.202.4@tcp:101:dd.0 Request processed in 177us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.433352:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5935 00000100:00100000:3.0:1777497778.434873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.435853:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402048 00000100:00100000:1.0:1777497778.435863:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402048 00000100:00100000:1.0:1777497778.435954:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 272 00000100:00100000:1.0:1777497778.435967:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+75:72975:x1863837546402048:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:1.0:1777497778.436330:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+76:72975:x1863837546402048:12345-192.168.202.4@tcp:35:dd.0 Request processed in 365us (1464us total) trans 120259084384 rc 0/0 00000100:00100000:1.0:1777497778.436337:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 272 00000100:00100000:1.0:1777497778.438782:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.438873:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402304 00000100:00100000:0.0:1777497778.438893:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402304 00000100:00100000:0.0:1777497778.438961:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1553 00000100:00100000:0.0:1777497778.438971:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+76:72973:x1863837546402304:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.439020:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.439047:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691e97f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6a8 expref: 76 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.439067:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:0.0:1777497778.439073:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.439274:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.439289:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.439311:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.439351:0:73210:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084385 00000004:00010000:0.0:1777497778.439388:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000004ece10 reply state 0000000048ceff05 transno 120259084386 ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.439399:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.439405:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:0.0:1777497778.439407:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.439410:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497778.439591:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+78:72973:x1863837546402304:12345-192.168.202.4@tcp:36:dd.0 Request processed in 621us (817us total) trans 120259084386 rc 0/0 00000100:00100000:0.0:1777497778.439599:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1553 00000020:00080000:0.0:1777497778.439604:0:73210:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1777497778.443690:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.443738:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.443814:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.443855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.443899:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402816 00000100:00100000:3.0:1777497778.443908:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402816 00002000:00010000:3.0:1777497778.443960:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/869 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.443965:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a3b88000 with x1863837546402816 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.443976:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a3b88000. 00000100:00100000:3.0:1777497778.443996:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402944 00000100:00100000:3.0:1777497778.443998:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402944 00002000:00010000:3.0:1777497778.444024:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/872 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.444027:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a3b89c00 with x1863837546402944 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.444031:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a3b89c00. 00000100:00100000:3.0:1777497778.444048:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1013 00000100:00100000:3.0:1777497778.444057:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+18:2412:x1863837546402816:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:3.0:1777497778.444604:0:24658:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777497778.444609:0:24658:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.444612:0:24658:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:3.0:1777497778.444614:0:24658:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.444616:0:24658:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1777497778.444627:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b88000 x1863837546402816/t4294969486(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.444702:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:2412:x1863837546402816:12345-192.168.202.4@tcp:10:dd.0 Request processed in 646us (887us total) trans 4294969486 rc 0/0 00000100:00100000:3.0:1777497778.444710:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1013 00002000:00010000:3.0:1777497778.444713:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/869 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.444716:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a3b88000 with x1863837546402816 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.444721:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a3b88000. 00000100:00100000:3.0:1777497778.444741:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1014 00000100:00100000:3.0:1777497778.444749:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+18:2412:x1863837546402944:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:3.0:1777497778.444816:0:24658:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777497778.444819:0:24658:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.444821:0:24658:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:3.0:1777497778.444823:0:24658:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.444825:0:24658:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1777497778.444839:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a3b89c00 x1863837546402944/t4294969487(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.444865:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:2412:x1863837546402944:12345-192.168.202.4@tcp:10:dd.0 Request processed in 118us (1010us total) trans 4294969487 rc 0/0 00000100:00100000:3.0:1777497778.444871:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1014 00002000:00010000:3.0:1777497778.444874:0:24658:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/872 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.444876:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240a3b89c00 with x1863837546402944 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.444881:0:24658:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240a3b89c00. 00000100:00100000:2.0:1777497778.447679:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.447881:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403072 00000100:00100000:3.0:1777497778.447900:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403072 00000100:00100000:3.0:1777497778.447959:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5936 00000100:00100000:3.0:1777497778.447968:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:72973:x1863837546403072:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.447986:0:23437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.448006:0:23437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691e9da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6e0 expref: -99 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.448029:0:23437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x367:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.448048:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.448051:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.448057:0:23437:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691e9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6e0 expref: 20 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.448072:0:23437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691e9da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6e0 expref: 20 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.448084:0:23437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9240bb7ffa00, rc 0) 00010000:00000080:3.0:1777497778.448130:0:23437:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f844cfb80 x1863837546403072/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.448179:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+20:72973:x1863837546403072:12345-192.168.202.4@tcp:101:dd.0 Request processed in 213us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.448186:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5936 00000100:00100000:1.0:1777497778.449120:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402432 00000100:00100000:1.0:1777497778.449129:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402432 00000100:00100000:1.0:1777497778.449196:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402688 00000100:00100000:1.0:1777497778.449200:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402688 00000100:00100000:1.0:1777497778.449233:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1554 00000100:00100000:1.0:1777497778.449242:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+79:72976:x1863837546402432:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.449259:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.449276:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e9e1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6d2 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.449386:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e9e8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.449400:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.449410:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e9e8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497778.449602:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1555 00000100:00100000:3.0:1777497778.449612:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+81:72977:x1863837546402688:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.449621:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.449631:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e9ef lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6d9 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449729:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449739:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449746:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449760:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449766:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449772:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449817:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691ea04 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449831:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691ea04 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.449838:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691ea04 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497778.449848:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0xf:0x0]: returning size 0 00010000:00010000:1.0:1777497778.450000:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691e9e1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6d2 expref: 82 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.450021:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b000/0x3e357265691e9e8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6d2 expref: 81 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.450028:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:1.0:1777497778.450031:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777497778.450034:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b000, rc 0) 00000100:00100000:1.0:1777497778.450092:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+81:72976:x1863837546402432:12345-192.168.202.4@tcp:101:dd.0 Request processed in 851us (6419us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.450127:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1554 00010000:00010000:3.0:1777497778.450245:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450253:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450260:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450266:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450272:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.450276:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450282:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450439:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497778.450443:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.450448:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450454:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe800/0x3e357265691e9f6 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450472:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450477:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450482:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450487:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.450489:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450494:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450501:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x6e9b5ca3 (ffff923f847c8e00) 00010000:00010000:3.0:1777497778.450503:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.450505:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450805:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff400/0x3e357265691e9fd lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x6e9b5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450849:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fee00/0x3e357265691e9ef lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6d9 expref: 82 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450861:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691ea04 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6d9 expref: 81 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.450878:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:3.0:1777497778.450880:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497778.450882:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079800, rc 0) 00000100:00100000:3.0:1777497778.451166:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+81:72977:x1863837546402688:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1554us (7425us total) trans 120259084387 rc 0/0 00000100:00100000:3.0:1777497778.451175:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1555 00000100:00100000:0.0:1777497778.453581:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.453677:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.453779:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403456 00000100:00100000:2.0:1777497778.453789:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403456 00000100:00100000:2.0:1777497778.453844:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 273 00000100:00100000:2.0:1777497778.453855:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+81:72971:x1863837546403456:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:2.0:1777497778.454469:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+82:72971:x1863837546403456:12345-192.168.202.4@tcp:35:dd.0 Request processed in 614us (893us total) trans 120259084388 rc 0/0 00000100:00100000:2.0:1777497778.454477:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 273 00000100:00100000:3.0:1777497778.458012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.458463:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.458560:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.458842:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403712 00000100:00100000:3.0:1777497778.458852:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403712 00000100:00100000:3.0:1777497778.458911:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403968 00000100:00100000:3.0:1777497778.458914:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403968 00000100:00100000:3.0:1777497778.458939:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546404224 00000100:00100000:3.0:1777497778.458942:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546404224 00000100:00100000:3.0:1777497778.458964:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1556 00000100:00100000:3.0:1777497778.458973:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+84:72977:x1863837546403712:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.458994:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.459015:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691ea12 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6e7 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459052:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691ea19 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459066:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691ea19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459079:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691ea19 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459229:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078800/0x3e357265691ea12 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6e7 expref: 86 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459246:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079200/0x3e357265691ea19 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6e7 expref: 85 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459255:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:3.0:1777497778.459257:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1777497778.459261:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079200, rc 0) 00000100:00100000:3.0:1777497778.459397:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+85:72977:x1863837546403712:12345-192.168.202.4@tcp:101:dd.0 Request processed in 424us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.459405:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1556 00000100:00100000:3.0:1777497778.459426:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1557 00000100:00100000:3.0:1777497778.459433:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+84:72987:x1863837546403968:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.459443:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.459457:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691ea20 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6ee expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459568:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459577:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459584:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459609:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459617:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459623:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459673:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691ea35 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459681:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691ea35 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459687:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691ea35 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497778.459697:0:73210:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x19:0x0]: returning size 0 00010000:00010000:3.0:1777497778.459787:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459795:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 2/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459802:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459807:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.459811:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459828:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459838:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497778.459840:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.459845:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 2/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459851:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079c00/0x3e357265691ea27 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459861:0:73210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459867:0:73210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459873:0:73210:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459878:0:73210:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.459881:0:73210:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459886:0:73210:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459892:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xb6f515a3 (ffff923f847c8400) 00010000:00010000:3.0:1777497778.459895:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.459897:0:73210:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459912:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691ea2e lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xb6f515a3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459962:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691ea20 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6ee expref: 87 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459974:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691ea35 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6ee expref: 86 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.459980:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:3.0:1777497778.459982:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497778.459984:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078200, rc 0) 00000100:00100000:1.0:1777497778.460006:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1558 00000100:00100000:1.0:1777497778.460017:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+86:72976:x1863837546404224:12345-192.168.202.4@tcp:36:dd.0 00000100:00100000:3.0:1777497778.460020:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+86:72987:x1863837546403968:12345-192.168.202.4@tcp:101:dd.0 Request processed in 589us (1559us total) trans 120259084389 rc 0/0 00000100:00100000:3.0:1777497778.460025:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1557 00010000:00010000:1.0:1777497778.460043:0:64885:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.460057:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691e9b7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6c4 expref: 85 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.460522:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:1.0:1777497778.460525:0:64885:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.460662:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.460674:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.460682:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.460724:0:64885:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084390 00000004:00010000:1.0:1777497778.460746:0:64885:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000c57a56f3 reply state 00000000ff6abc30 transno 120259084391 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.460759:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.460764:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:1.0:1777497778.460766:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.460768:0:64885:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.460905:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+87:72976:x1863837546404224:12345-192.168.202.4@tcp:36:dd.0 Request processed in 888us (2341us total) trans 120259084391 rc 0/0 00000100:00100000:1.0:1777497778.460912:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1558 00000020:00080000:1.0:1777497778.460926:0:64885:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777497778.461314:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403200 00000100:00100000:1.0:1777497778.461322:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403200 00002000:00010000:1.0:1777497778.461349:0:8403:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/871 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.461353:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2c000 with x1863837546403200 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.461361:0:8403:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2c000. 00000100:00100000:1.0:1777497778.461387:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1015 00000100:00100000:1.0:1777497778.461395:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+20:2412:x1863837546403200:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.461491:0:8403:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.461495:0:8403:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.461497:0:8403:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.461499:0:8403:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.461502:0:8403:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.461509:0:8403:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2c000 x1863837546403200/t4294969488(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.461538:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+21:2412:x1863837546403200:12345-192.168.202.4@tcp:10:dd.0 Request processed in 145us (7861us total) trans 4294969488 rc 0/0 00000100:00100000:1.0:1777497778.461545:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1015 00002000:00010000:1.0:1777497778.461547:0:8403:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/871 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.461550:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2c000 with x1863837546403200 ext(0->18446744073709551615) 00000100:00100000:0.0:1777497778.461550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00010000:1.0:1777497778.461555:0:8403:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2c000. 00000100:00100000:2.0:1777497778.461895:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546404352 00000100:00100000:2.0:1777497778.461900:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546404352 00000100:00100000:2.0:1777497778.461945:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 274 00000100:00100000:2.0:1777497778.461955:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+87:72974:x1863837546404352:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:2.0:1777497778.462134:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+88:72974:x1863837546404352:12345-192.168.202.4@tcp:35:dd.0 Request processed in 182us (583us total) trans 120259084392 rc 0/0 00000100:00100000:2.0:1777497778.462151:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 274 00000100:00100000:0.0:1777497778.464424:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.465749:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546404608 00000100:00100000:1.0:1777497778.465762:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546404608 00000100:00100000:1.0:1777497778.465865:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1559 00000100:00100000:1.0:1777497778.465875:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+88:72977:x1863837546404608:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1777497778.465949:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.465991:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079800/0x3e357265691ea04 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0xf:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6d9 expref: 88 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.466010:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:1.0:1777497778.466015:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.466209:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.466222:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.466231:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.466272:0:73210:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084393 00000004:00010000:1.0:1777497778.466503:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000e6a34494 reply state 00000000d7404f6d transno 120259084394 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.466515:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.466522:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:1.0:1777497778.466524:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.466527:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.466626:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+90:72977:x1863837546404608:12345-192.168.202.4@tcp:36:dd.0 Request processed in 751us (2209us total) trans 120259084394 rc 0/0 00000100:00100000:1.0:1777497778.466633:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1559 00000020:00080000:1.0:1777497778.466638:0:73210:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.468192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.468272:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.468301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.468336:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405120 00000100:00100000:3.0:1777497778.468344:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405120 00000100:00100000:3.0:1777497778.468384:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5937 00000100:00100000:3.0:1777497778.468393:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+21:72976:x1863837546405120:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.468407:0:25493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.468427:0:25493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691ea51 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6fc expref: -99 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.468451:0:25493:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36a:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.468471:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.468474:0:25493:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.468494:0:25493:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691ea51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6fc expref: 22 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.468512:0:25493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691ea51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6fc expref: 22 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.468525:0:25493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079400, rc 0) 00010000:00000080:3.0:1777497778.468532:0:25493:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f83cf2d80 x1863837546405120/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.468594:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+22:72976:x1863837546405120:12345-192.168.202.4@tcp:101:dd.0 Request processed in 203us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.468601:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5937 00000100:00100000:0.0:1777497778.468997:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.469331:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546404736 00000100:00100000:2.0:1777497778.469338:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546404736 00000100:00100000:2.0:1777497778.469624:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405376 00000100:00100000:2.0:1777497778.469629:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405376 00000100:00100000:0.0:1777497778.469824:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1560 00000100:00100000:0.0:1777497778.469836:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+91:72987:x1863837546404736:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.469856:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.469873:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691ea58 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c6f5 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497778.470106:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546404992 00000100:00100000:3.0:1777497778.470112:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546404992 00000100:00100000:3.0:1777497778.470142:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 275 00000100:00100000:3.0:1777497778.470149:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+92:72973:x1863837546404992:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.470397:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+93:72973:x1863837546404992:12345-192.168.202.4@tcp:35:dd.0 Request processed in 246us (1398us total) trans 120259084395 rc 0/0 00000100:00100000:3.0:1777497778.470404:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 275 00010000:00010000:0.0:1777497778.470513:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691ea5f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.470526:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691ea5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.470536:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691ea5f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.470609:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375c00/0x3e357265691ea58 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6f5 expref: 94 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.470625:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375000/0x3e357265691ea5f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6f5 expref: 93 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.470634:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:0.0:1777497778.470637:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.470640:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375000, rc 0) 00000100:00100000:0.0:1777497778.471149:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+93:72987:x1863837546404736:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1315us (2961us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.471157:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1560 00000100:00100000:0.0:1777497778.471181:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1561 00000100:00100000:0.0:1777497778.471192:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+92:72978:x1863837546405376:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.471203:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.471215:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ea66 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c703 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471326:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471338:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471346:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471362:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471370:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471376:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471423:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ea7b lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471431:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ea7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471437:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ea7b lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.471447:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x10:0x0]: returning size 0 00010000:00010000:0.0:1777497778.471514:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471521:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471533:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471539:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471545:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84374200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.471550:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471557:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471567:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.471570:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.471574:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471580:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374200/0x3e357265691ea6d lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471593:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471598:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471603:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471608:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84374800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.471616:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471622:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471629:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xc8545ca3 (ffff92409c15e100) 00010000:00010000:0.0:1777497778.471632:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.471634:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471639:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ea74 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xc8545ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471674:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ea66 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c703 expref: 95 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471685:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ea7b lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c703 expref: 94 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.471692:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:0.0:1777497778.471694:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.471696:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84375200, rc 0) 00000100:00100000:0.0:1777497778.471739:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f83cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+94:72978:x1863837546405376:12345-192.168.202.4@tcp:101:dd.0 Request processed in 551us (3437us total) trans 120259084396 rc 0/0 00000100:00100000:0.0:1777497778.471746:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1561 00000100:00100000:3.0:1777497778.472000:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.472389:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405632 00000100:00100000:0.0:1777497778.472397:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405632 00002000:00010000:0.0:1777497778.472422:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/874 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.472427:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240865b1500 with x1863837546405632 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.472442:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240865b1500. 00000100:00100000:0.0:1777497778.472472:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1016 00000100:00100000:0.0:1777497778.472480:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:2412:x1863837546405632:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:0.0:1777497778.472598:0:8401:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1777497778.472601:0:8401:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.472604:0:8401:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:0.0:1777497778.472605:0:8401:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.472608:0:8401:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1777497778.472616:0:8401:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240865b1500 x1863837546405632/t4294969489(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.472656:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+23:2412:x1863837546405632:12345-192.168.202.4@tcp:10:dd.0 Request processed in 178us (657us total) trans 4294969489 rc 0/0 00000100:00100000:0.0:1777497778.472662:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1016 00002000:00010000:0.0:1777497778.472666:0:8401:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/874 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.472668:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240865b1500 with x1863837546405632 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.472672:0:8401:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240865b1500. 00000100:00100000:3.0:1777497778.474871:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.474912:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405504 00000100:00100000:2.0:1777497778.474921:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405504 00000100:00100000:2.0:1777497778.474981:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5938 00000100:00100000:2.0:1777497778.474991:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+23:72977:x1863837546405504:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.477564:0:25486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.477604:0:25486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691ea89 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c70a expref: -99 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497778.477638:0:25486:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36b:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:2.0:1777497778.477668:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.477670:0:25486:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.477690:0:25486:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691ea89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c70a expref: 24 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.477708:0:25486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691ea89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c70a expref: 24 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.477721:0:25486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39200, rc 0) 00010000:00000080:2.0:1777497778.477728:0:25486:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbed80 x1863837546405504/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.477797:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+24:72977:x1863837546405504:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2807us (2931us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.477820:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5938 00000100:00100000:2.0:1777497778.480029:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.480192:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406144 00000100:00100000:3.0:1777497778.480201:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406144 00000100:00100000:3.0:1777497778.480249:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1562 00000100:00100000:3.0:1777497778.480259:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+94:72987:x1863837546406144:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:3.0:1777497778.480316:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497778.480356:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691ea35 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x19:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6ee expref: 94 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.480373:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:3.0:1777497778.480378:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497778.480540:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.480554:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.480564:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1777497778.480607:0:65418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084397 00000004:00010000:3.0:1777497778.480627:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000059d0671a reply state 00000000e5d56d29 transno 120259084398 ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.480639:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.480645:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:3.0:1777497778.480648:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1777497778.480650:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1777497778.480813:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+96:72987:x1863837546406144:12345-192.168.202.4@tcp:36:dd.0 Request processed in 556us (792us total) trans 120259084398 rc 0/0 00000100:00100000:3.0:1777497778.480820:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1562 00000020:00080000:3.0:1777497778.480825:0:65418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.482658:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.482736:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.482770:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.482831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.482862:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406400 00000100:00100000:0.0:1777497778.482869:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406400 00000100:00100000:0.0:1777497778.482922:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406656 00000100:00100000:0.0:1777497778.482926:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406656 00000100:00100000:0.0:1777497778.482956:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1563 00000100:00100000:0.0:1777497778.482964:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+97:72979:x1863837546406400:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.483005:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.483025:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ea97 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c711 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483177:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483192:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483204:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483218:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483224:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483231:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483287:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eaac lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483295:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eaac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483302:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eaac lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.483312:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x11:0x0]: returning size 0 00010000:00010000:0.0:1777497778.483394:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483401:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483406:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483412:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483417:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df8c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.483421:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483426:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483436:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.483439:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.483443:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483448:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691ea9e lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483460:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483464:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483468:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483480:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.483483:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483488:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483494:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x220d5ca3 (ffff9240812e3c00) 00010000:00010000:0.0:1777497778.483496:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.483498:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483503:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eaa5 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x220d5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483559:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ea97 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c711 expref: 100 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483572:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eaac lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c711 expref: 99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483578:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:0.0:1777497778.483580:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.483582:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8a00, rc 0) 00000100:00100000:0.0:1777497778.483632:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+99:72979:x1863837546406400:12345-192.168.202.4@tcp:101:dd.0 Request processed in 670us (897us total) trans 120259084399 rc 0/0 00000100:00100000:0.0:1777497778.483639:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1563 00000100:00100000:0.0:1777497778.483662:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1564 00000100:00100000:0.0:1777497778.483675:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+98:72978:x1863837546406656:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.483685:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.483695:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eaba lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c718 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483713:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8e00/0x3e357265691eac1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483722:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8e00/0x3e357265691eac1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483730:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8e00/0x3e357265691eac1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483795:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eaba lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c718 expref: 100 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483806:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8e00/0x3e357265691eac1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c718 expref: 99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.483812:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:0.0:1777497778.483814:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.483816:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8e00, rc 0) 00000100:00100000:0.0:1777497778.483846:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+99:72978:x1863837546406656:12345-192.168.202.4@tcp:101:dd.0 Request processed in 173us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.483851:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1564 00000100:00100000:2.0:1777497778.484414:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406528 00000100:00100000:2.0:1777497778.484421:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406528 00002000:00010000:2.0:1777497778.484446:0:24903:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/875 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.484450:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff924089387800 with x1863837546406528 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.484459:0:24903:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924089387800. 00000100:00100000:2.0:1777497778.484484:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1017 00000100:00100000:2.0:1777497778.484492:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+24:2415:x1863837546406528:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497778.484612:0:24903:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777497778.484616:0:24903:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.484618:0:24903:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:2.0:1777497778.484620:0:24903:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.484622:0:24903:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1777497778.484630:0:24903:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff924089387800 x1863837546406528/t4294969490(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.484671:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+25:2415:x1863837546406528:12345-192.168.202.4@tcp:10:dd.0 Request processed in 181us (1901us total) trans 4294969490 rc 0/0 00000100:00100000:2.0:1777497778.484692:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1017 00002000:00010000:2.0:1777497778.484695:0:24903:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/875 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.484698:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff924089387800 with x1863837546406528 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.484703:0:24903:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff924089387800. 00000100:00100000:3.0:1777497778.485467:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405888 00000100:00100000:3.0:1777497778.485475:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405888 00000100:00100000:3.0:1777497778.485538:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 276 00000100:00100000:3.0:1777497778.485546:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+99:72976:x1863837546405888:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.485766:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+100:72976:x1863837546405888:12345-192.168.202.4@tcp:35:dd.0 Request processed in 220us (3116us total) trans 120259084400 rc 0/0 00000100:00100000:3.0:1777497778.485773:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 276 00000100:00100000:0.0:1777497778.485870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.485900:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406784 00000100:00100000:0.0:1777497778.485904:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406784 00000100:00100000:0.0:1777497778.485946:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5939 00000100:00100000:0.0:1777497778.485952:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+25:72987:x1863837546406784:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.485961:0:25491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.485976:0:25491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8a1db41/0x3e357265691eac8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c71f expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.485994:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x375:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.486008:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.486010:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.486017:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8a1db41/0x3e357265691eac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c71f expref: 26 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.486032:0:25491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8a1db41/0x3e357265691eac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c71f expref: 26 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.486043:0:25491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df9800, rc 0) 00010000:00000080:0.0:1777497778.486049:0:25491:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409094ce00 x1863837546406784/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.486073:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409094ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+26:72987:x1863837546406784:12345-192.168.202.4@tcp:101:dd.0 Request processed in 122us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.486078:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5939 00000100:00100000:2.0:1777497778.490971:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.491057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.493564:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.497007:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407040 00000100:00100000:1.0:1777497778.497021:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407040 00000100:00100000:0.0:1777497778.497584:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1565 00000100:00100000:0.0:1777497778.497597:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+100:72978:x1863837546407040:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.497656:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.497749:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ea7b lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c703 expref: 100 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.497786:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:0.0:1777497778.497791:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1777497778.497885:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.497914:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407680 00000100:00100000:2.0:1777497778.497919:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407680 00002000:00100000:2.0:1777497778.497963:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x362:0x0] (0->1023) req@ffff9240866fc700 x1863837546407680/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.497973:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fc700 with x1863837546407680 ext(0->1023) 00002000:00010000:2.0:1777497778.497977:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fc700 00010000:00010000:0.0:1777497778.497988:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497778.497997:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1018 00010000:00010000:0.0:1777497778.498002:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497778.498004:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+26:2415:x1863837546407680:12345-192.168.202.4@tcp:4:dd.0 00010000:00010000:0.0:1777497778.498013:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.498054:0:73210:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084401 00000004:00010000:0.0:1777497778.498075:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000500dd209 reply state 00000000dbae1f84 transno 120259084402 ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.498086:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.498091:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:0.0:1777497778.498112:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.498114:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497778.498194:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+102:72978:x1863837546407040:12345-192.168.202.4@tcp:36:dd.0 Request processed in 600us (7231us total) trans 120259084402 rc 0/0 00000100:00100000:0.0:1777497778.498201:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1565 00000020:00080000:0.0:1777497778.498206:0:73210:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.498222:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407168 00000100:00100000:0.0:1777497778.498226:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407168 00010000:00000080:2.0:1777497778.500022:0:24904:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fc700 x1863837546407680/t4294969491(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.500225:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407424 00000100:00100000:0.0:1777497778.500232:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407424 00000100:00100000:0.0:1777497778.500273:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1566 00000100:00100000:0.0:1777497778.500307:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+103:72979:x1863837546407168:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.500325:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.500343:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691ead6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c726 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500372:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8400/0x3e357265691eadd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500385:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8400/0x3e357265691eadd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500395:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8400/0x3e357265691eadd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500484:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691ead6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c726 expref: 105 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500502:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8400/0x3e357265691eadd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c726 expref: 104 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.500509:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:0.0:1777497778.500512:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.500515:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8400, rc 0) 00000100:00100000:3.0:1777497778.500659:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1567 00000100:00100000:3.0:1777497778.500669:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+104:72980:x1863837546407424:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.500689:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.500701:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691eae4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c72d expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500802:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500811:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500819:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500833:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500839:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500846:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500889:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691eaf9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500909:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691eaf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.500917:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691eaf9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1777497778.500927:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x12:0x0]: returning size 0 00010000:00010000:3.0:1777497778.501008:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501015:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501021:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501027:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501033:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099078600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.501037:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501044:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501052:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:3.0:1777497778.501055:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.501058:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501065:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078600/0x3e357265691eaeb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501081:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501088:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501110:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501117:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079e00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:3.0:1777497778.501119:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501126:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501133:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x7bc65ca3 (ffff923f847c8400) 00010000:00010000:3.0:1777497778.501135:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1777497778.501138:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501144:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079e00/0x3e357265691eaf2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x7bc65ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501177:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078200/0x3e357265691eae4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c72d expref: 107 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501189:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691eaf9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c72d expref: 106 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.501207:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:3.0:1777497778.501209:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1777497778.501212:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078e00, rc 0) 00000100:00100000:0.0:1777497778.503135:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+106:72979:x1863837546407168:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2833us (12068us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.503146:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1566 00000100:00100000:3.0:1777497778.503274:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+105:72980:x1863837546407424:12345-192.168.202.4@tcp:101:dd.0 Request processed in 2606us (9716us total) trans 120259084403 rc 0/0 00000100:00100000:3.0:1777497778.503283:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1567 00000100:00100000:2.0:1777497778.503437:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+28:2415:x1863837546407680:12345-192.168.202.4@tcp:4:dd.0 Request processed in 5431us (5551us total) trans 4294969491 rc 0/0 00000100:00100000:2.0:1777497778.503447:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1018 00002000:00100000:2.0:1777497778.503459:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x362:0x0] (0->1023) req@ffff9240866fc700 x1863837546407680/t4294969491(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.503470:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fc700 with x1863837546407680 ext(0->1023) 00002000:00010000:2.0:1777497778.503474:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fc700 00000100:00100000:1.0:1777497778.503557:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.503638:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.503704:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.503909:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408064 00000100:00100000:3.0:1777497778.503917:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408064 00000100:00100000:3.0:1777497778.503980:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 277 00000100:00100000:3.0:1777497778.503989:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+105:72977:x1863837546408064:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.504412:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086ea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+106:72977:x1863837546408064:12345-192.168.202.4@tcp:35:dd.0 Request processed in 421us (705us total) trans 120259084404 rc 0/0 00000100:00100000:3.0:1777497778.504419:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 277 00000100:00100000:0.0:1777497778.504609:0:24914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407552 00000100:00100000:0.0:1777497778.504615:0:24914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407552 00002000:00010000:0.0:1777497778.504634:0:24914:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/885 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.504647:0:24914:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc8ca80 with x1863837546407552 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.504658:0:24914:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc8ca80. 00000100:00100000:2.0:1777497778.505308:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407808 00000100:00100000:2.0:1777497778.505314:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407808 00000100:00100000:2.0:1777497778.505523:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5940 00000100:00100000:2.0:1777497778.505533:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+29:2414:x1863837546407808:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:2.0:1777497778.505791:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969491 is committed 00010000:00000080:2.0:1777497778.505853:0:8397:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f839ffb80 x1863837546407808/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.505915:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f839ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+17:2414:x1863837546407808:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 383us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.505921:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5940 00000100:00100000:0.0:1777497778.509603:0:24914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1019 00000100:00100000:0.0:1777497778.509628:0:24914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+16:2414:x1863837546407552:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:0.0:1777497778.509944:0:24914:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1777497778.509948:0:24914:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.509951:0:24914:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:0.0:1777497778.509953:0:24914:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.509955:0:24914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1777497778.509965:0:24914:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc8ca80 x1863837546407552/t4294969492(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.510116:0:24914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+17:2414:x1863837546407552:12345-192.168.202.4@tcp:10:dd.0 Request processed in 483us (6541us total) trans 4294969492 rc 0/0 00000100:00100000:0.0:1777497778.510125:0:24914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1019 00002000:00010000:0.0:1777497778.510130:0:24914:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/885 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.510133:0:24914:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc8ca80 with x1863837546407552 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.510140:0:24914:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc8ca80. 00000100:00100000:1.0:1777497778.511022:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.511055:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.511061:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408320 00000100:00100000:0.0:1777497778.511069:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408320 00000100:00100000:0.0:1777497778.511148:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1568 00000100:00100000:0.0:1777497778.511157:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+106:72979:x1863837546408320:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.511206:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.511232:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eaac lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c711 expref: 106 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.511263:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:0.0:1777497778.511268:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.511413:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.511427:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.511437:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.511480:0:63729:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084405 00000004:00010000:0.0:1777497778.511501:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000508f601b reply state 0000000001405a27 transno 120259084406 ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.511513:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.511520:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:0.0:1777497778.511522:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.511524:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.511526:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.511561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.511612:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408448 00000100:00100000:2.0:1777497778.511617:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408448 00000100:00100000:2.0:1777497778.511627:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408576 00000100:00100000:2.0:1777497778.511629:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408576 00000100:00100000:2.0:1777497778.511664:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5941 00000100:00100000:0.0:1777497778.511664:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924088f84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+109:72979:x1863837546408320:12345-192.168.202.4@tcp:36:dd.0 Request processed in 508us (645us total) trans 120259084406 rc 0/0 00000100:00100000:0.0:1777497778.511671:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1568 00000100:00100000:2.0:1777497778.511672:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+17:72978:x1863837546408576:12345-192.168.202.4@tcp:101:dd.0 00000020:00080000:0.0:1777497778.511675:0:63729:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1777497778.511693:0:25488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.511709:0:25488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691eb0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c73b expref: -99 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497778.511728:0:25488:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36c:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:2.0:1777497778.511742:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.511744:0:25488:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.511750:0:25488:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691eb0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c73b expref: 18 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.511763:0:25488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691eb0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c73b expref: 18 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.511774:0:25488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d39000, rc 0) 00010000:00000080:2.0:1777497778.511780:0:25488:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc06300 x1863837546408576/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.511939:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408832 00000100:00100000:0.0:1777497778.511943:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408832 00000100:00100000:2.0:1777497778.511990:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+18:72978:x1863837546408576:12345-192.168.202.4@tcp:101:dd.0 Request processed in 319us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.512002:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5941 00000100:00100000:0.0:1777497778.512054:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1569 00000100:00100000:0.0:1777497778.512061:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+109:72981:x1863837546408832:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.512234:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.512245:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb15 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c742 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512335:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512345:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512353:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512364:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512370:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512375:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512411:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9e00/0x3e357265691eb2a lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512421:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9e00/0x3e357265691eb2a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512427:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9e00/0x3e357265691eb2a lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.512436:0:63729:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x13:0x0]: returning size 0 00010000:00010000:0.0:1777497778.512495:0:63729:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512502:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512508:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512514:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512519:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.512523:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512530:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512540:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.512542:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.512545:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512551:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb1c lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512562:0:63729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512567:0:63729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512572:0:63729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512584:0:63729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df8800 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.512587:0:63729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512592:0:63729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512599:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xd57f5ca3 (ffff9240812e3c00) 00010000:00010000:0.0:1777497778.512601:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.512603:0:63729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512608:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb23 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xd57f5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512638:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb15 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c742 expref: 112 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512649:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9e00/0x3e357265691eb2a lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c742 expref: 111 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.512655:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:0.0:1777497778.512657:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.512659:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df9e00, rc 0) 00000100:00100000:0.0:1777497778.513472:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+111:72981:x1863837546408832:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1408us (1907us total) trans 120259084407 rc 0/0 00000100:00100000:0.0:1777497778.513480:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1569 00000100:00100000:0.0:1777497778.513506:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1570 00000100:00100000:0.0:1777497778.513525:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+110:72980:x1863837546408448:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.513537:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.513548:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8600/0x3e357265691eb38 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c734 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513569:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eb3f lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513579:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eb3f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513588:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eb3f lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513665:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8600/0x3e357265691eb38 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c734 expref: 112 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513680:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8200/0x3e357265691eb3f lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c734 expref: 111 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.513687:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:0.0:1777497778.513689:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.513692:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8200, rc 0) 00000100:00100000:0.0:1777497778.513870:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+111:72980:x1863837546408448:12345-192.168.202.4@tcp:101:dd.0 Request processed in 348us (2814us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.513876:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1570 00000100:00100000:3.0:1777497778.522950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.523248:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408960 00000100:00100000:2.0:1777497778.523258:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408960 00002000:00100000:2.0:1777497778.523306:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x363:0x0] (0->1023) req@ffff9240b5bbe680 x1863837546408960/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.523317:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbe680 with x1863837546408960 ext(0->1023) 00002000:00010000:2.0:1777497778.523322:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbe680 00000100:00100000:2.0:1777497778.523356:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1020 00000100:00100000:2.0:1777497778.523365:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+18:2414:x1863837546408960:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.523742:0:24910:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbe680 x1863837546408960/t4294969493(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.524020:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+20:2414:x1863837546408960:12345-192.168.202.4@tcp:4:dd.0 Request processed in 654us (1089us total) trans 4294969493 rc 0/0 00000100:00100000:2.0:1777497778.524028:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1020 00002000:00100000:2.0:1777497778.524035:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x363:0x0] (0->1023) req@ffff9240b5bbe680 x1863837546408960/t4294969493(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.524044:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbe680 with x1863837546408960 ext(0->1023) 00002000:00010000:2.0:1777497778.524048:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbe680 00000100:00100000:2.0:1777497778.526051:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.526085:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.526142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.526176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.526208:0:66634:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409472 00000100:00100000:2.0:1777497778.526217:0:66634:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409472 00000100:00100000:2.0:1777497778.526278:0:66634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 278 00000100:00100000:2.0:1777497778.526287:0:66634:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+111:72987:x1863837546409472:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:2.0:1777497778.526550:0:66634:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:d146155b-4321-4b14-9284-f644ed9631fb+112:72987:x1863837546409472:12345-192.168.202.4@tcp:35:dd.0 Request processed in 263us (372us total) trans 120259084408 rc 0/0 00000100:00100000:2.0:1777497778.526558:0:66634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 278 00000100:00100000:0.0:1777497778.526712:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409088 00000100:00100000:0.0:1777497778.526717:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409088 00000100:00100000:0.0:1777497778.526752:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409600 00000100:00100000:0.0:1777497778.526762:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409600 00000100:00100000:0.0:1777497778.526789:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5942 00000100:00100000:0.0:1777497778.526796:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+21:2414:x1863837546409088:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:0.0:1777497778.527018:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5943 00000100:00100000:0.0:1777497778.527026:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+21:72979:x1863837546409600:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.527037:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.527054:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7729689/0x3e357265691eb46 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c749 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497778.527074:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36d:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:0.0:1777497778.527113:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.527116:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1777497778.527124:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7729689/0x3e357265691eb46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c749 expref: 22 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.527143:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e7729689/0x3e357265691eb46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c749 expref: 22 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.527156:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8600, rc 0) 00010000:00000080:0.0:1777497778.527164:0:8396:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fe300 x1863837546409600/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.527198:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:72979:x1863837546409600:12345-192.168.202.4@tcp:101:dd.0 Request processed in 174us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.527204:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5943 00000001:00080000:0.0:1777497778.527265:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969493 is committed 00010000:00000080:0.0:1777497778.527303:0:8717:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fca80 x1863837546409088/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.527331:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+18:2414:x1863837546409088:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 537us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.527338:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5942 00000100:00100000:1.0:1777497778.527905:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409216 00000100:00100000:1.0:1777497778.527912:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409216 00002000:00010000:1.0:1777497778.527947:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/876 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.527951:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fea00 with x1863837546409216 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.527961:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fea00. 00000100:00100000:1.0:1777497778.527989:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1021 00000100:00100000:1.0:1777497778.527997:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+18:2413:x1863837546409216:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.528174:0:24902:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.528178:0:24902:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.528180:0:24902:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.528182:0:24902:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.528184:0:24902:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.528191:0:24902:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fea00 x1863837546409216/t4294969494(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.528235:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+19:2413:x1863837546409216:12345-192.168.202.4@tcp:10:dd.0 Request processed in 239us (2149us total) trans 4294969494 rc 0/0 00000100:00100000:1.0:1777497778.528241:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1021 00002000:00010000:1.0:1777497778.528245:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/876 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.528248:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fea00 with x1863837546409216 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.528254:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fea00. 00000100:00100000:2.0:1777497778.528820:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.528902:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409728 00000100:00100000:1.0:1777497778.528919:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409728 00000100:00100000:1.0:1777497778.528993:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1571 00000100:00100000:1.0:1777497778.529000:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+112:72981:x1863837546409728:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.529016:0:63727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.529032:0:63727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691eb4d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c750 expref: -99 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529063:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691eb54 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529078:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691eb54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529090:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691eb54 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529221:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691eb4d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c750 expref: 114 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529240:0:63727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150b600/0x3e357265691eb54 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c750 expref: 113 pid: 63727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.529249:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:1.0:1777497778.529252:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777497778.529255:0:63727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff92408150b600, rc 0) 00000100:00100000:1.0:1777497778.529299:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+113:72981:x1863837546409728:12345-192.168.202.4@tcp:101:dd.0 Request processed in 299us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.529305:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1571 00000100:00100000:2.0:1777497778.538519:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.538600:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.538623:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.538713:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410368 00000100:00100000:3.0:1777497778.538724:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410368 00002000:00100000:3.0:1777497778.538774:0:25314:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x364:0x0] (0->1023) req@ffff9240866fdc00 x1863837546410368/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.538786:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fdc00 with x1863837546410368 ext(0->1023) 00002000:00010000:3.0:1777497778.538791:0:25314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fdc00 00000100:00100000:3.0:1777497778.538825:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1022 00000100:00100000:3.0:1777497778.538835:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+19:2415:x1863837546410368:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:3.0:1777497778.539241:0:25314:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fdc00 x1863837546410368/t4294969495(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.539312:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+21:2415:x1863837546410368:12345-192.168.202.4@tcp:4:dd.0 Request processed in 479us (711us total) trans 4294969495 rc 0/0 00000100:00100000:3.0:1777497778.539321:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1022 00002000:00100000:3.0:1777497778.539329:0:25314:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x364:0x0] (0->1023) req@ffff9240866fdc00 x1863837546410368/t4294969495(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.539337:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fdc00 with x1863837546410368 ext(0->1023) 00002000:00010000:3.0:1777497778.539341:0:25314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fdc00 00000100:00100000:2.0:1777497778.540244:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.540270:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.540290:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410624 00000100:00100000:2.0:1777497778.540296:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410624 00002000:00010000:2.0:1777497778.540323:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/877 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.540327:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866ffb80 with x1863837546410624 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.540337:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866ffb80. 00000100:00100000:2.0:1777497778.540356:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1023 00000100:00100000:2.0:1777497778.540364:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+21:2414:x1863837546410624:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497778.540463:0:24168:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777497778.540467:0:24168:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.540470:0:24168:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:2.0:1777497778.540472:0:24168:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.540474:0:24168:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1777497778.540481:0:24168:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866ffb80 x1863837546410624/t4294969496(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.540521:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546410624:12345-192.168.202.4@tcp:10:dd.0 Request processed in 159us (251us total) trans 4294969496 rc 0/0 00000100:00100000:2.0:1777497778.540539:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1023 00002000:00010000:2.0:1777497778.540543:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/877 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.540545:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866ffb80 with x1863837546410624 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.540550:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866ffb80. 00000100:00100000:2.0:1777497778.540586:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.540625:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410496 00000100:00100000:0.0:1777497778.540629:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410496 00000100:00100000:0.0:1777497778.540662:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5944 00000100:00100000:0.0:1777497778.540669:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546410496:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:0.0:1777497778.540910:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969496 is committed 00010000:00000080:0.0:1777497778.540955:0:25494:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fce00 x1863837546410496/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.540983:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+18:2414:x1863837546410496:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 316us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.540989:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5944 00000100:00100000:1.0:1777497778.542299:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410240 00000100:00100000:1.0:1777497778.542324:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410240 00000100:00100000:0.0:1777497778.542455:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409984 00000100:00100000:0.0:1777497778.542461:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409984 00000100:00100000:0.0:1777497778.542490:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1572 00000100:00100000:0.0:1777497778.542499:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+114:72980:x1863837546410240:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.542556:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.542581:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099078e00/0x3e357265691eaf9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x12:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c72d expref: 114 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.542600:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:0.0:1777497778.542604:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.542775:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.542801:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.542811:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.542856:0:63728:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084409 00000004:00010000:0.0:1777497778.542878:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000089e62e3a reply state 00000000fee30488 transno 120259084410 ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.542889:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.542895:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:0.0:1777497778.542897:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.542900:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497778.542990:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+116:72980:x1863837546410240:12345-192.168.202.4@tcp:36:dd.0 Request processed in 491us (4479us total) trans 120259084410 rc 0/0 00000100:00100000:0.0:1777497778.542997:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1572 00000020:00080000:0.0:1777497778.543003:0:63728:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.543026:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1573 00000100:00100000:0.0:1777497778.543032:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+115:72982:x1863837546409984:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.543041:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.543052:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb62 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c757 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543174:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543194:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543201:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543217:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543224:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543229:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543270:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691eb77 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543277:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691eb77 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543283:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691eb77 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.543291:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x14:0x0]: returning size 0 00010000:00010000:0.0:1777497778.543338:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543345:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543351:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543364:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543370:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.543374:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543381:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543389:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.543392:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.543395:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543401:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9600/0x3e357265691eb69 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543411:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543417:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543422:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543427:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df8a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.543429:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543447:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543455:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x2f385ca3 (ffff9240812e3c00) 00010000:00010000:0.0:1777497778.543457:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.543460:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543464:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8a00/0x3e357265691eb70 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x2f385ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543498:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8800/0x3e357265691eb62 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c757 expref: 118 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543510:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691eb77 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c757 expref: 117 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.543516:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:0.0:1777497778.543518:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.543521:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df9000, rc 0) 00000100:00100000:0.0:1777497778.543546:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+117:72982:x1863837546409984:12345-192.168.202.4@tcp:101:dd.0 Request processed in 514us (4922us total) trans 120259084411 rc 0/0 00000100:00100000:0.0:1777497778.543553:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1573 00000100:00100000:2.0:1777497778.546450:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.546539:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411136 00000100:00100000:3.0:1777497778.546551:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411136 00000100:00100000:3.0:1777497778.546607:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 279 00000100:00100000:3.0:1777497778.546617:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+117:72978:x1863837546411136:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.549653:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.549761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.549988:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+118:72978:x1863837546411136:12345-192.168.202.4@tcp:35:dd.0 Request processed in 3371us (3549us total) trans 120259084412 rc 0/0 00000100:00100000:2.0:1777497778.550000:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 279 00000100:00100000:3.0:1777497778.550219:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.550980:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.551004:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.551032:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411392 00000100:00100000:2.0:1777497778.551041:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411392 00002000:00100000:2.0:1777497778.551129:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x365:0x0] (0->1023) req@ffff9240b5bbc000 x1863837546411392/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.551140:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbc000 with x1863837546411392 ext(0->1023) 00002000:00010000:2.0:1777497778.551146:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbc000 00000100:00100000:2.0:1777497778.551168:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1024 00000100:00100000:2.0:1777497778.551177:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+18:2415:x1863837546411392:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.551559:0:24904:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbc000 x1863837546411392/t4294969497(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.551610:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+20:2415:x1863837546411392:12345-192.168.202.4@tcp:4:dd.0 Request processed in 435us (1391us total) trans 4294969497 rc 0/0 00000100:00100000:2.0:1777497778.551616:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1024 00002000:00100000:2.0:1777497778.551622:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x365:0x0] (0->1023) req@ffff9240b5bbc000 x1863837546411392/t4294969497(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.551643:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbc000 with x1863837546411392 ext(0->1023) 00002000:00010000:2.0:1777497778.551647:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbc000 00000100:00100000:3.0:1777497778.551843:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411264 00000100:00100000:3.0:1777497778.551849:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411264 00000100:00100000:3.0:1777497778.551885:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411520 00000100:00100000:3.0:1777497778.551888:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411520 00000100:00100000:3.0:1777497778.551907:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5945 00000100:00100000:3.0:1777497778.551914:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+21:72980:x1863837546411264:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.551925:0:23437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.551955:0:23437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691eb85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c75e expref: -99 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.551981:0:23437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36e:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.551999:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.552008:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.552015:0:23437:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691eb85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c75e expref: 22 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.552032:0:23437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691eb85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c75e expref: 22 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.552043:0:23437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079c00, rc 0) 00010000:00000080:3.0:1777497778.552048:0:23437:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbce00 x1863837546411264/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.552080:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+22:72980:x1863837546411264:12345-192.168.202.4@tcp:101:dd.0 Request processed in 166us (2436us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.552086:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5945 00000100:00100000:3.0:1777497778.552127:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5946 00000100:00100000:3.0:1777497778.552134:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+21:2415:x1863837546411520:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:0.0:1777497778.552614:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410880 00000100:00100000:0.0:1777497778.552620:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410880 00000100:00100000:0.0:1777497778.552850:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411776 00000100:00100000:0.0:1777497778.552855:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411776 00000100:00100000:0.0:1777497778.552877:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1574 00000100:00100000:0.0:1777497778.552971:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+119:72981:x1863837546410880:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.553026:0:63728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.553051:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9e00/0x3e357265691eb2a lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x13:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c742 expref: 119 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.553069:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:0.0:1777497778.553074:0:63728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.553272:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.553286:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.553541:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.553590:0:63728:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084413 00000004:00010000:0.0:1777497778.553613:0:63728:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000003d9e92c4 reply state 00000000aad5acfb transno 120259084414 ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.553624:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.553630:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:0.0:1777497778.553632:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.553635:0:63728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1777497778.553715:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+121:72981:x1863837546410880:12345-192.168.202.4@tcp:36:dd.0 Request processed in 829us (13126us total) trans 120259084414 rc 0/0 00000100:00100000:0.0:1777497778.553721:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1574 00000020:00080000:0.0:1777497778.553726:0:63728:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.553747:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1575 00000100:00100000:0.0:1777497778.553765:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+120:72983:x1863837546411776:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.553776:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.553788:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9200/0x3e357265691eb93 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c765 expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1777497778.554053:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969497 is committed 00010000:00000080:2.0:1777497778.554114:0:23437:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc07800 x1863837546411520/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.554144:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:2415:x1863837546411520:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 2011us (3166us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.554152:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5946 00010000:00010000:0.0:1777497778.554728:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554742:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554752:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554769:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554775:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554781:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554835:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691eba8 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554843:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691eba8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554850:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691eba8 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1777497778.554875:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x15:0x0]: returning size 0 00010000:00010000:0.0:1777497778.554967:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554974:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554979:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554985:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.554991:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.554995:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555002:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555012:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:0.0:1777497778.555015:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.555019:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555026:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9a00/0x3e357265691eb9a lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555038:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555044:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555057:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555062:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:0.0:1777497778.555065:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555071:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555079:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x88f15ca3 (ffff9240812e3a00) 00010000:00010000:0.0:1777497778.555081:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1777497778.555084:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555090:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691eba1 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x88f15ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555158:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9200/0x3e357265691eb93 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c765 expref: 123 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555171:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691eba8 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c765 expref: 122 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.555178:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:0.0:1777497778.555180:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1777497778.555183:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374e00, rc 0) 00000100:00100000:0.0:1777497778.555229:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+122:72983:x1863837546411776:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1467us (5468us total) trans 120259084415 rc 0/0 00000100:00100000:0.0:1777497778.555246:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1575 00000100:00100000:0.0:1777497778.556189:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411904 00000100:00100000:0.0:1777497778.556200:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411904 00000100:00100000:0.0:1777497778.556254:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1576 00000100:00100000:0.0:1777497778.556264:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+122:72982:x1863837546411904:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.556280:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.556363:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ebb6 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c76c expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556390:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ebbd lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556400:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ebbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556409:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ebbd lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556499:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ebb6 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c76c expref: 124 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556513:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374800/0x3e357265691ebbd lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c76c expref: 123 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.556519:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:0.0:1777497778.556522:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.556525:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374800, rc 0) 00000100:00100000:0.0:1777497778.556664:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+123:72982:x1863837546411904:12345-192.168.202.4@tcp:101:dd.0 Request processed in 402us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.556676:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1576 00000100:00100000:0.0:1777497778.557764:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.557903:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.557945:0:24914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412288 00000100:00100000:0.0:1777497778.557953:0:24914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412288 00002000:00010000:0.0:1777497778.557988:0:24914:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/878 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.557993:0:24914:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f86068700 with x1863837546412288 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.558004:0:24914:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f86068700. 00000100:00100000:0.0:1777497778.558027:0:24914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1025 00000100:00100000:0.0:1777497778.558036:0:24914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+19:2414:x1863837546412288:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:0.0:1777497778.558214:0:24914:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1777497778.558218:0:24914:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.558221:0:24914:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:0.0:1777497778.558223:0:24914:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.558226:0:24914:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1777497778.558234:0:24914:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f86068700 x1863837546412288/t4294969498(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.558278:0:24914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+20:2414:x1863837546412288:12345-192.168.202.4@tcp:10:dd.0 Request processed in 244us (375us total) trans 4294969498 rc 0/0 00000100:00100000:0.0:1777497778.558285:0:24914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1025 00002000:00010000:0.0:1777497778.558300:0:24914:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/878 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.558302:0:24914:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff923f86068700 with x1863837546412288 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.558307:0:24914:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff923f86068700. 00000100:00100000:1.0:1777497778.558691:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412160 00000100:00100000:1.0:1777497778.558697:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412160 00000100:00100000:1.0:1777497778.558739:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:1.0:1777497778.558747:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+123:72979:x1863837546412160:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:1.0:1777497778.559076:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+124:72979:x1863837546412160:12345-192.168.202.4@tcp:35:dd.0 Request processed in 329us (1318us total) trans 120259084416 rc 0/0 00000100:00100000:1.0:1777497778.559084:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 280 00000100:00100000:2.0:1777497778.564511:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.564550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.564573:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412416 00000100:00100000:2.0:1777497778.564582:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412416 00002000:00100000:2.0:1777497778.564628:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x366:0x0] (0->1023) req@ffff9240866fc380 x1863837546412416/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.564640:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fc380 with x1863837546412416 ext(0->1023) 00002000:00010000:2.0:1777497778.564645:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fc380 00000100:00100000:2.0:1777497778.564667:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1026 00000100:00100000:2.0:1777497778.564676:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+20:2414:x1863837546412416:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.565036:0:24910:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fc380 x1863837546412416/t4294969499(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.565090:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546412416:12345-192.168.202.4@tcp:4:dd.0 Request processed in 415us (538us total) trans 4294969499 rc 0/0 00000100:00100000:2.0:1777497778.565120:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1026 00002000:00100000:2.0:1777497778.565127:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x366:0x0] (0->1023) req@ffff9240866fc380 x1863837546412416/t4294969499(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.565141:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240866fc380 with x1863837546412416 ext(0->1023) 00002000:00010000:2.0:1777497778.565145:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240866fc380 00000100:00100000:2.0:1777497778.565184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.565273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.565295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.565315:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412928 00000100:00100000:2.0:1777497778.565319:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412928 00000100:00100000:2.0:1777497778.565343:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413056 00000100:00100000:2.0:1777497778.565346:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413056 00000100:00100000:2.0:1777497778.565367:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1577 00000100:00100000:2.0:1777497778.565373:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+125:72984:x1863837546412928:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.565391:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.565411:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691ebc4 lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c77a expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565528:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565544:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565556:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565570:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565577:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565590:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565648:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691ebd9 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565657:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691ebd9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565664:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691ebd9 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1777497778.565675:0:65418:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x16:0x0]: returning size 0 00010000:00010000:2.0:1777497778.565736:0:65418:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565744:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565750:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565757:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565763:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d38200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.565767:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565775:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565796:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:2.0:1777497778.565799:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.565803:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565809:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38200/0x3e357265691ebcb lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565823:0:65418:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565828:0:65418:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565833:0:65418:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565838:0:65418:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497778.565840:0:65418:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565845:0:65418:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565851:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0xe2aa5ca3 (ffff923f85215100) 00010000:00010000:2.0:1777497778.565853:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497778.565855:0:65418:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565860:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39600/0x3e357265691ebd2 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0xe2aa5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565938:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38a00/0x3e357265691ebc4 lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c77a expref: 128 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565952:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691ebd9 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c77a expref: 127 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.565959:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:2.0:1777497778.565961:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1777497778.565963:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924087d38e00, rc 0) 00000100:00100000:2.0:1777497778.566002:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+127:72984:x1863837546412928:12345-192.168.202.4@tcp:101:dd.0 Request processed in 629us (728us total) trans 120259084417 rc 0/0 00000100:00100000:2.0:1777497778.566008:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1577 00000100:00100000:2.0:1777497778.566025:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1578 00000100:00100000:2.0:1777497778.566032:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+126:72983:x1863837546413056:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.566041:0:65418:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.566050:0:65418:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691ebe7 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c781 expref: -99 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566067:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691ebee lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566076:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691ebee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566082:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691ebee lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566180:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39800/0x3e357265691ebe7 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c781 expref: 128 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566193:0:65418:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9c00/0x3e357265691ebee lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c781 expref: 127 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.566200:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:2.0:1777497778.566203:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1777497778.566205:0:65418:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd9c00, rc 0) 00000100:00100000:2.0:1777497778.566230:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+127:72983:x1863837546413056:12345-192.168.202.4@tcp:101:dd.0 Request processed in 199us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.566238:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1578 00000100:00100000:3.0:1777497778.566988:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412544 00000100:00100000:3.0:1777497778.566996:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412544 00000100:00100000:3.0:1777497778.567043:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412672 00000100:00100000:3.0:1777497778.567046:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412672 00000100:00100000:3.0:1777497778.567072:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5947 00000100:00100000:3.0:1777497778.567079:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+23:2414:x1863837546412544:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:3.0:1777497778.567167:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5948 00000100:00100000:3.0:1777497778.567174:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+23:72981:x1863837546412672:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.567181:0:25491:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.567197:0:25491:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691ebf5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c773 expref: -99 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.567229:0:25491:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x36f:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.567246:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.567248:0:25491:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.567255:0:25491:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691ebf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c773 expref: 24 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.567269:0:25491:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691ebf5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c773 expref: 24 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.567280:0:25491:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079000, rc 0) 00010000:00000080:3.0:1777497778.567288:0:25491:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866fd880 x1863837546412672/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.567330:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+24:72981:x1863837546412672:12345-192.168.202.4@tcp:101:dd.0 Request processed in 156us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.567336:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5948 00000001:00080000:3.0:1777497778.567539:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969499 is committed 00010000:00000080:3.0:1777497778.567574:0:25495:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240866ff480 x1863837546412544/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.567596:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+20:2414:x1863837546412544:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 519us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.567602:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5947 00000100:00100000:2.0:1777497778.573459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.573496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.573529:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.573652:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413568 00000100:00100000:3.0:1777497778.573662:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413568 00000100:00100000:3.0:1777497778.573716:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 281 00000100:00100000:3.0:1777497778.573726:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+127:72980:x1863837546413568:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.574041:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+128:72980:x1863837546413568:12345-192.168.202.4@tcp:35:dd.0 Request processed in 315us (542us total) trans 120259084418 rc 0/0 00000100:00100000:3.0:1777497778.574049:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 281 00000100:00100000:1.0:1777497778.574247:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413312 00000100:00100000:1.0:1777497778.574253:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413312 00000100:00100000:1.0:1777497778.574322:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413824 00000100:00100000:1.0:1777497778.574326:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413824 00000100:00100000:1.0:1777497778.574354:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1579 00000100:00100000:1.0:1777497778.574362:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+129:72982:x1863837546413312:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1777497778.574393:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.574423:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9000/0x3e357265691eb77 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x14:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c757 expref: 129 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574441:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:1.0:1777497778.574447:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.574543:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574556:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574578:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.574621:0:65418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084419 00000004:00010000:1.0:1777497778.574644:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 0000000029a346d6 reply state 00000000fdd6ea6d transno 120259084420 ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574656:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574662:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:1.0:1777497778.574664:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.574667:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.574714:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+131:72982:x1863837546413312:12345-192.168.202.4@tcp:36:dd.0 Request processed in 354us (1265us total) trans 120259084420 rc 0/0 00000100:00100000:1.0:1777497778.574720:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1579 00000020:00080000:1.0:1777497778.574724:0:65418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777497778.574740:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1580 00000100:00100000:1.0:1777497778.574746:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+130:72983:x1863837546413824:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1777497778.574764:0:65418:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.574775:0:65418:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691eba8 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x15:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c765 expref: 130 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574786:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:1.0:1777497778.574789:0:65418:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.574861:0:65418:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574880:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574903:0:65418:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.574947:0:65418:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084421 00000004:00010000:1.0:1777497778.574966:0:65418:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000d61b1103 reply state 00000000046de22f transno 120259084422 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574975:0:65418:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.574982:0:65418:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:1.0:1777497778.574984:0:65418:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.574986:0:65418:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.575024:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+132:72983:x1863837546413824:12345-192.168.202.4@tcp:36:dd.0 Request processed in 277us (1494us total) trans 120259084422 rc 0/0 00000100:00100000:1.0:1777497778.575036:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1580 00000020:00080000:1.0:1777497778.575040:0:65418:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1777497778.576050:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.576078:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.576224:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414080 00000100:00100000:0.0:1777497778.576232:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414080 00000100:00100000:0.0:1777497778.576270:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5949 00000100:00100000:0.0:1777497778.576276:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+20:2415:x1863837546414080:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:0.0:1777497778.576322:0:25487:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbc700 x1863837546414080/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.576359:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+20:2415:x1863837546414080:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 83us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.576365:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5949 00000100:00100000:2.0:1777497778.576978:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413952 00000100:00100000:2.0:1777497778.576984:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413952 00002000:00100000:2.0:1777497778.577014:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x367:0x0] (0->1023) req@ffff9240b5bbea00 x1863837546413952/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.577024:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbea00 with x1863837546413952 ext(0->1023) 00002000:00010000:2.0:1777497778.577030:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbea00 00000100:00100000:2.0:1777497778.577119:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1027 00000100:00100000:2.0:1777497778.577128:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+20:2415:x1863837546413952:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.577513:0:8401:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b5bbea00 x1863837546413952/t4294969500(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.577584:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+22:2415:x1863837546413952:12345-192.168.202.4@tcp:4:dd.0 Request processed in 457us (1536us total) trans 4294969500 rc 0/0 00000100:00100000:2.0:1777497778.577591:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1027 00002000:00100000:2.0:1777497778.577598:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x367:0x0] (0->1023) req@ffff9240b5bbea00 x1863837546413952/t4294969500(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.577606:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b5bbea00 with x1863837546413952 ext(0->1023) 00002000:00010000:2.0:1777497778.577610:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b5bbea00 00000100:00100000:3.0:1777497778.586571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.586607:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.586698:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414208 00000100:00100000:2.0:1777497778.586707:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414208 00002000:00010000:2.0:1777497778.586750:0:24903:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/879 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.586755:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b50b1880 with x1863837546414208 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.586768:0:24903:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b50b1880. 00000100:00100000:2.0:1777497778.586802:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1028 00000100:00100000:2.0:1777497778.586809:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+22:2414:x1863837546414208:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:2.0:1777497778.586956:0:24903:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1777497778.586959:0:24903:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.586960:0:24903:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:2.0:1777497778.586962:0:24903:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:2.0:1777497778.586964:0:24903:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:2.0:1777497778.586971:0:24903:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240b50b1880 x1863837546414208/t4294969501(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.587028:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+23:2414:x1863837546414208:12345-192.168.202.4@tcp:10:dd.0 Request processed in 221us (468us total) trans 4294969501 rc 0/0 00000100:00100000:2.0:1777497778.587033:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1028 00002000:00010000:2.0:1777497778.587048:0:24903:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/879 (0->18446744073709551615) 00002000:00100000:2.0:1777497778.587050:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240b50b1880 with x1863837546414208 ext(0->18446744073709551615) 00002000:00010000:2.0:1777497778.587053:0:24903:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240b50b1880. 00000100:00100000:3.0:1777497778.587268:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.588201:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.588273:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414720 00000100:00100000:3.0:1777497778.588281:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414720 00000100:00100000:3.0:1777497778.588334:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5950 00000100:00100000:3.0:1777497778.588344:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+23:72983:x1863837546414720:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.588358:0:25497:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.588376:0:25497:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691ec0a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c796 expref: -99 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.588398:0:25497:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x371:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.588431:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.588433:0:25497:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.588439:0:25497:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691ec0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c796 expref: 24 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.588452:0:25497:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691ec0a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c796 expref: 24 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.588461:0:25497:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078800, rc 0) 00010000:00000080:3.0:1777497778.588474:0:25497:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c253800 x1863837546414720/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.588521:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+24:72983:x1863837546414720:12345-192.168.202.4@tcp:101:dd.0 Request processed in 179us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.588527:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5950 00000100:00100000:0.0:1777497778.589169:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414336 00000100:00100000:0.0:1777497778.589175:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414336 00000100:00100000:0.0:1777497778.589237:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414592 00000100:00100000:0.0:1777497778.589240:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414592 00000100:00100000:1.0:1777497778.589290:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1581 00000100:00100000:1.0:1777497778.589300:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+133:72984:x1863837546414336:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.589313:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.589326:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec11 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c788 expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589355:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691ec18 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589380:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691ec18 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589391:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691ec18 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589482:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec11 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c788 expref: 135 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589499:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734c00/0x3e357265691ec18 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c788 expref: 134 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589507:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:1.0:1777497778.589510:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777497778.589513:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89734c00, rc 0) 00000100:00100000:1.0:1777497778.589549:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+134:72984:x1863837546414336:12345-192.168.202.4@tcp:101:dd.0 Request processed in 251us (2939us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.589555:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1581 00000100:00100000:1.0:1777497778.589570:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1582 00000100:00100000:1.0:1777497778.589575:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+133:72985:x1863837546414592:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.589581:0:64885:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.589587:0:64885:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691ec1f lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c78f expref: -99 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589684:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589699:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589705:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589719:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589725:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589731:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589775:0:64885:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691ec34 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589783:0:64885:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691ec34 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589790:0:64885:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691ec34 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497778.589799:0:64885:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x17:0x0]: returning size 0 00010000:00010000:1.0:1777497778.589858:0:64885:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589863:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589867:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589876:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589880:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.589893:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589898:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589905:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:1.0:1777497778.589906:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.589909:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589913:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec26 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589920:0:64885:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589923:0:64885:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589926:0:64885:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589939:0:64885:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.589942:0:64885:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589957:0:64885:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589969:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x3c635ca3 (ffff9240aefbbe00) 00010000:00010000:1.0:1777497778.589971:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.589974:0:64885:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.589979:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec2d lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x3c635ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.590017:0:64885:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691ec1f lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c78f expref: 136 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.590030:0:64885:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691ec34 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c78f expref: 135 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.590036:0:64885:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:1.0:1777497778.590038:0:64885:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497778.590041:0:64885:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735200, rc 0) 00000100:00100000:1.0:1777497778.590064:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d146155b-4321-4b14-9284-f644ed9631fb+135:72985:x1863837546414592:12345-192.168.202.4@tcp:101:dd.0 Request processed in 488us (2795us total) trans 120259084423 rc 0/0 00000100:00100000:1.0:1777497778.590070:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1582 00000100:00100000:2.0:1777497778.601789:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.601901:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.604946:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414976 00000100:00100000:0.0:1777497778.604961:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414976 00000100:00100000:0.0:1777497778.605064:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415104 00000100:00100000:0.0:1777497778.605068:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415104 00000100:00100000:2.0:1777497778.605190:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5951 00000100:00100000:2.0:1777497778.605213:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+25:72982:x1863837546414976:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:2.0:1777497778.605233:0:8396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1777497778.605254:0:8396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000514994fb/0x3e357265691ec42 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c79d expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1777497778.605281:0:8396:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x370:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:2.0:1777497778.605312:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.605314:0:8396:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1777497778.605322:0:8396:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000514994fb/0x3e357265691ec42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c79d expref: 26 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.605349:0:8396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000514994fb/0x3e357265691ec42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c79d expref: 26 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497778.605363:0:8396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8200, rc 0) 00010000:00000080:2.0:1777497778.605371:0:8396:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251c00 x1863837546414976/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.605439:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+26:72982:x1863837546414976:12345-192.168.202.4@tcp:101:dd.0 Request processed in 239us (3662us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.605462:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5951 00000100:00100000:2.0:1777497778.605482:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5952 00000100:00100000:2.0:1777497778.605490:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+25:2415:x1863837546415104:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:2.0:1777497778.605523:0:8396:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251f80 x1863837546415104/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.605548:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d146155b-4321-4b14-9284-f644ed9631fb+25:2415:x1863837546415104:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 60us (3647us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.605555:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5952 00000100:00100000:0.0:1777497778.620989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.621135:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.621166:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.621193:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415616 00000100:00100000:0.0:1777497778.621214:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415616 00000100:00100000:0.0:1777497778.621282:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1583 00000100:00100000:0.0:1777497778.621293:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+135:72984:x1863837546415616:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:0.0:1777497778.621362:0:63729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1777497778.621388:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d38e00/0x3e357265691ebd9 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x16:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c77a expref: 135 pid: 65418 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.621407:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497778.621412:0:63729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1777497778.622358:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.622377:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.622388:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1777497778.622436:0:63729:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084424 00000004:00010000:0.0:1777497778.622458:0:63729:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000008255f156 reply state 0000000034fc04ee transno 120259084425 ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.622470:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.622477:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:0.0:1777497778.622480:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1777497778.622482:0:63729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1777497778.622710:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.622789:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.622852:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415360 00000100:00100000:3.0:1777497778.622858:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415360 00000100:00100000:3.0:1777497778.622894:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 282 00000100:00100000:3.0:1777497778.622902:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+138:72981:x1863837546415360:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.623082:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+139:72981:x1863837546415360:12345-192.168.202.4@tcp:35:dd.0 Request processed in 180us (1945us total) trans 120259084426 rc 0/0 00000100:00100000:3.0:1777497778.623090:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 282 00000100:00100000:0.0:1777497778.623384:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+138:72984:x1863837546415616:12345-192.168.202.4@tcp:36:dd.0 Request processed in 2093us (2216us total) trans 120259084425 rc 0/0 00000100:00100000:0.0:1777497778.623391:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1583 00000020:00080000:0.0:1777497778.623394:0:63729:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1777497778.623410:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415744 00000100:00100000:0.0:1777497778.623414:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415744 00000100:00100000:0.0:1777497778.623437:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1584 00000100:00100000:0.0:1777497778.623442:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+138:72985:x1863837546415744:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:0.0:1777497778.623455:0:63729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1777497778.623473:0:63729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ec50 lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7a4 expref: -99 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623622:0:63729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ec57 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623635:0:63729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ec57 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623644:0:63729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ec57 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623782:0:63729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375800/0x3e357265691ec50 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7a4 expref: 140 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623799:0:63729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374e00/0x3e357265691ec57 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7a4 expref: 139 pid: 63729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497778.623806:0:63729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:0.0:1777497778.623808:0:63729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1777497778.623811:0:63729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f84374e00, rc 0) 00000100:00100000:0.0:1777497778.623833:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d146155b-4321-4b14-9284-f644ed9631fb+139:72985:x1863837546415744:12345-192.168.202.4@tcp:101:dd.0 Request processed in 390us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.623839:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1584 00000100:00100000:1.0:1777497778.624972:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414848 00000100:00100000:1.0:1777497778.624984:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414848 00000100:00100000:3.0:1777497778.625052:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415872 00000100:00100000:3.0:1777497778.625056:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415872 00002000:00010000:3.0:1777497778.625088:0:24904:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/880 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.625109:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c253b80 with x1863837546415872 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.625122:0:24904:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c253b80. 00000100:00100000:3.0:1777497778.625151:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1029 00000100:00100000:3.0:1777497778.625160:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+26:2414:x1863837546415872:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:3.0:1777497778.625313:0:24904:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777497778.625317:0:24904:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.625320:0:24904:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:3.0:1777497778.625322:0:24904:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.625324:0:24904:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1777497778.625332:0:24904:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c253b80 x1863837546415872/t4294969502(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.625533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00002000:00100000:0.0:1777497778.625575:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x368:0x0] (0->1023) req@ffff92409bf2aa00 x1863837546414848/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.625584:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409bf2aa00 with x1863837546414848 ext(0->1023) 00002000:00010000:0.0:1777497778.625589:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409bf2aa00 00000100:00100000:0.0:1777497778.625603:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416384 00000100:00100000:0.0:1777497778.625613:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416384 00002000:00100000:0.0:1777497778.625629:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x369:0x0] (0->1023) req@ffff92409bf2a680 x1863837546416384/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.625637:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409bf2a680 with x1863837546416384 ext(0->1023) 00002000:00010000:0.0:1777497778.625640:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409bf2a680 00000100:00100000:0.0:1777497778.625662:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1030 00000100:00100000:0.0:1777497778.625681:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+28:2415:x1863837546414848:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:0.0:1777497778.626027:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409bf2aa00 x1863837546414848/t4294969503(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.626073:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+30:2415:x1863837546414848:12345-192.168.202.4@tcp:4:dd.0 Request processed in 404us (5093us total) trans 4294969503 rc 0/0 00000100:00100000:0.0:1777497778.626081:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1030 00002000:00100000:0.0:1777497778.626087:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x368:0x0] (0->1023) req@ffff92409bf2aa00 x1863837546414848/t4294969503(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.626115:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409bf2aa00 with x1863837546414848 ext(0->1023) 00002000:00010000:0.0:1777497778.626119:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409bf2aa00 00000100:00100000:0.0:1777497778.626136:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1031 00000100:00100000:0.0:1777497778.626143:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+29:2412:x1863837546416384:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:0.0:1777497778.626966:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409bf2a680 x1863837546416384/t4294969504(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.627001:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+31:2412:x1863837546416384:12345-192.168.202.4@tcp:4:dd.0 Request processed in 859us (1470us total) trans 4294969504 rc 0/0 00000100:00100000:0.0:1777497778.627008:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1031 00002000:00100000:0.0:1777497778.627014:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x369:0x0] (0->1023) req@ffff92409bf2a680 x1863837546416384/t4294969504(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.627029:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409bf2a680 with x1863837546416384 ext(0->1023) 00002000:00010000:0.0:1777497778.627032:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409bf2a680 00000100:00100000:2.0:1777497778.629277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.629330:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.629981:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416512 00000100:00100000:0.0:1777497778.629990:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416512 00000100:00100000:0.0:1777497778.630039:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5953 00000100:00100000:0.0:1777497778.630048:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+31:2412:x1863837546416512:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:0.0:1777497778.630160:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+31:2414:x1863837546415872:12345-192.168.202.4@tcp:10:dd.0 Request processed in 5001us (7369us total) trans 4294969502 rc 0/0 00000100:00100000:0.0:1777497778.630169:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1029 00002000:00010000:0.0:1777497778.630174:0:24904:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/880 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.630177:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c253b80 with x1863837546415872 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.630188:0:24904:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c253b80. 00000100:00100000:1.0:1777497778.630465:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416128 00000100:00100000:1.0:1777497778.630470:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416128 00000100:00100000:1.0:1777497778.630511:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1585 00000100:00100000:1.0:1777497778.630528:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+139:72986:x1863837546416128:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.630554:0:63728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.630575:0:63728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691ec5e lrc: 2/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7ab expref: -99 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630848:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 3/1,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630865:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630876:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 3/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630890:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630897:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630904:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630967:0:63728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec73 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630975:0:63728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec73 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.630982:0:63728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec73 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1777497778.630992:0:63728:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x20000cf21:0x18:0x0]: returning size 0 00010000:00010000:1.0:1777497778.631078:0:63728:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631086:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 4/1,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631126:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 3/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631134:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631139:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.631143:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 4/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631149:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 5/0,0 mode: CR/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631161:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x0 (ffff9240817a3f00) 00010000:00010000:1.0:1777497778.631164:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.631168:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 3/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631175:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734000/0x3e357265691ec65 lrc: 0/0,0 mode: --/CR res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631191:0:63728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631197:0:63728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 2/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631202:0:63728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631305:0:63728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:1.0:1777497778.631309:0:63728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631316:0:63728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 4/0,0 mode: PR/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631324:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x4:0x0].0x961c5ca3 (ffff9240aefbbe00) 00010000:00010000:1.0:1777497778.631326:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1777497778.631329:0:63728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631335:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735400/0x3e357265691ec6c lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x4:0x0].0x961c5ca3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631380:0:63728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734e00/0x3e357265691ec5e lrc: 0/0,0 mode: --/CW res: [0x20000cf21:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ab expref: 142 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631394:0:63728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec73 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ab expref: 141 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.631401:0:63728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:1.0:1777497778.631403:0:63728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1777497778.631405:0:63728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f89735c00, rc 0) 00000100:00100000:1.0:1777497778.631586:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+141:72986:x1863837546416128:12345-192.168.202.4@tcp:101:dd.0 Request processed in 1067us (2318us total) trans 120259084427 rc 0/0 00000100:00100000:1.0:1777497778.631593:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1585 00000001:00080000:3.0:1777497778.633470:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969504 is committed 00010000:00000080:1.0:1777497778.633690:0:25499:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251500 x1863837546416512/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.634301:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.634542:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416256 00000100:00100000:3.0:1777497778.634550:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416256 00002000:00010000:3.0:1777497778.634589:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/881 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.634594:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c253480 with x1863837546416256 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.634606:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c253480. 00000100:00100000:3.0:1777497778.634640:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1032 00000100:00100000:3.0:1777497778.634650:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+23:2414:x1863837546416256:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:3.0:1777497778.634981:0:24902:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1777497778.634985:0:24902:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.634987:0:24902:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:3.0:1777497778.634990:0:24902:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:3.0:1777497778.634992:0:24902:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:3.0:1777497778.635000:0:24902:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c253480 x1863837546416256/t4294969505(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.635057:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+24:2414:x1863837546416256:12345-192.168.202.4@tcp:10:dd.0 Request processed in 408us (758us total) trans 4294969505 rc 0/0 00000100:00100000:3.0:1777497778.635065:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1032 00002000:00010000:3.0:1777497778.635068:0:24902:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/881 (0->18446744073709551615) 00002000:00100000:3.0:1777497778.635071:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c253480 with x1863837546416256 ext(0->18446744073709551615) 00002000:00010000:3.0:1777497778.635076:0:24902:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c253480. 00000100:00100000:1.0:1777497778.635408:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+23:2412:x1863837546416512:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 5360us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.635417:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5953 00000100:00100000:2.0:1777497778.640033:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.640137:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.640231:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416896 00000100:00100000:3.0:1777497778.640242:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416896 00000100:00100000:3.0:1777497778.640297:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5954 00000100:00100000:3.0:1777497778.640308:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+23:72984:x1863837546416896:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.640347:0:25489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.640375:0:25489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691ec81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7b2 expref: -99 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.640405:0:25489:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x372:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.640433:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.640435:0:25489:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.640445:0:25489:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691ec81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7b2 expref: 24 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.640463:0:25489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691ec81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7b2 expref: 24 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.640479:0:25489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079e00, rc 0) 00010000:00000080:3.0:1777497778.640488:0:25489:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251880 x1863837546416896/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.640577:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+24:72984:x1863837546416896:12345-192.168.202.4@tcp:101:dd.0 Request processed in 271us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.640585:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5954 00000100:00100000:1.0:1777497778.644559:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.644601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.644655:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417024 00000100:00100000:3.0:1777497778.644665:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417024 00002000:00100000:3.0:1777497778.644723:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x36a:0x0] (0->1023) req@ffff9240bd067050 x1863837546417024/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.644734:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bd067050 with x1863837546417024 ext(0->1023) 00002000:00010000:3.0:1777497778.644740:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bd067050 00000100:00100000:3.0:1777497778.644765:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1033 00000100:00100000:3.0:1777497778.644784:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bd067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+24:2412:x1863837546417024:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:3.0:1777497778.646376:0:8401:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bd067050 x1863837546417024/t4294969506(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.646453:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bd067050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+26:2412:x1863837546417024:12345-192.168.202.4@tcp:4:dd.0 Request processed in 1670us (1902us total) trans 4294969506 rc 0/0 00000100:00100000:3.0:1777497778.646463:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1033 00002000:00100000:3.0:1777497778.646472:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x36a:0x0] (0->1023) req@ffff9240bd067050 x1863837546417024/t4294969506(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.646482:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bd067050 with x1863837546417024 ext(0->1023) 00002000:00010000:3.0:1777497778.646487:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bd067050 00000100:00100000:1.0:1777497778.646868:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416768 00000100:00100000:1.0:1777497778.646880:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416768 00000100:00100000:1.0:1777497778.646944:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417280 00000100:00100000:1.0:1777497778.646948:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417280 00000100:00100000:1.0:1777497778.646970:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1586 00000100:00100000:1.0:1777497778.646977:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+142:72985:x1863837546416768:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1777497778.647025:0:73210:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.647048:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735200/0x3e357265691ec34 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x17:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c78f expref: 142 pid: 64885 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647066:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:1.0:1777497778.647071:0:73210:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.647237:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647251:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647261:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.647300:0:73210:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084428 00000004:00010000:1.0:1777497778.647320:0:73210:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 00000000dceb00d8 reply state 000000000cb8092c transno 120259084429 ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647344:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647350:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:1.0:1777497778.647352:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.647354:0:73210:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.647413:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+144:72985:x1863837546416768:12345-192.168.202.4@tcp:36:dd.0 Request processed in 436us (7391us total) trans 120259084429 rc 0/0 00000100:00100000:1.0:1777497778.647419:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1586 00000020:00080000:1.0:1777497778.647423:0:73210:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1777497778.647438:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1587 00000100:00100000:1.0:1777497778.647445:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+143:72986:x1863837546417280:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.647455:0:73210:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.647465:0:73210:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88000/0x3e357265691ec8f lrc: 2/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7b9 expref: -99 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647500:0:73210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff924086d89400/0x3e357265691ec96 lrc: 3/1,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647508:0:73210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086d89400/0x3e357265691ec96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647514:0:73210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086d89400/0x3e357265691ec96 lrc: 3/1,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647589:0:73210:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88000/0x3e357265691ec8f lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7b9 expref: 145 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647615:0:73210:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff924086d89400/0x3e357265691ec96 lrc: 3/0,0 mode: PR/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7b9 expref: 144 pid: 73210 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.647622:0:73210:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:1.0:1777497778.647625:0:73210:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1777497778.647627:0:73210:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086d89400, rc 0) 00000100:00100000:1.0:1777497778.647651:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+144:72986:x1863837546417280:12345-192.168.202.4@tcp:101:dd.0 Request processed in 207us (3050us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.647657:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1587 00000100:00100000:1.0:1777497778.649290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.649400:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.649453:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.649480:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417664 00000100:00100000:1.0:1777497778.649488:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417664 00002000:00010000:1.0:1777497778.650644:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/882 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.650652:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc07100 with x1863837546417664 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.650663:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc07100. 00000100:00100000:1.0:1777497778.651510:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1034 00000100:00100000:1.0:1777497778.651780:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+26:2415:x1863837546417664:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.651951:0:24168:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.651956:0:24168:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.651958:0:24168:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.651961:0:24168:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.651963:0:24168:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.651972:0:24168:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc07100 x1863837546417664/t4294969507(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.652040:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+27:2415:x1863837546417664:12345-192.168.202.4@tcp:10:dd.0 Request processed in 521us (2586us total) trans 4294969507 rc 0/0 00000100:00100000:1.0:1777497778.652048:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1034 00002000:00010000:1.0:1777497778.652053:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/882 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.652056:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc07100 with x1863837546417664 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.652062:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc07100. 00000100:00100000:1.0:1777497778.652155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.653498:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417536 00000100:00100000:3.0:1777497778.653513:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417536 00000100:00100000:3.0:1777497778.653575:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417920 00000100:00100000:3.0:1777497778.653578:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417920 00000100:00100000:3.0:1777497778.653598:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 283 00000100:00100000:3.0:1777497778.653607:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+145:72982:x1863837546417536:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.653969:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+146:72982:x1863837546417536:12345-192.168.202.4@tcp:35:dd.0 Request processed in 362us (4567us total) trans 120259084430 rc 0/0 00000100:00100000:3.0:1777497778.653976:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 283 00000100:00100000:3.0:1777497778.653992:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 284 00000100:00100000:3.0:1777497778.653998:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+145:72983:x1863837546417920:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.654128:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+146:72983:x1863837546417920:12345-192.168.202.4@tcp:35:dd.0 Request processed in 129us (1972us total) trans 120259084431 rc 0/0 00000100:00100000:3.0:1777497778.654135:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 284 00000100:00100000:1.0:1777497778.655052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.655117:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.656220:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418304 00000100:00100000:1.0:1777497778.656230:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418304 00000100:00100000:3.0:1777497778.657324:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417152 00000100:00100000:3.0:1777497778.657332:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417152 00000100:00100000:3.0:1777497778.657379:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418048 00000100:00100000:3.0:1777497778.657383:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418048 00000100:00100000:3.0:1777497778.657408:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5955 00000100:00100000:3.0:1777497778.657417:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+28:2412:x1863837546417152:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:3.0:1777497778.657484:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5956 00000100:00100000:3.0:1777497778.657491:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+28:72985:x1863837546418048:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:3.0:1777497778.657499:0:23437:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1777497778.657536:0:23437:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691ec9d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7c0 expref: -99 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1777497778.657557:0:23437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x373:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:3.0:1777497778.657576:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.657578:0:23437:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1777497778.657586:0:23437:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691ec9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c0 expref: 29 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.657602:0:23437:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691ec9d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c0 expref: 29 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497778.657615:0:23437:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078600, rc 0) 00010000:00000080:3.0:1777497778.657623:0:23437:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc07480 x1863837546418048/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.657694:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+29:72985:x1863837546418048:12345-192.168.202.4@tcp:101:dd.0 Request processed in 204us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.657721:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5956 00000001:00080000:3.0:1777497778.657955:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969507 is committed 00010000:00000080:3.0:1777497778.657992:0:25496:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc04e00 x1863837546417152/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.658018:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+24:2412:x1863837546417152:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 603us (8816us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.658024:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5955 00000100:00100000:3.0:1777497778.663177:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.663219:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418560 00000100:00100000:3.0:1777497778.663229:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418560 00000100:00100000:3.0:1777497778.663283:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 285 00000100:00100000:3.0:1777497778.663293:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+147:72984:x1863837546418560:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.663584:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+148:72984:x1863837546418560:12345-192.168.202.4@tcp:35:dd.0 Request processed in 291us (415us total) trans 120259084432 rc 0/0 00000100:00100000:3.0:1777497778.663592:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 285 00000100:00100000:1.0:1777497778.664898:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1588 00000100:00100000:1.0:1777497778.664915:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+147:72986:x1863837546418304:12345-192.168.202.4@tcp:36:dd.0 00010000:00010000:1.0:1777497778.664996:0:63727:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497778.665023:0:63727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735c00/0x3e357265691ec73 lrc: 0/0,0 mode: --/PR res: [0x20000cf21:0x18:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ab expref: 147 pid: 63728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.665041:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:1.0:1777497778.665047:0:63727:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1777497778.665218:0:63727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: --/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.665233:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.665243:0:63727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1777497778.665298:0:63727:0:(tgt_lastrcvd.c:2129:tgt_txn_stop_cb()) More than one transaction 120259084433 00000004:00010000:1.0:1777497778.665321:0:63727:0:(mdt_handler.c:4479:mdt_save_lock()) ### save lock request 000000005199b874 reply state 0000000052aa4484 transno 120259084434 ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: PW/PW res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.665333:0:63727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.665339:0:63727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:1.0:1777497778.665341:0:63727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1777497778.665343:0:63727:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1777497778.665429:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+149:72986:x1863837546418304:12345-192.168.202.4@tcp:36:dd.0 Request processed in 520us (10334us total) trans 120259084434 rc 0/0 00000100:00100000:1.0:1777497778.665436:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1588 00000020:00080000:1.0:1777497778.665441:0:63727:0:(tgt_main.c:783:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1777497778.672788:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.673003:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418816 00000100:00100000:0.0:1777497778.673013:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418816 00002000:00100000:0.0:1777497778.673062:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36b:0x0] (0->1023) req@ffff92409c252d80 x1863837546418816/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.673073:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c252d80 with x1863837546418816 ext(0->1023) 00002000:00010000:0.0:1777497778.673081:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c252d80 00000100:00100000:0.0:1777497778.673352:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1035 00000100:00100000:0.0:1777497778.673362:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+24:2415:x1863837546418816:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:0.0:1777497778.673981:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c252d80 x1863837546418816/t4294969508(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.674089:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+26:2415:x1863837546418816:12345-192.168.202.4@tcp:4:dd.0 Request processed in 729us (1309us total) trans 4294969508 rc 0/0 00000100:00100000:0.0:1777497778.674124:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1035 00002000:00100000:0.0:1777497778.674132:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36b:0x0] (0->1023) req@ffff92409c252d80 x1863837546418816/t4294969508(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.674140:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c252d80 with x1863837546418816 ext(0->1023) 00002000:00010000:0.0:1777497778.674143:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c252d80 00000100:00100000:2.0:1777497778.675847:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.675887:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.675959:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418688 00000100:00100000:1.0:1777497778.675968:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418688 00002000:00010000:1.0:1777497778.675999:0:8403:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/883 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.676003:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c250000 with x1863837546418688 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.676014:0:8403:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c250000. 00000100:00100000:1.0:1777497778.676046:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1036 00000100:00100000:1.0:1777497778.676055:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+26:2415:x1863837546418688:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:1.0:1777497778.676228:0:8403:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1777497778.676232:0:8403:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.676234:0:8403:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:1.0:1777497778.676236:0:8403:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:1.0:1777497778.676238:0:8403:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:1.0:1777497778.676245:0:8403:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c250000 x1863837546418688/t4294969509(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.676306:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+27:2415:x1863837546418688:12345-192.168.202.4@tcp:10:dd.0 Request processed in 252us (465us total) trans 4294969509 rc 0/0 00000100:00100000:1.0:1777497778.676313:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1036 00002000:00010000:1.0:1777497778.676316:0:8403:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/883 (0->18446744073709551615) 00002000:00100000:1.0:1777497778.676319:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c250000 with x1863837546418688 ext(0->18446744073709551615) 00002000:00010000:1.0:1777497778.676324:0:8403:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c250000. 00000100:00100000:2.0:1777497778.676490:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.679510:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418944 00000100:00100000:3.0:1777497778.679811:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418944 00000100:00100000:3.0:1777497778.679905:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419072 00000100:00100000:3.0:1777497778.679910:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419072 00000100:00100000:0.0:1777497778.679966:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5957 00000100:00100000:0.0:1777497778.679978:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+28:2415:x1863837546418944:12345-192.168.202.4@tcp:16:kworker.0 00000100:00100000:1.0:1777497778.680075:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5958 00000100:00100000:1.0:1777497778.680084:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+28:72986:x1863837546419072:12345-192.168.202.4@tcp:101:dd.0 00010000:00010000:1.0:1777497778.680132:0:8398:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1777497778.680154:0:8398:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000200a2bed/0x3e357265691ecab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7c7 expref: -99 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1777497778.680176:0:8398:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x374:0x0] initial LVB size: 0, mtime: 0x69f276a8, atime: 0x69f276a8, ctime: 0x69f276a8, blocks: 0x0 00010000:00010000:1.0:1777497778.680194:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497778.680196:0:8398:0:(ldlm_extent.c:402:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1777497778.680339:0:8398:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000200a2bed/0x3e357265691ecab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c7 expref: 29 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.680362:0:8398:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000200a2bed/0x3e357265691ecab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c7 expref: 29 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497778.680375:0:8398:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086d89600, rc 0) 00010000:00000080:1.0:1777497778.680383:0:8398:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c250700 x1863837546419072/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 328/400 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000001:00080000:2.0:1777497778.680725:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969509 is committed 00010000:00000080:2.0:1777497778.680767:0:25486:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c8cfc50 x1863837546418944/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.680818:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d146155b-4321-4b14-9284-f644ed9631fb+26:72986:x1863837546419072:12345-192.168.202.4@tcp:101:dd.0 Request processed in 734us (4326us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.680825:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5958 00000100:00100000:2.0:1777497778.681477:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:d146155b-4321-4b14-9284-f644ed9631fb+25:2415:x1863837546418944:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 1500us (5587us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.681486:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5957 00000100:00100000:1.0:1777497778.681921:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.682077:0:63731:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419328 00000100:00100000:3.0:1777497778.682083:0:63731:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419328 00000100:00100000:3.0:1777497778.682146:0:63731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:3.0:1777497778.682154:0:63731:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+149:72985:x1863837546419328:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.682394:0:63731:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d146155b-4321-4b14-9284-f644ed9631fb+150:72985:x1863837546419328:12345-192.168.202.4@tcp:35:dd.0 Request processed in 240us (473us total) trans 120259084435 rc 0/0 00000100:00100000:3.0:1777497778.682402:0:63731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 286 00000100:00100000:1.0:1777497778.684560:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.684602:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.684667:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419584 00000100:00100000:3.0:1777497778.684684:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419584 00000100:00100000:3.0:1777497778.684735:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5959 00000100:00100000:3.0:1777497778.684746:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546419584:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:3.0:1777497778.684795:0:8397:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc06d80 x1863837546419584/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.684846:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546419584:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 103us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.684852:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5959 00000100:00100000:2.0:1777497778.684958:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419456 00000100:00100000:2.0:1777497778.684963:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419456 00002000:00100000:2.0:1777497778.684986:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x36c:0x0] (0->1023) req@ffff9240bcc04000 x1863837546419456/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.684995:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04000 with x1863837546419456 ext(0->1023) 00002000:00010000:2.0:1777497778.685000:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04000 00000100:00100000:2.0:1777497778.685023:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1037 00000100:00100000:2.0:1777497778.685030:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546419456:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.685561:0:24904:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc04000 x1863837546419456/t4294969510(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.685593:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+27:2412:x1863837546419456:12345-192.168.202.4@tcp:4:dd.0 Request processed in 564us (991us total) trans 4294969510 rc 0/0 00000100:00100000:2.0:1777497778.685599:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1037 00002000:00100000:2.0:1777497778.685605:0:24904:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x36c:0x0] (0->1023) req@ffff9240bcc04000 x1863837546419456/t4294969510(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.685612:0:24904:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04000 with x1863837546419456 ext(0->1023) 00002000:00010000:2.0:1777497778.685615:0:24904:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04000 00000100:00100000:1.0:1777497778.694767:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.694828:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.694925:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.695144:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419968 00000100:00100000:2.0:1777497778.695155:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419968 00000100:00100000:2.0:1777497778.695216:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5960 00000100:00100000:2.0:1777497778.695228:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+27:2414:x1863837546419968:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:2.0:1777497778.695285:0:25485:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc06a00 x1863837546419968/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.695331:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:d146155b-4321-4b14-9284-f644ed9631fb+27:2414:x1863837546419968:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 108us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.695348:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5960 00000100:00100000:0.0:1777497778.698439:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419712 00000100:00100000:0.0:1777497778.698451:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419712 00002000:00010000:0.0:1777497778.698505:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/884 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.698509:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04700 with x1863837546419712 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.698520:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04700. 00000100:00100000:0.0:1777497778.698542:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419840 00000100:00100000:0.0:1777497778.698546:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419840 00002000:00100000:0.0:1777497778.698567:0:24168:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x36d:0x0] (0->1023) req@ffff9240bcc04a80 x1863837546419840/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.698577:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04a80 with x1863837546419840 ext(0->1023) 00002000:00010000:0.0:1777497778.698582:0:24168:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04a80 00000100:00100000:0.0:1777497778.698611:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1038 00000100:00100000:0.0:1777497778.698621:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+28:2415:x1863837546419712:12345-192.168.202.4@tcp:10:dd.0 00002000:00010000:0.0:1777497778.698767:0:24168:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1777497778.698771:0:24168:0:(ofd_lvb.c:312:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb mtime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.698773:0:24168:0:(ofd_lvb.c:318:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb atime from disk: 1777497768 -> 1777497768 00002000:00010000:0.0:1777497778.698776:0:24168:0:(ofd_lvb.c:324:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb ctime from disk: 1777497768 -> 1777497778 00002000:00010000:0.0:1777497778.698788:0:24168:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb blocks from disk: 0 -> 0 00010000:00000080:0.0:1777497778.698796:0:24168:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc04700 x1863837546419712/t4294969511(0) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.698854:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+29:2415:x1863837546419712:12345-192.168.202.4@tcp:10:dd.0 Request processed in 235us (4096us total) trans 4294969511 rc 0/0 00000100:00100000:0.0:1777497778.698861:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1038 00002000:00010000:0.0:1777497778.698864:0:24168:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/884 (0->18446744073709551615) 00002000:00100000:0.0:1777497778.698867:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04700 with x1863837546419712 ext(0->18446744073709551615) 00002000:00010000:0.0:1777497778.698871:0:24168:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04700. 00000100:00100000:0.0:1777497778.698887:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1039 00000100:00100000:0.0:1777497778.698893:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+28:2414:x1863837546419840:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:0.0:1777497778.699944:0:24168:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc04a80 x1863837546419840/t4294969512(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.699999:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+30:2414:x1863837546419840:12345-192.168.202.4@tcp:4:dd.0 Request processed in 1106us (5170us total) trans 4294969512 rc 0/0 00000100:00100000:0.0:1777497778.700007:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1039 00002000:00100000:0.0:1777497778.700015:0:24168:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x36d:0x0] (0->1023) req@ffff9240bcc04a80 x1863837546419840/t4294969512(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.700024:0:24168:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc04a80 with x1863837546419840 ext(0->1023) 00002000:00010000:0.0:1777497778.700028:0:24168:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc04a80 00000100:00100000:1.0:1777497778.704978:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.705053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.705090:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420224 00000100:00100000:0.0:1777497778.705115:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420224 00000100:00100000:0.0:1777497778.705177:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5961 00000100:00100000:0.0:1777497778.705188:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+30:2415:x1863837546420224:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:0.0:1777497778.705269:0:25488:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc07800 x1863837546420224/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.705330:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+30:2415:x1863837546420224:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 144us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.705471:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420096 00000100:00100000:3.0:1777497778.705476:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420096 00002000:00100000:3.0:1777497778.705501:0:24903:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x36e:0x0] (0->1023) req@ffff9240bcc06300 x1863837546420096/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.705510:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc06300 with x1863837546420096 ext(0->1023) 00002000:00010000:3.0:1777497778.705516:0:24903:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc06300 00000100:00100000:3.0:1777497778.705626:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1040 00000100:00100000:3.0:1777497778.705634:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+31:2415:x1863837546420096:12345-192.168.202.4@tcp:4:dd.0 00000100:00100000:0.0:1777497778.705830:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5961 00010000:00000080:3.0:1777497778.706180:0:24903:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc06300 x1863837546420096/t4294969513(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.709040:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+32:2415:x1863837546420096:12345-192.168.202.4@tcp:4:dd.0 Request processed in 3393us (4058us total) trans 4294969513 rc 0/0 00000100:00100000:3.0:1777497778.709053:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1040 00002000:00100000:3.0:1777497778.709077:0:24903:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x36e:0x0] (0->1023) req@ffff9240bcc06300 x1863837546420096/t4294969513(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.709213:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc06300 with x1863837546420096 ext(0->1023) 00002000:00010000:3.0:1777497778.709219:0:24903:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc06300 00000100:00100000:1.0:1777497778.715011:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.715131:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420352 00000100:00100000:0.0:1777497778.715142:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420352 00002000:00100000:0.0:1777497778.715192:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36f:0x0] (0->1023) req@ffff9240bcc07480 x1863837546420352/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.715202:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc07480 with x1863837546420352 ext(0->1023) 00002000:00010000:0.0:1777497778.715207:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc07480 00000100:00100000:0.0:1777497778.715234:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1041 00000100:00100000:0.0:1777497778.715244:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+32:2413:x1863837546420352:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:0.0:1777497778.715617:0:24658:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc07480 x1863837546420352/t4294969514(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.715680:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+34:2413:x1863837546420352:12345-192.168.202.4@tcp:4:dd.0 Request processed in 427us (667us total) trans 4294969514 rc 0/0 00000100:00100000:0.0:1777497778.715689:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1041 00002000:00100000:0.0:1777497778.715696:0:24658:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x36f:0x0] (0->1023) req@ffff9240bcc07480 x1863837546420352/t4294969514(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.715704:0:24658:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bcc07480 with x1863837546420352 ext(0->1023) 00002000:00010000:0.0:1777497778.715708:0:24658:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bcc07480 00000100:00100000:1.0:1777497778.717844:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497778.718058:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420480 00000100:00100000:2.0:1777497778.722247:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.722379:0:63730:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420736 00000100:00100000:3.0:1777497778.722389:0:63730:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420736 00000100:00100000:3.0:1777497778.722452:0:63730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 287 00000100:00100000:3.0:1777497778.722462:0:63730:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+150:72986:x1863837546420736:12345-192.168.202.4@tcp:35:dd.0 00000100:00100000:3.0:1777497778.723083:0:63730:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d146155b-4321-4b14-9284-f644ed9631fb+151:72986:x1863837546420736:12345-192.168.202.4@tcp:35:dd.0 Request processed in 620us (842us total) trans 120259084436 rc 0/0 00000100:00100000:3.0:1777497778.723091:0:63730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 287 00000100:00100000:0.0:1777497778.727625:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420480 00000100:00100000:2.0:1777497778.727867:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5962 00000100:00100000:2.0:1777497778.727881:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+34:2413:x1863837546420480:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:3.0:1777497778.728209:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969514 is committed 00010000:00000080:2.0:1777497778.728321:0:25494:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bcc04e00 x1863837546420480/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.728877:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+25:2413:x1863837546420480:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 998us (11038us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.728886:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5962 00000100:00100000:3.0:1777497778.756084:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.756085:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.756313:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420992 00000100:00100000:1.0:1777497778.756323:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420992 00000100:00100000:1.0:1777497778.756754:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5963 00000100:00100000:1.0:1777497778.756767:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546420992:12345-192.168.202.4@tcp:16:kworker.0 00010000:00000080:1.0:1777497778.756836:0:25499:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251c00 x1863837546420992/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.756841:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420864 00000100:00100000:0.0:1777497778.756847:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420864 00002000:00100000:0.0:1777497778.756874:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x370:0x0] (0->1023) req@ffff9240bce2d500 x1863837546420864/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1777497778.756883:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2d500 with x1863837546420864 ext(0->1023) 00002000:00010000:0.0:1777497778.756888:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2d500 00000100:00100000:0.0:1777497778.756912:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1042 00000100:00100000:1.0:1777497778.756914:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+26:2412:x1863837546420992:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 151us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497778.756918:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+26:2413:x1863837546420864:12345-192.168.202.4@tcp:4:dd.0 00000100:00100000:1.0:1777497778.756921:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5963 00010000:00000080:2.0:1777497778.757446:0:24910:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2d500 x1863837546420864/t4294969515(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.757491:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+27:2413:x1863837546420864:12345-192.168.202.4@tcp:4:dd.0 Request processed in 572us (1413us total) trans 4294969515 rc 0/0 00000100:00100000:2.0:1777497778.757499:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1042 00002000:00100000:2.0:1777497778.757505:0:24910:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x370:0x0] (0->1023) req@ffff9240bce2d500 x1863837546420864/t4294969515(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.757512:0:24910:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2d500 with x1863837546420864 ext(0->1023) 00002000:00010000:2.0:1777497778.757516:0:24910:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2d500 00000100:00100000:2.0:1777497778.761536:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.761626:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421120 00000100:00100000:3.0:1777497778.761640:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421120 00002000:00100000:3.0:1777497778.761690:0:25314:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x371:0x0] (0->1023) req@ffff92409c251f80 x1863837546421120/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.761701:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251f80 with x1863837546421120 ext(0->1023) 00002000:00010000:3.0:1777497778.761706:0:25314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251f80 00000100:00100000:3.0:1777497778.761739:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1043 00000100:00100000:3.0:1777497778.761748:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+27:2415:x1863837546421120:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:3.0:1777497778.765192:0:25314:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251f80 x1863837546421120/t4294969516(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497778.766073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.766153:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421248 00000100:00100000:3.0:1777497778.766162:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421248 00000100:00100000:3.0:1777497778.766227:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5964 00000100:00100000:3.0:1777497778.766251:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+30:2415:x1863837546421248:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:1.0:1777497778.766583:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969516 is committed 00010000:00000080:3.0:1777497778.766985:0:25493:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409bf29180 x1863837546421248/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.767055:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:d146155b-4321-4b14-9284-f644ed9631fb+26:2415:x1863837546421248:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 806us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.767064:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5964 00000100:00100000:2.0:1777497778.769217:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+25:2415:x1863837546421120:12345-192.168.202.4@tcp:4:dd.0 Request processed in 7459us (7679us total) trans 4294969516 rc 0/0 00000100:00100000:2.0:1777497778.769230:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1043 00002000:00100000:2.0:1777497778.769260:0:25314:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x371:0x0] (0->1023) req@ffff92409c251f80 x1863837546421120/t4294969516(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.769269:0:25314:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251f80 with x1863837546421120 ext(0->1023) 00002000:00010000:2.0:1777497778.769276:0:25314:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251f80 00000100:00100000:3.0:1777497778.772652:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.772697:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.772853:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421376 00000100:00100000:2.0:1777497778.772864:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421376 00002000:00100000:2.0:1777497778.772912:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x372:0x0] (0->1023) req@ffff9240bce2ed80 x1863837546421376/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.772922:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2ed80 with x1863837546421376 ext(0->1023) 00002000:00010000:2.0:1777497778.772937:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2ed80 00000100:00100000:2.0:1777497778.772971:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1044 00000100:00100000:2.0:1777497778.772978:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546421376:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:2.0:1777497778.773346:0:8401:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2ed80 x1863837546421376/t4294969517(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497778.773647:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+27:2414:x1863837546421376:12345-192.168.202.4@tcp:4:dd.0 Request processed in 669us (1006us total) trans 4294969517 rc 0/0 00000100:00100000:2.0:1777497778.773653:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1044 00002000:00100000:2.0:1777497778.773658:0:8401:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x372:0x0] (0->1023) req@ffff9240bce2ed80 x1863837546421376/t4294969517(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1777497778.773663:0:8401:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2ed80 with x1863837546421376 ext(0->1023) 00002000:00010000:2.0:1777497778.773665:0:8401:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2ed80 00000100:00100000:1.0:1777497778.773935:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421504 00000100:00100000:1.0:1777497778.773942:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421504 00000100:00100000:1.0:1777497778.773989:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5965 00000100:00100000:1.0:1777497778.774007:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+27:2414:x1863837546421504:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:0.0:1777497778.774285:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969517 is committed 00010000:00000080:1.0:1777497778.774357:0:25491:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2e680 x1863837546421504/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.774565:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546421504:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 558us (1866us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.774573:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5965 00000100:00100000:3.0:1777497778.796012:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.796060:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.796141:0:25492:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421760 00000100:00100000:2.0:1777497778.796151:0:25492:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421760 00000100:00100000:1.0:1777497778.796204:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421632 00000100:00100000:1.0:1777497778.796209:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421632 00000100:00100000:2.0:1777497778.796224:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5966 00000100:00100000:2.0:1777497778.796235:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+26:2412:x1863837546421760:12345-192.168.202.4@tcp:16:kworker.0 00002000:00100000:1.0:1777497778.796253:0:24902:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x373:0x0] (0->1023) req@ffff9240bce2e300 x1863837546421632/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497778.796266:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2e300 with x1863837546421632 ext(0->1023) 00002000:00010000:1.0:1777497778.796271:0:24902:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2e300 00000100:00100000:1.0:1777497778.796294:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1045 00010000:00000080:2.0:1777497778.796304:0:25492:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2c000 x1863837546421760/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.796305:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bce2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+26:2413:x1863837546421632:12345-192.168.202.4@tcp:4:dd.0 00000100:00100000:2.0:1777497778.796376:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+26:2412:x1863837546421760:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 144us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497778.796384:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5966 00010000:00000080:1.0:1777497778.796702:0:24902:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240bce2e300 x1863837546421632/t4294969518(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.796744:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bce2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+27:2413:x1863837546421632:12345-192.168.202.4@tcp:4:dd.0 Request processed in 443us (743us total) trans 4294969518 rc 0/0 00000100:00100000:1.0:1777497778.796750:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1045 00002000:00100000:1.0:1777497778.796757:0:24902:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x373:0x0] (0->1023) req@ffff9240bce2e300 x1863837546421632/t4294969518(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1777497778.796764:0:24902:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9240bce2e300 with x1863837546421632 ext(0->1023) 00002000:00010000:1.0:1777497778.796766:0:24902:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9240bce2e300 00000100:00100000:2.0:1777497778.822529:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.822677:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421888 00000100:00100000:3.0:1777497778.822689:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421888 00002000:00100000:3.0:1777497778.822742:0:24903:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x374:0x0] (0->1023) req@ffff92409c251500 x1863837546421888/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.822754:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251500 with x1863837546421888 ext(0->1023) 00002000:00010000:3.0:1777497778.822760:0:24903:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251500 00000100:00100000:3.0:1777497778.822852:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1046 00000100:00100000:3.0:1777497778.822864:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+27:2415:x1863837546421888:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:3.0:1777497778.823292:0:24903:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251500 x1863837546421888/t4294969519(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.823371:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+29:2415:x1863837546421888:12345-192.168.202.4@tcp:4:dd.0 Request processed in 510us (852us total) trans 4294969519 rc 0/0 00000100:00100000:3.0:1777497778.823379:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1046 00002000:00100000:3.0:1777497778.823387:0:24903:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x374:0x0] (0->1023) req@ffff92409c251500 x1863837546421888/t4294969519(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.823408:0:24903:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251500 with x1863837546421888 ext(0->1023) 00002000:00010000:3.0:1777497778.823411:0:24903:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251500 00000100:00100000:0.0:1777497778.833387:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497778.833654:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422016 00000100:00100000:1.0:1777497778.833681:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422016 00000100:00100000:1.0:1777497778.833751:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5967 00000100:00100000:1.0:1777497778.833761:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+29:2414:x1863837546422016:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:0.0:1777497778.835009:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969519 is committed 00010000:00000080:1.0:1777497778.835161:0:25487:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409bf2b800 x1863837546422016/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497778.835235:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546422016:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 1475us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497778.835242:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5967 00000100:00100000:2.0:1777497778.856466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497778.856523:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497778.856643:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422144 00000100:00100000:3.0:1777497778.856654:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422144 00002000:00100000:3.0:1777497778.856714:0:8403:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x375:0x0] (0->1023) req@ffff92409c251880 x1863837546422144/t0(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/0 e 0 to 0 dl 1777497789 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.856725:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251880 with x1863837546422144 ext(0->1023) 00002000:00010000:3.0:1777497778.856731:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251880 00000100:00100000:3.0:1777497778.856765:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1047 00000100:00100000:3.0:1777497778.856774:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+25:2413:x1863837546422144:12345-192.168.202.4@tcp:4:dd.0 00010000:00000080:3.0:1777497778.857217:0:8403:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c251880 x1863837546422144/t4294969520(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.857282:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+27:2413:x1863837546422144:12345-192.168.202.4@tcp:4:dd.0 Request processed in 509us (825us total) trans 4294969520 rc 0/0 00000100:00100000:3.0:1777497778.857288:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1047 00002000:00100000:3.0:1777497778.857295:0:8403:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x375:0x0] (0->1023) req@ffff92409c251880 x1863837546422144/t4294969520(0) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 1512/448 e 0 to 0 dl 1777497789 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1777497778.857302:0:8403:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff92409c251880 with x1863837546422144 ext(0->1023) 00002000:00010000:3.0:1777497778.857305:0:8403:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff92409c251880 00000100:00100000:3.0:1777497778.857329:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422272 00000100:00100000:3.0:1777497778.857334:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422272 00000100:00100000:3.0:1777497778.857358:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5968 00000100:00100000:3.0:1777497778.857365:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+27:2412:x1863837546422272:12345-192.168.202.4@tcp:16:kworker.0 00000001:00080000:3.0:1777497778.857573:0:8391:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969520 is committed 00010000:00000080:3.0:1777497778.857600:0:25495:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409c250a80 x1863837546422272/t0(0) o16->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:534/0 lens 440/432 e 0 to 0 dl 1777497789 ref 1 fl Interpret:/600/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497778.857626:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+25:2412:x1863837546422272:12345-192.168.202.4@tcp:16:kworker.0 Request processed in 262us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497778.857633:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5968 00000100:00100000:1.0:1777497779.234265:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497779.234289:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565074432:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497779.234355:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.234402:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074432 00000100:00100000:1.0:1777497779.234409:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074432 00000100:00100000:1.0:1777497779.234456:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1777497779.234464:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565074432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497779.234509:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:1.0:1777497779.234566:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565074432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.234573:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4100 00000100:00100000:1.0:1777497779.234619:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565074432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497779.235325:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565074944:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235363:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235392:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565075456:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235413:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235427:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565075968:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235445:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235464:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1777497779.235481:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565074560:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235506:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235529:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565075072:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235549:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235574:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565075584:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235593:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.235616:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074944 00000100:00100000:2.0:1777497779.235621:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074944 00000100:00100000:2.0:1777497779.235657:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075456 00000100:00100000:2.0:1777497779.235659:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075456 00000100:00100000:2.0:1777497779.235685:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075968 00000100:00100000:2.0:1777497779.235688:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075968 00000100:00100000:2.0:1777497779.235697:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075072 00000100:00100000:2.0:1777497779.235699:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075072 00000100:00100000:2.0:1777497779.235712:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1777497779.235718:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565074944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235758:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565074944:12345-0@lo:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.235765:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1777497779.235779:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1777497779.235784:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565075456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235806:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565075456:12345-0@lo:400:kworker.0 Request processed in 22us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.235812:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:2.0:1777497779.235822:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1777497779.235827:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565075968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235847:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565075968:12345-0@lo:400:kworker.0 Request processed in 21us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.235853:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1777497779.235862:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1777497779.235868:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565075072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235889:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565075072:12345-0@lo:400:kworker.0 Request processed in 22us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.235895:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:2.0:1777497779.235910:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074560 00000100:00100000:2.0:1777497779.235913:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074560 00000100:00100000:2.0:1777497779.235947:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1777497779.235959:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565074560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.235986:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565074560:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.235991:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1777497779.236017:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075584 00000100:00100000:2.0:1777497779.236020:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075584 00000100:00100000:2.0:1777497779.236040:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4101 00000100:00100000:2.0:1777497779.236046:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565075584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236072:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565075584:12345-0@lo:400:kworker.0 Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.236078:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4101 00000100:00080000:2.0:1777497779.236092:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497779.236114:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497779.236154:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565074560:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236165:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565075072:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236172:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565075584:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236180:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565074944:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236188:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565075456:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.236195:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565075968:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236481:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837565074688:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236509:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236529:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565075200:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236549:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236578:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565075712:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236612:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236632:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1777497779.236638:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565074816:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236660:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236673:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565075328:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236692:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236709:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f844cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565075840:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236727:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497779.236757:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074688 00000100:00100000:1.0:1777497779.236761:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074688 00000100:00100000:1.0:1777497779.236790:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565074816 00000100:00100000:1.0:1777497779.236792:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565074816 00000100:00100000:1.0:1777497779.236804:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1777497779.236809:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837565074688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236843:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837565074688:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.236849:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:1.0:1777497779.236863:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1777497779.236869:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565074816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.236895:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565074816:12345-0@lo:400:kworker.0 Request processed in 27us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.236900:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1777497779.236920:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075200 00000100:00100000:1.0:1777497779.236936:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075200 00000100:00100000:1.0:1777497779.236963:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075712 00000100:00100000:1.0:1777497779.236966:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075712 00000100:00100000:1.0:1777497779.236982:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075328 00000100:00100000:1.0:1777497779.236991:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075328 00000100:00100000:1.0:1777497779.237013:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565075840 00000100:00100000:1.0:1777497779.237016:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565075840 00000100:00100000:1.0:1777497779.237034:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1777497779.237040:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565075200:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497779.237053:0:25497:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d80e00 x1863837565075200/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:535/0 lens 224/224 e 0 to 0 dl 1777497790 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497779.237081:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565075200:12345-0@lo:400:kworker.0 Request processed in 42us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.237087:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2705 00000100:00100000:1.0:1777497779.237126:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2706 00000100:00100000:1.0:1777497779.237133:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565075712:12345-0@lo:400:kworker.0 00010000:00000080:1.0:1777497779.237143:0:25497:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff9240a6d81f80 x1863837565075712/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:535/0 lens 224/224 e 0 to 0 dl 1777497790 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497779.237168:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565075712:12345-0@lo:400:kworker.0 Request processed in 36us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.237172:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2706 00000100:00100000:1.0:1777497779.237183:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1777497779.237188:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565075328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.238358:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565075328:12345-0@lo:400:kworker.0 Request processed in 1164us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.238367:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2707 00000100:00100000:1.0:1777497779.238388:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2708 00000100:00100000:1.0:1777497779.238397:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565075840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.238432:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565075840:12345-0@lo:400:kworker.0 Request processed in 38us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497779.238451:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2708 00000100:00100000:2.0:1777497779.238659:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1777497779.238674:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f82f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565076096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497779.238713:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497779.238747:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076096 00000100:00100000:2.0:1777497779.238755:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076096 00000100:00100000:2.0:1777497779.238796:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4102 00000100:00100000:2.0:1777497779.238802:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565076096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497779.238828:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:2.0:1777497779.238861:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565076096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497779.238867:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4102 00000100:00080000:1.0:1777497779.239354:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497779.239360:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497779.239363:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497779.239365:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497779.239399:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565074816:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.239413:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f83cf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565075328:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.239424:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565075840:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.239434:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837565074688:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.239444:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565075200:0@lo:400:kworker.0 00000100:00100000:1.0:1777497779.239456:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f844cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565075712:0@lo:400:kworker.0 00000100:00100000:2.0:1777497779.240342:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f82f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565076096:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1777497779.362366:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497779.747284:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1777497779.747306:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565076224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1777497779.747376:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497779.747425:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076224 00000100:00100000:0.0:1777497779.747432:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076224 00000100:00100000:0.0:1777497779.747479:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1777497779.747489:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565076224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1777497779.747519:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 176800064 pending 0 free 3922399232 avail 3690876928 00010000:00000080:0.0:1777497779.747533:0:8400:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff92409bf29f80 x1863837565076224/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:535/0 lens 224/368 e 0 to 0 dl 1777497790 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497779.747574:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565076224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497779.747581:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1777497779.747638:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565076224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1777497779.753385:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565076352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497779.753457:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497779.753510:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076352 00000100:00100000:3.0:1777497779.753518:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076352 00000100:00100000:3.0:1777497779.753561:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2205 00000100:00100000:3.0:1777497779.753572:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565076352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497779.753601:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497779.753642:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565076352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497779.753649:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2205 00000100:00100000:3.0:1777497779.753699:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bce2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565076352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497780.032135:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497780.032178:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497780.032203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497780.032222:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497780.032242:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497780.032370:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422400 00000100:00100000:1.0:1777497780.032381:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422400 00000100:00100000:1.0:1777497780.032427:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:1.0:1777497780.032436:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546422400:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497780.032504:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546422400:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.032512:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 182 00000100:00100000:1.0:1777497780.032546:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422528 00000100:00100000:1.0:1777497780.032550:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422528 00000100:00100000:1.0:1777497780.032584:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422656 00000100:00100000:1.0:1777497780.032587:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422656 00000100:00100000:1.0:1777497780.032608:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1450 00000100:00100000:1.0:1777497780.032614:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+151:2414:x1863837546422528:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497780.032664:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+151:2414:x1863837546422528:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 50us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.032670:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1450 00000100:00100000:1.0:1777497780.032700:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1451 00000100:00100000:1.0:1777497780.032707:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546422656:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497780.032733:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546422656:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 27us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.032739:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1451 00000100:00100000:1.0:1777497780.032755:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422784 00000100:00100000:1.0:1777497780.032759:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422784 00000100:00100000:1.0:1777497780.032782:0:25499:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422912 00000100:00100000:1.0:1777497780.032785:0:25499:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422912 00000100:00100000:1.0:1777497780.032804:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2709 00000100:00100000:1.0:1777497780.032810:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546422784:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000080:1.0:1777497780.032823:0:25499:0:(ldlm_lib.c:3285:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff923f861e3480 x1863837546422784/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:536/0 lens 224/224 e 0 to 0 dl 1777497791 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497780.032848:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+25:2414:x1863837546422784:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 38us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.032869:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2709 00000100:00100000:1.0:1777497780.032881:0:25499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2710 00000100:00100000:1.0:1777497780.032887:0:25499:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546422912:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497780.032910:0:25499:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546422912:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.032925:0:25499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2710 00000100:00080000:1.0:1777497780.032952:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1777497780.032956:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1777497780.032958:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497780.032960:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:0.0:1777497780.386234:0:92092:0:(tgt_mount.c:2017:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1777497780.386300:0:92092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497780.386316:0:92092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497780.386324:0:92092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497780.386331:0:92092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497780.386358:0:92092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1777497780.386363:0:92092:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1777497780.386477:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1777497780.386481:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1777497780.386487:0:92092:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1777497780.386511:0:92092:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1777497780.386573:0:8412:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1777497780.386580:0:8412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386588:0:8412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f88a17e00 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:1.0:1777497780.386592:0:8412:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386600:0:8412:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1777497780.386608:0:8412:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497780.386613:0:8412:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1777497780.386616:0:8412:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1777497780.386618:0:8412:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1777497780.386643:0:8412:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386650:0:8412:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1777497780.386677:0:8412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386684:0:8412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f88a17e00/0x3e357265691e2be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2c5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386695:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497780.386707:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497780.386709:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497780.386718:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1777497780.386737:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565076608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1777497780.386804:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497780.386857:0:19127:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076608 00000100:00100000:1.0:1777497780.386863:0:19127:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076608 00000100:00100000:1.0:1777497780.386909:0:19127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1777497780.386928:0:19127:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3660:x1863837565076608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497780.386941:0:19127:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1777497780.386955:0:19127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff924085eee200/0x3e357265691e2c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691e2be expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.386967:0:19127:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1777497780.387000:0:19127:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3660:x1863837565076608:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497780.387008:0:19127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:1.0:1777497780.387044:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565076608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497780.387217:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565076480:0@lo:39:umount.0 00000100:00100000:2.0:1777497780.387252:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497780.387301:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076480 00000100:00100000:2.0:1777497780.387305:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076480 00000100:00100000:2.0:1777497780.387334:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:2.0:1777497780.387340:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837565076480:12345-0@lo:39:umount.0 00000020:00000080:2.0:1777497780.387365:0:64885:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691def8 00000100:00080000:2.0:1777497780.387988:0:64885:0:(import.c:65:import_set_state_nolock()) ffff923f88a18800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1777497780.388086:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+1:3656:x1863837565076480:12345-0@lo:39:umount.0 Request processed in 745us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497780.388117:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000020:00000080:2.0:1777497780.388125:0:64885:0:(genops.c:906:class_export_put()) final put ffff923f88a1e000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00080000:2.0:1777497780.388184:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409c46a000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497780.388195:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565076480:0@lo:39:umount.0 00000020:00000080:2.0:1777497780.388213:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff923f88a1e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1777497780.388252:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f88a18800 for lustre-MDT0000 00000100:00080000:1.0:1777497780.389333:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1777497780.389339:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1777497780.389347:0:92092:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1777497780.390483:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1777497780.390589:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777497780.390593:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1777497780.390599:0:92092:0:(pinger.c:396:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1777497780.390625:0:92092:0:(import.c:65:import_set_state_nolock()) ffff923f81a03800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1777497780.390683:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1863837565076736:0@lo:39:umount.0 00000100:00100000:2.0:1777497780.390744:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497780.390839:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076736 00000100:00100000:0.0:1777497780.390846:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076736 00000100:00100000:0.0:1777497780.390918:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1777497780.390929:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1863837565076736:12345-0@lo:39:umount.0 00000020:00000080:0.0:1777497780.390954:0:73210:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e3572656917c57 00000100:00080000:0.0:1777497780.390962:0:73210:0:(import.c:65:import_set_state_nolock()) ffff92409fb63800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1777497780.391456:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497780.392471:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+1:3656:x1863837565076736:12345-0@lo:39:umount.0 Request processed in 1538us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497780.392501:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000020:00000080:0.0:1777497780.392518:0:73210:0:(genops.c:906:class_export_put()) final put ffff92409fb63000/lustre-MDT0001-lwp-OST0000_UUID 00010000:00010000:0.0:1777497780.392548:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1777497780.392632:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff92409fb63000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1777497780.392690:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409fb63800 for lustre-MDT0001 00000100:00080000:2.0:1777497780.392809:0:3656:0:(import.c:65:import_set_state_nolock()) ffff923f81a03800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1777497780.392874:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1863837565076736:0@lo:39:umount.0 00000100:00080000:1.0:1777497780.393027:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1777497780.393032:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1777497780.393037:0:92092:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1777497780.395227:0:92092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395247:0:92092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395256:0:92092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395264:0:92092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395329:0:92092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1777497780.395337:0:92092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395344:0:92092:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395350:0:92092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497780.395356:0:92092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395531:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497780.395539:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395547:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee000 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497780.395550:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395559:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497780.395565:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497780.395570:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1777497780.395573:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1777497780.395609:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395617:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497780.395649:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395657:0:83956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee000/0x3e357265691e2cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691e2d3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395671:0:83956:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497780.395673:0:83956:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395692:0:83956:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f896cb800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497780.395695:0:83956:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395701:0:83956:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497780.395707:0:83956:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497780.395712:0:83956:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1777497780.395714:0:83956:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1777497780.395726:0:83956:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395731:0:83956:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1777497780.395746:0:83956:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497780.395753:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497780.395754:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497780.395756:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497780.395773:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565076992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1777497780.395835:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497780.395994:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565076864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497780.396025:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497780.396062:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076992 00000100:00100000:3.0:1777497780.396069:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076992 00000100:00100000:3.0:1777497780.396131:0:10268:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565076864 00000100:00100000:3.0:1777497780.396134:0:10268:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565076864 00000100:00100000:3.0:1777497780.396159:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1777497780.396168:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565076992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497780.396184:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497780.396201:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5aa00/0x3e357265691dece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691dec7 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497780.396216:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497780.396247:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3657:x1863837565076992:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497780.396254:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:3.0:1777497780.396270:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1777497780.396276:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:3660:x1863837565076864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497780.396283:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1777497780.396291:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f89734400/0x3e357265691e2d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3e357265691e2cc expref: 21 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497780.396299:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1777497780.396325:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565076864:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497780.396331:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:2.0:1777497780.396526:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565076992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1777497780.396590:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565076864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1777497780.396744:0:92092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1777497780.396751:0:92092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff923f896cb800/0x3e357265691dec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3e357265691dece expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497780.396764:0:92092:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1777497780.396768:0:92092:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1777497780.396782:0:92092:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1777497780.396827:0:92092:0:(tgt_mount.c:2067:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1777497780.396831:0:92092:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='FA') 00000020:00000080:1.0:1777497780.396836:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:02000400:1.0:1777497780.396843:0:92092:0:(obd_config.c:932:class_cleanup()) Failing over lustre-OST0000 00010000:00010000:3.0:1777497780.399507:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00000080:1.0:1777497780.400676:0:92092:0:(ofd_obd.c:1267:ofd_iocontrol()) lustre-OST0000: cmd=40086672 len=0 karg=0000000000000000 uarg=0000000000000000 00002000:00100000:1.0:1777497780.400727:0:92092:0:(ofd_obd.c:1281:ofd_iocontrol()) syncing ost lustre-OST0000 00000020:00000080:1.0:1777497780.400998:0:92092:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 3/7 00000020:00080000:1.0:1777497780.401009:0:92092:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff924086e21800 d146155b-4321-4b14-9284-f644ed9631fb 192.168.202.4@tcp 24 (0 0 20) 0 0 0 0: 0000000000000000 4294969520 stale:0 00000020:00080000:1.0:1777497780.401017:0:92092:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff9240aef6b800 lustre-MDT0000-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969476 stale:0 00000020:00080000:1.0:1777497780.401021:0:92092:0:(genops.c:1840:print_export_data()) lustre-OST0000: ACTIVE ffff924098a6d800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294969458 stale:0 00000020:00080000:1.0:1777497780.401026:0:92092:0:(genops.c:1574:class_disconnect_exports()) OBD device 18 (ffff9240a6958000) has exports, disconnecting them 00000020:00080000:1.0:1777497780.401032:0:92092:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 192.168.202.4@tcp (ffff924086e21800), last request at 1777497780 00000020:00000080:1.0:1777497780.401039:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691e10c 00000020:00010000:1.0:1777497780.401048:0:92092:0:(genops.c:1942:obd_stale_export_put()) Put export ffff924086e21800: total 0 00000100:00080000:1.0:1777497780.401053:0:92092:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777497780.401285:0:92092:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.202.4@tcp (ffff924086e21800): rc 0 00000020:00080000:1.0:1777497780.401289:0:92092:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff9240aef6b800), last request at 1777497779 00000020:00000080:1.0:1777497780.401293:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e357265691ddc4 00000100:00080000:1.0:1777497780.401297:0:92092:0:(import.c:65:import_set_state_nolock()) ffff9240aef68800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1777497780.401461:0:6502:0:(genops.c:1928:obd_stale_export_get()) Get export ffff924086e21800: total 0 00010000:00010000:0.0:1777497780.401508:0:6502:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff924086e21800, canceled 0 locks, left on hash table 20. 00002000:00010000:0.0:1777497780.401539:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401543:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x373:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401565:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f27f7b7/0x3e357265691ec9d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x373:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c0 expref: 21 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401593:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401596:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x367:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401603:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005251da74/0x3e357265691e9da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x367:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6e0 expref: 20 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401618:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401620:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36f:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401627:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee594e97/0x3e357265691ebf5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c773 expref: 19 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401641:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401644:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x372:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401651:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000918b28e3/0x3e357265691ec81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x372:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7b2 expref: 18 pid: 25489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401666:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401680:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x366:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401689:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000350bc77f/0x3e357265691e8de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x366:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c67e expref: 17 pid: 8717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401706:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401708:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36a:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401715:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f0c6353/0x3e357265691ea51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6fc expref: 16 pid: 25493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401729:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401731:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x362:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401737:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fa5cf5d/0x3e357265691e844 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x362:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c64d expref: 15 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401751:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401753:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x375:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401759:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8a1db41/0x3e357265691eac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x375:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c71f expref: 14 pid: 25491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401772:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401775:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36e:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401781:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027f5756c/0x3e357265691eb85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c75e expref: 13 pid: 23437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401795:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401797:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x370:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401802:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000514994fb/0x3e357265691ec42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x370:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c79d expref: 12 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401827:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401830:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x363:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401837:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb6fba19/0x3e357265691e8a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x363:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c670 expref: 11 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401851:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401854:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x369:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401861:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9539a9a/0x3e357265691e94e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x369:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6af expref: 10 pid: 25490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401891:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401893:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36c:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401899:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7e215aa/0x3e357265691eb0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c73b expref: 9 pid: 25488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401924:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401926:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x368:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401933:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e48ec24/0x3e357265691e9cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x368:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6cb expref: 8 pid: 25496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401947:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401949:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36b:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401956:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f66913b0/0x3e357265691ea89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c70a expref: 7 pid: 25486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.401984:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.401986:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x36d:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.401995:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7729689/0x3e357265691eb46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c749 expref: 6 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.402010:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.402013:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x374:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.402019:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000200a2bed/0x3e357265691ecab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x374:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7c7 expref: 5 pid: 8398 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.402034:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.402036:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x371:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.402042:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a014a729/0x3e357265691ec0a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x371:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c796 expref: 4 pid: 25497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.402056:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.402059:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x364:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.402065:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a671882/0x3e357265691e8ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x364:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c677 expref: 3 pid: 25487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1777497780.402077:0:6502:0:(ofd_lvb.c:305:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb size from disk: 0 -> 1024 00002000:00010000:0.0:1777497780.402079:0:6502:0:(ofd_lvb.c:330:ofd_lvbo_update()) res: [0x280000401:0x365:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1777497780.402085:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b2c31be/0x3e357265691e9c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x365:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801080000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c6b6 expref: 2 pid: 25494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497780.402146:0:6502:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff924086e21800, canceled 20 locks, left on hash table 0. 00000020:00000080:0.0:1777497780.403367:0:6502:0:(genops.c:906:class_export_put()) final put ffff924086e21800/d146155b-4321-4b14-9284-f644ed9631fb 00010000:00010000:0.0:1777497780.403610:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497780.403613:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497780.403615:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777497780.403993:0:92092:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240aef6b800): rc 0 00000020:00000080:1.0:1777497780.403996:0:92092:0:(genops.c:906:class_export_put()) final put ffff9240aef6b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1777497780.404027:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff924086e21800/d146155b-4321-4b14-9284-f644ed9631fb for lustre-OST0000 00000020:00000080:3.0:1777497780.404090:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924086e27000 for lustre-OST0000 00010000:00010000:2.0:1777497780.404157:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1777497780.404260:0:92092:0:(genops.c:1549:class_disconnect_export_list()) lustre-OST0000: disconnecting export at 0@lo (ffff924098a6d800), last request at 1777497779 00000020:00000080:1.0:1777497780.404267:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e3572656917bcb 00000100:00080000:1.0:1777497780.404277:0:92092:0:(import.c:65:import_set_state_nolock()) ffff924098a6a000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1777497780.404297:0:92092:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff924098a6d800): rc 0 00000020:00000080:1.0:1777497780.404299:0:92092:0:(genops.c:906:class_export_put()) final put ffff924098a6d800/lustre-MDT0001-mdtlov_UUID 00010000:00010000:2.0:1777497780.404322:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1777497780.404342:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240aef6b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1777497780.404486:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9240aef68800 for lustre-OST0000 00000020:00080000:1.0:1777497780.404566:0:92092:0:(genops.c:1579:class_disconnect_exports()) OBD device 18 (ffff9240a6958000) has no exports 00000020:00000080:0.0:1777497780.406239:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff924098a6d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1777497780.406979:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff924098a6a000 for lustre-OST0000 00000020:01000000:1.0:1777497780.407043:0:92092:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff9240885c9000 - data ffff9240a317a870/ffff923f824dd800 00000020:01000000:1.0:1777497780.407364:0:92092:0:(lprocfs_status_server.c:298:lprocfs_free_client_stats()) stat ffff92409c58c840 - data ffff9240a313c948/ffff9240be1f7400 00100000:10000000:1.0:1777497780.419791:0:92092:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1777497780.426520:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e35726568d12ef 00000020:00000080:0.0:1777497780.426531:0:92092:0:(genops.c:906:class_export_put()) final put ffff923f81240000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1777497780.426583:0:92092:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9240bcd94000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1777497780.426587:0:92092:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240bcd94000 2 00000020:01000004:0.0:1777497780.426590:0:92092:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9240bcd94000 from lustre-OST0000 00000020:00000080:0.0:1777497780.426619:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1777497780.426632:0:92092:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1777497780.426636:0:92092:0:(genops.c:906:class_export_put()) final put ffff923f81241000/lustre-OST0000_UUID 00000020:00000080:0.0:1777497780.426639:0:92092:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81241000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1777497780.426645:0:92092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1777497780.426691:0:92092:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000000:0.0:1777497780.426695:0:92092:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1777497780.426699:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1777497780.426705:0:92092:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1777497780.426711:0:92092:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9240849d3000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1777497780.426716:0:92092:0:(genops.c:1574:class_disconnect_exports()) OBD device 19 (ffff9240bb69b380) has exports, disconnecting them 00000020:00080000:0.0:1777497780.426720:0:92092:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9240849d3000), last request at 1777494148 00000020:00000080:0.0:1777497780.426724:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e35726568d1319 00000020:00080000:0.0:1777497780.426741:0:92092:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff9240849d3000): rc 0 00000020:00000080:0.0:1777497780.426747:0:92092:0:(genops.c:906:class_export_put()) final put ffff9240849d3000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1777497780.426858:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81240000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1777497780.427185:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d3000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1777497780.433206:0:92092:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1777497780.433223:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1777497780.433227:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1777497780.433234:0:92092:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1777497780.433369:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1777497780.433389:0:92092:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1777497780.433397:0:92092:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1777497780.433400:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1777497780.433405:0:92092:0:(obd_config.c:955:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1777497780.433413:0:92092:0:(genops.c:1840:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff923f81a06000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1777497780.433420:0:92092:0:(genops.c:1574:class_disconnect_exports()) OBD device 20 (ffff9240bb69cd40) has exports, disconnecting them 00000020:00080000:2.0:1777497780.433424:0:92092:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff923f81a06000), last request at 1777494148 00000020:00000080:2.0:1777497780.433427:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e35726568d132e 00000020:00080000:2.0:1777497780.433439:0:92092:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff923f81a06000): rc 0 00000020:00000080:2.0:1777497780.433445:0:92092:0:(genops.c:906:class_export_put()) final put ffff923f81a06000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1777497780.434045:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff92409c46a000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1777497780.434053:0:38121:0:(genops.c:906:class_export_put()) final put ffff9240849d1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1777497780.434056:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240849d1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1777497780.434062:0:38121:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1777497780.434157:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff923f81a06000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1777497780.435151:0:92092:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1777497780.435157:0:92092:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1777497780.435161:0:92092:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1777497780.435167:0:92092:0:(import.c:321:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1777497780.435192:0:38121:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff923f81a03800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1777497780.435309:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497780.435320:0:92092:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1777497780.435324:0:92092:0:(genops.c:906:class_export_put()) final put ffff9240a6836800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1777497780.435327:0:92092:0:(genops.c:865:class_export_destroy()) destroying export ffff9240a6836800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1777497780.435332:0:92092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1777497780.435399:0:92092:0:(obd_mount.c:701:lustre_put_lsi()) put ffff9240bcd94000 1 00000020:00000080:3.0:1777497780.435404:0:92092:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3e35726568d12b7 00000020:00000080:3.0:1777497780.435410:0:92092:0:(genops.c:906:class_export_put()) final put ffff9240bcd93000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1777497780.435418:0:92092:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1777497780.435425:0:38121:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcd93000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1777497780.435433:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1777497780.435438:0:92092:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1777497780.435441:0:92092:0:(genops.c:1579:class_disconnect_exports()) OBD device 16 (ffff924099060000) has no exports 00000020:00000080:3.0:1777497780.465009:0:92092:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1777497780.465037:0:92092:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1777497780.465042:0:92092:0:(genops.c:906:class_export_put()) final put ffff9240bcd92000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1777497780.465047:0:92092:0:(genops.c:865:class_export_destroy()) destroying export ffff9240bcd92000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1777497780.465060:0:92092:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1777497780.465466:0:92092:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff9240bcd90800 00000020:02000400:3.0:1777497780.465526:0:92092:0:(tgt_mount.c:2136:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1777497781.285992:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565077120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1777497781.286022:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565077248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497781.286075:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497781.286741:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497781.286785:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077120 00000100:00100000:3.0:1777497781.286793:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077120 00000100:00100000:3.0:1777497781.286830:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077248 00000100:00100000:3.0:1777497781.286833:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077248 00000100:00100000:3.0:1777497781.286867:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2206 00000100:00100000:3.0:1777497781.286873:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1863837565077120:12345-0@lo:13:osp-pre-0-1.0 00000020:00080000:3.0:1777497781.286881:0:8400:0:(tgt_handler.c:795:tgt_request_handle()) operation 13 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1777497781.286965:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2207 00000100:00100000:0.0:1777497781.286975:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409cad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565077248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1777497781.286994:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1777497781.288352:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409cad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565077248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1374us (1608us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497781.288362:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2207 00000100:00100000:1.0:1777497781.288586:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565077248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497781.289794:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0+-99:3658:x1863837565077120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2915us (3715us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497781.289805:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2206 00000100:00080000:3.0:1777497781.290049:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:02020000:0.0:1777497781.290618:0:3658:0:(client.c:1490:ptlrpc_check_status()) lustre-OST0000-osc-MDT0001: operation ost_statfs to node 0@lo failed: rc = -107 00000100:00080000:0.0:1777497781.310700:0:3658:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0001 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1777497781.310710:0:3658:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1777497781.310716:0:3658:0:(import.c:181:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:0.0:1777497781.310738:0:3658:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000100:00080000:0.0:1777497781.310742:0:3658:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1777497781.310747:0:3658:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3014 00000100:00080000:0.0:1777497781.310757:0:3658:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:1.0:1777497781.311010:0:3658:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d80000 x1863837565077376/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497781.311163:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565077376:0@lo:8:ptlrpcd_00_01.0 00000100:00100000:2.0:1777497781.311233:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497781.315446:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077376 00000100:00100000:0.0:1777497781.315461:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077376 00000100:00100000:0.0:1777497781.315511:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5969 00000100:00100000:0.0:1777497781.315519:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3656:x1863837565077376:12345-0@lo:8:ptlrpcd_00_01.0 00010000:00020000:0.0:1777497781.315544:0:25496:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497781.315629:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:3656:x1863837565077376:12345-0@lo:8:ptlrpcd_00_01.0 Request processed in 109us (4395us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497781.315646:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5969 00000100:00080000:0.0:1777497781.315695:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497781.315700:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497781.315704:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565077376:0@lo:8:ptlrpcd_00_01.0 00010000:00010000:3.0:1777497781.411472:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497782.438416:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497783.458808:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1777497783.844181:0:90569:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-MDT0000: transno 120259084436 is committed 00010000:00010000:2.0:1777497783.844599:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844613:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844620:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844626:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd9000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.844630:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844638:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844664:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x6:0x0].0x0 (ffff924083cd1900) 00010000:00010000:2.0:1777497783.844667:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.844821:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844830:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f82fd9000/0x3e357265691e81a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844936:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844943:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844949:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844955:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ffc00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.844958:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844964:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844975:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x7:0x0].0x0 (ffff9240a6e49800) 00010000:00010000:2.0:1777497783.844978:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.844981:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.844987:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ffc00/0x3e357265691e88a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845012:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845018:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845023:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845028:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845031:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845037:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845045:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x8:0x0].0x0 (ffff9240a6e49000) 00010000:00010000:2.0:1777497783.845048:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845050:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845056:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375600/0x3e357265691e891 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845066:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845072:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845079:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845217:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7ff600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845221:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845227:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845235:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xa:0x0].0x0 (ffff9240a6e49300) 00010000:00010000:2.0:1777497783.845312:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845317:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845324:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7ff600/0x3e357265691e8d7 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845337:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845343:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845348:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845352:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924087d39a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845355:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845361:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845378:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xd:0x0].0x0 (ffff924093e6e900) 00010000:00010000:2.0:1777497783.845381:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845384:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845389:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924087d39a00/0x3e357265691e947 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845400:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845406:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845411:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845415:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845417:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845423:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845429:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x9:0x0].0x0 (ffff924093e6e500) 00010000:00010000:2.0:1777497783.845432:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845434:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845440:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe400/0x3e357265691e955 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845463:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845469:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845475:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845480:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9240bb7fe200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845482:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845487:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845494:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xc:0x0].0x0 (ffff9240a6e49200) 00010000:00010000:2.0:1777497783.845497:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845499:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845505:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9240bb7fe200/0x3e357265691e98d lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845516:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845522:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845529:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845539:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84374000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845542:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845547:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845555:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xb:0x0].0x0 (ffff9240a6e49900) 00010000:00010000:2.0:1777497783.845557:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845560:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845565:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84374000/0x3e357265691e9d3 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845578:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845584:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845589:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845593:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845596:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845601:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845618:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xe:0x0].0x0 (ffff924090680c00) 00010000:00010000:2.0:1777497783.845620:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845623:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845629:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a200/0x3e357265691ea43 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 64885 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845642:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845648:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845653:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845658:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150ae00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845661:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845666:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845925:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0xf:0x0].0x0 (ffff924090680100) 00010000:00010000:2.0:1777497783.845929:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.845933:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845940:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150ae00/0x3e357265691ea4a lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0xf:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845962:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845968:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845974:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845980:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924099079a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.845983:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845989:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.845996:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x19:0x0].0x0 (ffff9240817a3e00) 00010000:00010000:2.0:1777497783.845999:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846002:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846007:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924099079a00/0x3e357265691ea90 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846015:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846020:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846026:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846035:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9400 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846039:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846044:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846051:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x10:0x0].0x0 (ffff924093e6eb00) 00010000:00010000:2.0:1777497783.846053:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846056:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846061:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9400/0x3e357265691eacf lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846071:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846077:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846084:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846088:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df9c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846200:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846209:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846226:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x11:0x0].0x0 (ffff924093e6e800) 00010000:00010000:2.0:1777497783.846228:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846232:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846320:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df9c00/0x3e357265691eb07 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x11:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846337:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846344:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846350:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846355:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df8c00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846359:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846365:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846373:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x12:0x0].0x0 (ffff924090680200) 00010000:00010000:2.0:1777497783.846376:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846379:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846384:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8c00/0x3e357265691eb5b lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x12:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846404:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846410:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846415:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846420:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086df8000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846423:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846429:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846436:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x13:0x0].0x0 (ffff9240817a3300) 00010000:00010000:2.0:1777497783.846438:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846441:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846446:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086df8000/0x3e357265691eb8c lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x13:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846455:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846459:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846465:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846477:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff92408150a000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846480:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846485:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846492:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x14:0x0].0x0 (ffff924093e6ef00) 00010000:00010000:2.0:1777497783.846494:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846497:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846502:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff92408150a000/0x3e357265691ebfc lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x14:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846514:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846520:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846525:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846529:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89734600 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846532:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846537:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846554:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x15:0x0].0x0 (ffff924093e6e200) 00010000:00010000:2.0:1777497783.846556:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846559:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846564:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89734600/0x3e357265691ec03 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x15:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 65418 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846576:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846583:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846589:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846594:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f84375200 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846597:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846602:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846610:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x16:0x0].0x0 (ffff924093e6e700) 00010000:00010000:2.0:1777497783.846612:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846614:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846619:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f84375200/0x3e357265691ec49 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x16:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846637:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846643:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846649:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846654:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f89735000 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.846657:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846662:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846669:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x17:0x0].0x0 (ffff924091207600) 00010000:00010000:2.0:1777497783.846671:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.846966:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846974:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff923f89735000/0x3e357265691ec88 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x17:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 73210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846988:0:3643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,1 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.846994:0:3643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 2/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.847000:0:3643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.847010:0:3643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924086d88a00 already unused, calling callback (ffffffffc19054f0) 00010000:00010000:2.0:1777497783.847013:0:3643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 3/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.847019:0:3643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 4/0,0 mode: TXN/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.847028:0:3643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20000cf21:0x18:0x0].0x0 (ffff9240a6e49a00) 00010000:00010000:2.0:1777497783.847030:0:3643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1777497783.847033:0:3643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 2/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497783.847038:0:3643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff924086d88a00/0x3e357265691eca4 lrc: 0/0,0 mode: --/TXN res: [0x20000cf21:0x18:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 63727 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1777497784.354272:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497784.354277:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1777497784.354281:0:38121:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497784.354289:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3910 00000100:00100000:2.0:1777497784.354292:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565077760:0@lo:400:kworker.0 00000100:00080000:3.0:1777497784.354294:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1777497784.354300:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497784.354319:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff923f861e0700 x1863837565078144/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497784.354356:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354397:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565078400:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354399:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565077504:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354420:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.354426:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354435:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565078912:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354449:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565077632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497784.354452:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354467:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1777497784.354473:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565077888:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354484:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354493:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.354500:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565078272:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354505:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565078528:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354520:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.354521:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.354533:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565078784:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354546:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077760 00000100:00100000:3.0:1777497784.354551:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354558:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077760 00000100:00100000:3.0:1777497784.354567:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1777497784.354572:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565078016:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354590:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.354605:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565078656:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354608:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078400 00000100:00100000:2.0:1777497784.354611:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078400 00000100:00100000:3.0:1777497784.354624:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354629:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078912 00000100:00100000:2.0:1777497784.354632:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078912 00000100:00100000:2.0:1777497784.354642:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077888 00000100:00100000:2.0:1777497784.354644:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077888 00000100:00100000:3.0:1777497784.354657:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f861e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565078144:0@lo:8:kworker.0 00000100:00100000:3.0:1777497784.354679:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497784.354679:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:2.0:1777497784.354688:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565077760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354706:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1777497784.354712:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565078400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354736:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565078400:12345-0@lo:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497784.354736:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565077760:12345-0@lo:400:kworker.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.354743:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:2.0:1777497784.354746:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1777497784.354759:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1777497784.354762:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1777497784.354764:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565078912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354767:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565077888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.354786:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565078912:12345-0@lo:400:kworker.0 Request processed in 22us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497784.354786:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565077888:12345-0@lo:400:kworker.0 Request processed in 19us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497784.354792:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1777497784.354797:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:3.0:1777497784.354812:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077504 00000100:00100000:2.0:1777497784.354813:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565077632 00000100:00100000:3.0:1777497784.354815:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077504 00000100:00100000:2.0:1777497784.354815:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565077632 00000100:00100000:2.0:1777497784.354835:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078528 00000100:00100000:2.0:1777497784.354837:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078528 00000100:00100000:2.0:1777497784.354845:0:8406:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078016 00000100:00100000:2.0:1777497784.354847:0:8406:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078016 00000100:00100000:3.0:1777497784.354852:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1777497784.354858:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565077504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.354858:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4103 00000100:00100000:2.0:1777497784.354862:0:8406:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565077632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497784.354897:0:8406:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:3.0:1777497784.354903:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565077504:12345-0@lo:400:kworker.0 Request processed in 46us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.354908:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1777497784.354924:0:8406:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:3660:x1863837565077632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497784.354930:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4103 00000100:00100000:3.0:1777497784.355397:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1777497784.355406:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565078528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.355438:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565078528:12345-0@lo:400:kworker.0 Request processed in 35us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.355444:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4104 00000100:00100000:3.0:1777497784.355457:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4105 00000100:00100000:3.0:1777497784.355537:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565078016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.355565:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3adc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565078016:12345-0@lo:400:kworker.0 Request processed in 103us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.355571:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4105 00000100:00100000:3.0:1777497784.355588:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078272 00000100:00100000:3.0:1777497784.355592:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078272 00000100:00100000:3.0:1777497784.355616:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078784 00000100:00100000:3.0:1777497784.355618:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078784 00000100:00100000:3.0:1777497784.355633:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078656 00000100:00100000:3.0:1777497784.355635:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078656 00000100:00100000:3.0:1777497784.355646:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565078144 00000100:00100000:3.0:1777497784.355648:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565078144 00000100:00100000:3.0:1777497784.355660:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1777497784.355672:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565078272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.355701:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565078272:12345-0@lo:400:kworker.0 Request processed in 30us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.355706:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2711 00000100:00100000:3.0:1777497784.355717:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1777497784.355722:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565078784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.355746:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3add180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565078784:12345-0@lo:400:kworker.0 Request processed in 24us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497784.355751:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2712 00000100:00100000:3.0:1777497784.355761:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5970 00000100:00100000:3.0:1777497784.355764:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3660:x1863837565078656:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1777497784.355770:0:8398:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1777497784.355788:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3660:x1863837565078656:12345-0@lo:400:kworker.0 Request processed in 23us (1164us total) trans 0 rc -107/-107 00000100:00100000:3.0:1777497784.355792:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5970 00000100:00100000:3.0:1777497784.355799:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5971 00000100:00100000:3.0:1777497784.355802:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1863837565078144:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1777497784.355818:0:8398:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497784.356479:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497784.356993:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497784.357004:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3656:x1863837565078144:12345-0@lo:8:kworker.0 Request processed in 1199us (2324us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497784.357012:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5971 00000100:00100000:1.0:1777497784.357032:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079040 00000100:00080000:3.0:1777497784.357036:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497784.357037:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079040 00000100:00080000:3.0:1777497784.357041:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1777497784.357044:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497784.357066:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1777497784.357073:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565079040:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497784.357112:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565078016:0@lo:400:kworker.0 00000100:00080000:3.0:1777497784.357125:0:3660:0:(recover.c:203:ptlrpc_request_handle_notconn()) import lustre-OST0000-osc-MDT0000 of lustre-OST0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1777497784.357136:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1777497784.357139:0:3660:0:(import.c:181:ptlrpc_set_import_discon()) lustre-OST0000-osc-MDT0000: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000004:00080000:3.0:1777497784.357152:0:3660:0:(osp_dev.c:1613:osp_import_event()) got disconnected 00000100:00080000:3.0:1777497784.357155:0:3660:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497784.357159:0:3660:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3862 00000100:00080000:3.0:1777497784.357165:0:3660:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000100:00100000:3.0:1777497784.357186:0:3660:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff924089359500 x1863837565079168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1777497784.357199:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565078656:0@lo:400:kworker.0 00000004:00000024:1.0:1777497784.357201:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:3.0:1777497784.357210:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565077504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.357227:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565077632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497784.357235:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565079040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497784.357242:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4106 00000100:00100000:1.0:1777497784.357270:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565079040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1777497784.357341:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565079168:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:0.0:1777497784.357372:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1777497784.357402:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1777497784.357407:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1777497784.357410:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565078144:0@lo:8:kworker.0 00000100:00100000:3.0:1777497784.358194:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565078272:0@lo:400:kworker.0 00000100:00100000:3.0:1777497784.358221:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565078784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497784.359804:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079168 00000100:00100000:1.0:1777497784.359815:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079168 00000100:00100000:1.0:1777497784.359871:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5972 00000100:00100000:1.0:1777497784.359888:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1863837565079168:12345-0@lo:8:ptlrpcd_00_03.0 00010000:00020000:1.0:1777497784.359914:0:8396:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1777497784.359987:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1863837565079168:12345-0@lo:8:ptlrpcd_00_03.0 Request processed in 98us (2614us total) trans 0 rc -19/-19 00000100:00100000:1.0:1777497784.359994:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5972 00000100:00080000:1.0:1777497784.360052:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497784.360059:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1777497784.360062:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565079168:0@lo:8:ptlrpcd_00_03.0 00000100:00100000:2.0:1777497784.360231:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565077888:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.360245:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565078528:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.360258:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565078400:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.360267:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565078912:0@lo:400:kworker.0 00000100:00100000:2.0:1777497784.360278:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f861e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565077760:0@lo:400:kworker.0 00010000:00010000:3.0:1777497784.483350:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497784.866311:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497784.866337:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565079296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497784.866412:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497784.866624:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079296 00000100:00100000:1.0:1777497784.866633:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079296 00000100:00100000:1.0:1777497784.866691:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1777497784.866701:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565079296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497784.866732:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497784.866778:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565079296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497784.866785:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2208 00000100:00100000:1.0:1777497784.868984:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92408935a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565079296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497785.155116:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497785.155150:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497785.155176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497785.155197:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497785.155218:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497785.155262:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423168 00000100:00100000:2.0:1777497785.155273:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423168 00000100:00100000:2.0:1777497785.155335:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423296 00000100:00100000:2.0:1777497785.155338:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423296 00000100:00100000:2.0:1777497785.155361:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1456 00000100:00100000:2.0:1777497785.155371:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2412:x1863837546423168:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497785.155441:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2412:x1863837546423168:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 72us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497785.155448:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1456 00000100:00100000:2.0:1777497785.155464:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1457 00000100:00100000:2.0:1777497785.155470:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546423296:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497785.155505:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+11:2412:x1863837546423296:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497785.155511:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1457 00000100:00100000:2.0:1777497785.155530:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423424 00000100:00100000:2.0:1777497785.155533:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423424 00000100:00100000:2.0:1777497785.155551:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423552 00000100:00100000:2.0:1777497785.155554:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423552 00000100:00100000:2.0:1777497785.155574:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2713 00000100:00100000:2.0:1777497785.155579:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546423552:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497785.155603:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+7:2412:x1863837546423552:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497785.155609:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2713 00000100:00100000:2.0:1777497785.155620:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5973 00000100:00100000:2.0:1777497785.155624:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2412:x1863837546423424:12345-192.168.202.4@tcp:400:kworker.0 00000020:00080000:2.0:1777497785.155630:0:25494:0:(tgt_handler.c:795:tgt_request_handle()) operation 400 on unconnected OST from 12345-192.168.202.4@tcp 00000100:00100000:2.0:1777497785.155650:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f844cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:0+-99:2412:x1863837546423424:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (499us total) trans 0 rc -107/-107 00000100:00100000:2.0:1777497785.155656:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5973 00000100:00100000:2.0:1777497785.155670:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423040 00000100:00100000:2.0:1777497785.155673:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423040 00000100:00100000:2.0:1777497785.155696:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00100000:2.0:1777497785.155702:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546423040:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497785.155722:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546423040:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 21us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497785.155729:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 184 00000100:00080000:2.0:1777497785.155763:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1777497785.155767:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497785.155769:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1777497785.186377:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497785.186442:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423680 00000100:00100000:0.0:1777497785.186451:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423680 00000100:00100000:0.0:1777497785.186496:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5974 00000100:00100000:0.0:1777497785.186504:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2411:x1863837546423680:12345-192.168.202.4@tcp:8:ptlrpcd_00_00.0 00010000:00020000:0.0:1777497785.186529:0:25493:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1777497785.186592:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:2411:x1863837546423680:12345-192.168.202.4@tcp:8:ptlrpcd_00_00.0 Request processed in 88us (221us total) trans 0 rc -19/-19 00000100:00100000:0.0:1777497785.186599:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5974 00010000:00010000:2.0:1777497785.506545:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1777497786.396236:0:92420:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing load_module ../libcfs/libcfs/libcfs 00000100:00100000:3.0:1777497786.412752:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565079424:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1777497786.413381:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497786.413938:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079424 00000100:00100000:2.0:1777497786.413947:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079424 00000100:00100000:2.0:1777497786.414685:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2209 00000100:00100000:2.0:1777497786.414701:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565079424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497786.414736:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1777497786.414818:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92408935a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565079424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497786.414826:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2209 00000100:00080000:0.0:1777497786.417140:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1777497786.417546:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565079424:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497786.530365:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497787.556330:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497788.578330:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:3.0:1777497789.475525:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475542:0:38121:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497789.475569:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475586:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000067acf47a] to pc [ptlrpcd_00_00+0] req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475621:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475628:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f8275c800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1777497789.475637:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475647:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000701a40df] to pc [ptlrpcd_00_01+1] req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475654:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475661:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f82ab3800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1777497789.475667:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475675:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf881137] to pc [ptlrpcd_00_02+2] req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475691:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475697:0:38121:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1777497789.475704:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475714:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003304ad51] to pc [ptlrpcd_00_03+3] req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497789.475722:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497789.475726:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1777497789.475729:0:38121:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497789.475734:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3913 00000100:00080000:3.0:1777497789.475739:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00000040:3.0:1777497789.475747:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:3.0:1777497789.475751:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:3.0:1777497789.475754:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bb6 00000020:00000040:3.0:1777497789.475758:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a89000 refcount=4 00000100:00000040:3.0:1777497789.475761:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:3.0:1777497789.475763:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:3.0:1777497789.475766:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a89000 : new refcount 3 00000100:00080000:3.0:1777497789.475770:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497789.475796:0:38121:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1777497789.475808:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475817:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005443ca26] to pc [ptlrpcd_rcv+-1] req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475841:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475847:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1777497789.475854:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475864:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e20a1433] to pc [ptlrpcd_00_00+0] req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475872:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475876:0:38121:0:(genops.c:1231:class_import_get()) import ffff92409c5dd800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1777497789.475882:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475890:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007c6c658c] to pc [ptlrpcd_00_01+1] req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475898:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475907:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1777497789.475914:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475923:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000031983dca] to pc [ptlrpcd_00_02+2] req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497789.475931:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497789.475934:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1777497789.475936:0:38121:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497789.475940:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3913 00000100:00080000:3.0:1777497789.475943:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:3.0:1777497789.475946:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:3.0:1777497789.475949:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:3.0:1777497789.475951:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddbd 00000020:00000040:3.0:1777497789.475953:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f839d0800 refcount=4 00000100:00000040:3.0:1777497789.475956:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:3.0:1777497789.475959:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:3.0:1777497789.475961:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f839d0800 : new refcount 3 00000100:00080000:3.0:1777497789.475963:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497789.475969:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1777497789.475975:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.475984:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004b854ddb] to pc [ptlrpcd_rcv+-1] req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.475991:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.475996:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497789.476002:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.476016:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006ceefcbe] to pc [ptlrpcd_00_03+3] req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476023:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497789.476028:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bb6f5800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1777497789.476034:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497789.476042:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cdddd431] to pc [ptlrpcd_00_00+0] req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476052:0:38121:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (3923) 00000100:00000040:3.0:1777497789.476077:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476090:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565079680:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476138:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476146:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476183:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240865b1500 x1863837565079680 msgsize 224 00000100:00100000:3.0:1777497789.476201:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476219:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476230:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8988 usecs (9 jiffies) 00000100:00000040:3.0:1777497789.476237:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476244:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565080320:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476256:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476269:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476284:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8df80 x1863837565080320 msgsize 224 00000100:00100000:3.0:1777497789.476288:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476302:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476311:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 79012 usecs (80 jiffies) 00000100:00100000:3.0:1777497789.476323:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00000040:3.0:1777497789.476327:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476335:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565079552:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476356:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476363:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476379:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240aecd7450 x1863837565079552 msgsize 224 00000100:00100000:3.0:1777497789.476383:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476385:0:3658:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497789.476396:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476417:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476426:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565080192:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476437:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476445:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476456:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8dc00 x1863837565080192 msgsize 224 00000100:00100000:3.0:1777497789.476460:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476472:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476487:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4956 usecs (5 jiffies) 00000100:00000040:3.0:1777497789.476492:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476501:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565080832:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476512:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476519:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476529:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8ce00 x1863837565080832 msgsize 224 00000100:00100000:3.0:1777497789.476532:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476541:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476550:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6787 usecs (7 jiffies) 00000100:00000040:3.0:1777497789.476565:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476574:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565079808:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476584:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476591:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476600:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8fb80 x1863837565079808 msgsize 224 00000100:00100000:3.0:1777497789.476605:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476613:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476622:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8576 usecs (9 jiffies) 00000100:00000040:3.0:1777497789.476627:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476635:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565080448:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476653:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476660:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476675:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8d180 x1863837565080448 msgsize 224 00000100:00100000:3.0:1777497789.476678:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476689:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476698:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4476 usecs (5 jiffies) 00000100:00100000:3.0:1777497789.476705:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00000040:3.0:1777497789.476710:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476719:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565079936:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476729:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476736:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476746:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8d880 x1863837565079936 msgsize 224 00000100:00100000:3.0:1777497789.476750:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476761:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476770:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1864028 usecs (1865 jiffies) 00000100:00000040:3.0:1777497789.476775:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476783:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565080704:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.476793:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476800:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476809:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8e680 x1863837565080704 msgsize 224 00000100:00100000:3.0:1777497789.476817:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476842:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476852:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6243 usecs (7 jiffies) 00000100:00000040:3.0:1777497789.476866:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476875:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565080064:0@lo:8:kworker.0 00000100:00000040:3.0:1777497789.476886:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497809 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476893:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476904:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8ea00 x1863837565080064 msgsize 520 00000100:00100000:3.0:1777497789.476908:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476917:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497809 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476927:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5273 usecs (6 jiffies) 00000100:00000040:3.0:1777497789.476932:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.476940:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565080576:0@lo:8:kworker.0 00000100:00000040:3.0:1777497789.476950:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497804 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476957:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.476966:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8c000 x1863837565080576 msgsize 520 00000100:00100000:3.0:1777497789.476969:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.476980:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497804 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.476988:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4018 usecs (5 jiffies) 00000100:00100000:3.0:1777497789.477009:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079680 00000100:00100000:3.0:1777497789.477020:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079680 00000020:00000040:3.0:1777497789.477024:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691deff 00000020:00000040:3.0:1777497789.477027:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1e800 refcount=5 00000020:00000040:3.0:1777497789.477041:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00000040:3.0:1777497789.477063:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497789.477082:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080320 00000100:00100000:3.0:1777497789.477085:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080320 00000020:00000040:3.0:1777497789.477087:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df06 00000020:00000040:3.0:1777497789.477089:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1f000 refcount=5 00000100:00100000:3.0:1777497789.477126:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080832 00000100:00100000:3.0:1777497789.477129:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080832 00000020:00000040:3.0:1777497789.477131:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df0d 00000020:00000040:3.0:1777497789.477133:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409f6c2800 refcount=5 00000100:00100000:3.0:1777497789.477142:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079808 00000100:00100000:3.0:1777497789.477144:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079808 00000020:00000040:3.0:1777497789.477145:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917c5e 00000020:00000040:3.0:1777497789.477147:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb61800 refcount=5 00000020:00000040:3.0:1777497789.477152:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00100000:3.0:1777497789.477164:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00000040:3.0:1777497789.477168:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1e800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477174:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240865b1500 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477186:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565079680:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477208:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565079680 00000100:00000040:3.0:1777497789.477217:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477222:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477239:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477258:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477262:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1500 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477283:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565079680:12345-0@lo:400:kworker.0 Request processed in 98us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477290:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00000040:3.0:1777497789.477293:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1e800 : new rpc_count 0 00000020:00000040:3.0:1777497789.477301:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1e800 : new refcount 4 00000100:00100000:3.0:1777497789.477311:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00000040:3.0:1777497789.477313:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1f000 : new rpc_count 1 00000100:00000040:3.0:1777497789.477317:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8df80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477327:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565080320:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477337:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565080320 00000100:00000040:3.0:1777497789.477341:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477345:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477358:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477370:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477373:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8df80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477381:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565080320:12345-0@lo:400:kworker.0 Request processed in 56us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477387:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00000040:3.0:1777497789.477390:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1f000 : new rpc_count 0 00000020:00000040:3.0:1777497789.477395:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1f000 : new refcount 4 00000100:00100000:3.0:1777497789.477402:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00000040:3.0:1777497789.477404:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409f6c2800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477408:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8ce00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477422:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565080832:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477431:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565080832 00000100:00000040:3.0:1777497789.477435:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477439:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477451:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477462:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477465:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8ce00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477474:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565080832:12345-0@lo:400:kworker.0 Request processed in 53us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477480:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00000040:3.0:1777497789.477482:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409f6c2800 : new rpc_count 0 00000020:00000040:3.0:1777497789.477487:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409f6c2800 : new refcount 4 00000100:00100000:3.0:1777497789.477494:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00000040:3.0:1777497789.477497:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb61800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477500:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8fb80 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477510:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565079808:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477519:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565079808 00000100:00000040:3.0:1777497789.477523:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477526:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477537:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477553:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477562:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8fb80 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477571:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565079808:12345-0@lo:400:kworker.0 Request processed in 62us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477577:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00000040:3.0:1777497789.477579:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb61800 : new rpc_count 0 00000020:00000040:3.0:1777497789.477585:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb61800 : new refcount 4 00000100:00100000:3.0:1777497789.477600:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079552 00000100:00100000:3.0:1777497789.477603:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079552 00000020:00000040:3.0:1777497789.477605:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497789.477607:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=20 00000100:00000040:3.0:1777497789.477617:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497789.477633:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1777497789.477635:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477639:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240aecd7450 x1863837565079552/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477649:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3658:x1863837565079552:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477658:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565079552 00000100:00000040:3.0:1777497789.477662:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477665:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477681:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477693:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477697:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240aecd7450 x1863837565079552/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477705:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3658:x1863837565079552:12345-0@lo:400:kworker.0 Request processed in 57us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477711:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00000040:3.0:1777497789.477719:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497789.477725:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 19 00000100:00100000:3.0:1777497789.477750:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080192 00000100:00100000:3.0:1777497789.477754:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080192 00000020:00000040:3.0:1777497789.477756:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:3.0:1777497789.477758:0:23437:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:3.0:1777497789.477766:0:23437:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:3.0:1777497789.477773:0:23437:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1777497789.477796:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080704 00000100:00100000:3.0:1777497789.477799:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080704 00000020:00000040:3.0:1777497789.477801:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:3.0:1777497789.477803:0:23437:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00100000:3.0:1777497789.477819:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080064 00000100:00100000:3.0:1777497789.477822:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080064 00000020:00000040:3.0:1777497789.477824:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bcb 00000100:00100000:3.0:1777497789.477849:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080576 00000100:00100000:3.0:1777497789.477852:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080576 00000020:00000040:3.0:1777497789.477853:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddc4 00000100:00100000:3.0:1777497789.477865:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2714 00000100:00000040:3.0:1777497789.477868:0:23437:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477872:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8dc00 x1863837565080192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477882:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565080192:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477891:0:23437:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565080192 00000100:00000040:3.0:1777497789.477895:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.477899:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.477914:0:23437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.477927:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.477931:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8dc00 x1863837565080192/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477950:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565080192:12345-0@lo:400:kworker.0 Request processed in 68us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.477957:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2714 00000100:00000040:3.0:1777497789.477959:0:23437:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:3.0:1777497789.477965:0:23437:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00100000:3.0:1777497789.477973:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2715 00000100:00000040:3.0:1777497789.477976:0:23437:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:3.0:1777497789.477979:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8e680 x1863837565080704/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.477988:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565080704:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.477997:0:23437:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565080704 00000100:00000040:3.0:1777497789.478002:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478005:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.478019:0:23437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478030:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.478034:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8e680 x1863837565080704/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478042:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565080704:12345-0@lo:400:kworker.0 Request processed in 55us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.478048:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2715 00000100:00000040:3.0:1777497789.478050:0:23437:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:3.0:1777497789.478054:0:23437:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00100000:3.0:1777497789.478061:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5975 00000100:00000040:3.0:1777497789.478064:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8ea00 x1863837565080064/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478083:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3656:x1863837565080064:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1777497789.478123:0:23437:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1777497789.478132:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478134:0:23437:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478138:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.478153:0:23437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497809 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478169:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.478173:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8ea00 x1863837565080064/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478181:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3656:x1863837565080064:12345-0@lo:8:kworker.0 Request processed in 98us (1276us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497789.478187:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5975 00000100:00100000:3.0:1777497789.478199:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5976 00000100:00000040:3.0:1777497789.478202:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8c000 x1863837565080576/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478211:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3656:x1863837565080576:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1777497789.478221:0:23437:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1777497789.478227:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478229:0:23437:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478232:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.478244:0:23437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497804 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478255:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.478259:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8c000 x1863837565080576/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478271:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3656:x1863837565080576:12345-0@lo:8:kworker.0 Request processed in 60us (1304us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497789.478277:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5976 00000100:00100000:3.0:1777497789.478295:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080448 00000100:00100000:3.0:1777497789.478298:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080448 00000020:00000040:3.0:1777497789.478300:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:3.0:1777497789.478302:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00000040:3.0:1777497789.478311:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1777497789.478326:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565079936 00000100:00100000:3.0:1777497789.478328:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565079936 00000020:00000040:3.0:1777497789.478330:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:3.0:1777497789.478332:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00100000:3.0:1777497789.478347:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4107 00000100:00000040:3.0:1777497789.478349:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:3.0:1777497789.478353:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8d180 x1863837565080448/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478363:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565080448:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.478374:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565080448 00000100:00000040:3.0:1777497789.478378:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478381:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.478396:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478408:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.478412:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8d180 x1863837565080448/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478420:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565080448:12345-0@lo:400:kworker.0 Request processed in 57us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.478425:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4107 00000100:00000040:3.0:1777497789.478433:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:3.0:1777497789.478439:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00100000:3.0:1777497789.478447:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4108 00000100:00000040:3.0:1777497789.478449:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:3.0:1777497789.478453:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8d880 x1863837565079936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478463:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565079936:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497789.478471:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565079936 00000100:00000040:3.0:1777497789.478476:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497789.478479:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.478494:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478505:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497789.478509:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8d880 x1863837565079936/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/224 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478517:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565079936:12345-0@lo:400:kworker.0 Request processed in 55us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497789.478522:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4108 00000100:00000040:3.0:1777497789.478525:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:3.0:1777497789.478529:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00080000:3.0:1777497789.478548:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1777497789.478551:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00080000:3.0:1777497789.478555:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1777497789.478557:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00080000:3.0:1777497789.478559:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1777497789.478561:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00000040:3.0:1777497789.478605:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497809 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497789.478626:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497789.478630:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1777497789.478634:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478641:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565080064:0@lo:8:kworker.0 00000100:00000040:3.0:1777497789.478655:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497804 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497789.478661:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497789.478664:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1777497789.478667:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497804 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478673:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565080576:0@lo:8:kworker.0 00000100:00000040:3.0:1777497789.478678:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b2a00 x1863837565080064/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497809 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.478689:0:3656:0:(genops.c:1244:class_import_put()) import ffff924098a6d000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1777497789.478697:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1c00 x1863837565080576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497804 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.478703:0:3656:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1777497789.478726:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:3.0:1777497789.478731:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478738:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478745:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565079936:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.478764:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1777497789.478769:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478776:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478783:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565080704:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.478793:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497789.478796:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.478804:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.478811:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565079808:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.478820:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1777497789.478823:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.479542:0:90586:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=4 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1777497789.479569:0:90586:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f8081a77] to pc [ptlrpcd_00_01+1] req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.479588:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1777497789.479597:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.479608:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565080960:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1777497789.479627:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.479634:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497789.479658:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240b569b800 x1863837565080960 msgsize 224 00000100:00100000:2.0:1777497789.479662:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497789.479693:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.479705:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4438 usecs (5 jiffies) 00000100:00100000:2.0:1777497789.479742:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565080960 00000100:00100000:2.0:1777497789.479747:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565080960 00000020:00000040:2.0:1777497789.479749:0:8407:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:2.0:1777497789.479752:0:8407:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00000040:2.0:1777497789.479767:0:8407:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1777497789.479803:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4109 00000100:00000040:2.0:1777497789.479805:0:8407:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:2.0:1777497789.479810:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b569b800 x1863837565080960/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.479820:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565080960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497789.479857:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00010000:00000040:2.0:1777497789.479867:0:8407:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565080960 00000100:00000040:2.0:1777497789.479873:0:8407:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497789.479877:0:8407:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497789.479893:0:8407:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.479910:0:8407:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497789.479914:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b569b800 x1863837565080960/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/368 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.479922:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565080960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497789.479928:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4109 00000100:00000040:2.0:1777497789.479930:0:8407:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:2.0:1777497789.479938:0:8407:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00000040:2.0:1777497789.479976:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1777497789.479988:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497789.479999:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352888 avail=317185 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023683 state=0: rc = 0 00000100:00000040:2.0:1777497789.480006:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480013:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b569b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565080960:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1777497789.480018:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b569b480 x1863837565080960/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480025:0:3657:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1777497789.480282:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.480291:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480299:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565079552:0@lo:400:kworker.0 00000100:00000040:2.0:1777497789.480312:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1777497789.480316:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.480325:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480332:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565080192:0@lo:400:kworker.0 00000100:00000040:2.0:1777497789.480343:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1777497789.480347:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.480367:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480375:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565080832:0@lo:400:kworker.0 00000100:00000040:2.0:1777497789.480388:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1777497789.480392:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.480399:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480407:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a3b89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565079680:0@lo:400:kworker.0 00000100:00000040:2.0:1777497789.480416:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1777497789.480420:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497789.480428:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497789.480435:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565080320:0@lo:400:kworker.0 00000100:00000040:2.0:1777497789.480442:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924089359500 x1863837565079552/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480450:0:3658:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000100:00000040:2.0:1777497789.480457:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1180 x1863837565080192/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480464:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1777497789.480469:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b0e00 x1863837565080832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480486:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240bb6f5800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1777497789.480492:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a3b89c00 x1863837565079680/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480499:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f8275c800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1777497789.480504:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3b80 x1863837565080320/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497789.480511:0:3658:0:(genops.c:1244:class_import_put()) import ffff92409c5dd800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:00000040:0.0:1777497789.484258:0:72706:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=4 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1777497789.484299:0:72706:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f23ecae6] to pc [ptlrpcd_00_02+2] req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497789.484325:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1777497789.484339:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497789.484378:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565081088:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1777497789.484405:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497789.484414:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497789.484449:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2b480 x1863837565081088 msgsize 224 00000100:00100000:0.0:1777497789.484454:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497789.484472:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497789.484485:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1858270 usecs (1859 jiffies) 00000100:00100000:0.0:1777497789.484507:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081088 00000100:00100000:0.0:1777497789.484514:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081088 00000020:00000040:0.0:1777497789.484517:0:8407:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:0.0:1777497789.484520:0:8407:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:0.0:1777497789.484538:0:8407:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1777497789.484563:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4110 00000100:00000040:0.0:1777497789.484567:0:8407:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:0.0:1777497789.484572:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2b480 x1863837565081088/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497789.484583:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565081088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1777497789.484615:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00010000:00000040:0.0:1777497789.484628:0:8407:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565081088 00000100:00000040:0.0:1777497789.484636:0:8407:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497789.484641:0:8407:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497789.484657:0:8407:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497789.484687:0:8407:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497789.484692:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2b480 x1863837565081088/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:545/0 lens 224/368 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497789.484706:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565081088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497789.484712:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4110 00000100:00000040:0.0:1777497789.484715:0:8407:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:0.0:1777497789.484724:0:8407:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00000040:0.0:1777497789.484751:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1777497789.484756:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1777497789.484767:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352833 avail=317130 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:0.0:1777497789.484775:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497789.485458:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565081088:0@lo:41:osp-pre-0-1.0 00000100:00000040:0.0:1777497789.485466:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf29500 x1863837565081088/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497789.485479:0:3660:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1777497789.486273:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.486281:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565080448:0@lo:400:kworker.0 00000100:00000040:3.0:1777497789.486289:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b2680 x1863837565079936/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.486300:0:3659:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1777497789.486312:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3100 x1863837565080704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.486320:0:3659:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497789.486335:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3800 x1863837565079808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.486343:0:3659:0:(genops.c:1244:class_import_put()) import ffff923f82ab3800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1777497789.486760:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1f80 x1863837565080448/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497789.486769:0:3659:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00010000:00010000:3.0:1777497789.602312:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1777497789.988451:0:90590:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497789.988494:0:90590:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006cd6b9f4] to pc [ptlrpcd_00_03+3] req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.988554:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000040:3.0:1777497789.988569:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497789.988582:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565081216:0@lo:13:osp-pre-1-0.0 00000100:00000040:3.0:1777497789.988610:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.988619:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497789.988661:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8d500 x1863837565081216 msgsize 224 00000100:00100000:3.0:1777497789.988665:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497789.988688:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497789.988701:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 6130 usecs (7 jiffies) 00000100:00100000:1.0:1777497789.988773:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081216 00000100:00100000:1.0:1777497789.988780:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081216 00000020:00000040:1.0:1777497789.988784:0:10306:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:1.0:1777497789.988787:0:10306:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00000040:1.0:1777497789.988814:0:10306:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1777497789.988860:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2210 00000100:00000040:1.0:1777497789.988864:0:10306:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:1.0:1777497789.988869:0:10306:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8d500 x1863837565081216/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/0 e 0 to 0 dl 1777497800 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497789.988882:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565081216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497789.988912:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1777497789.988925:0:10306:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565081216 00000100:00000040:1.0:1777497789.988935:0:10306:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:1.0:1777497789.988940:0:10306:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497789.988975:0:10306:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497789.988999:0:10306:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:1.0:1777497789.989004:0:10306:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8d500 x1863837565081216/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:545/0 lens 224/368 e 0 to 0 dl 1777497800 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497789.989012:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565081216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497789.989019:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2210 00000100:00000040:1.0:1777497789.989022:0:10306:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:1.0:1777497789.989033:0:10306:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00000040:1.0:1777497789.989066:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:1.0:1777497789.989071:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1777497789.989080:0:3659:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:1.0:1777497789.989083:0:3659:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:1.0:1777497789.989090:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497789.989123:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565081216:0@lo:13:osp-pre-1-0.0 00000100:00000040:1.0:1777497789.989128:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240bcc8f480 x1863837565081216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497789.989138:0:3659:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1777497790.271126:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240b569b480 x1863837546424192 msgsize 520 00000100:00100000:2.0:1777497790.271138:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497790.271169:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409097fc50 x1863837546423808 msgsize 224 00000100:00100000:2.0:1777497790.271173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497790.271175:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497790.271196:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240a3b89c00 x1863837546424064 msgsize 224 00000100:00100000:2.0:1777497790.271200:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497790.271218:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff924089359500 x1863837546423936 msgsize 224 00000100:00100000:2.0:1777497790.271223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497790.271252:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423808 00000100:00100000:2.0:1777497790.271261:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423808 00000020:00000040:2.0:1777497790.271264:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:2.0:1777497790.271268:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:2.0:1777497790.271292:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497790.271319:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 186 00000100:00000040:2.0:1777497790.271322:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:2.0:1777497790.271329:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409097fc50 x1863837546423808/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:546/0 lens 224/0 e 0 to 0 dl 1777497801 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271342:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546423808:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497790.271362:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546423808 00000100:00000040:2.0:1777497790.271385:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271391:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271430:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271435:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409097fc50 x1863837546423808/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:546/0 lens 224/224 e 0 to 0 dl 1777497801 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271444:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409097fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546423808:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497790.271451:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 186 00000100:00000040:2.0:1777497790.271454:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:2.0:1777497790.271463:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00100000:2.0:1777497790.271490:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424064 00000100:00100000:2.0:1777497790.271493:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424064 00000020:00000040:2.0:1777497790.271495:0:73210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691d36e 00000020:00000040:2.0:1777497790.271497:0:73210:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f818b2800 refcount=11 00000020:00000040:2.0:1777497790.271509:0:73210:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00000040:2.0:1777497790.271521:0:73210:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1777497790.271537:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546423936 00000100:00100000:2.0:1777497790.271540:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546423936 00000020:00000040:2.0:1777497790.271541:0:73210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd77 00000020:00000040:2.0:1777497790.271543:0:73210:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af7800 refcount=51 00000020:00000040:2.0:1777497790.271549:0:73210:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00100000:2.0:1777497790.271565:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1462 00000100:00000040:2.0:1777497790.271568:0:73210:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f818b2800 : new rpc_count 1 00000100:00000040:2.0:1777497790.271572:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a3b89c00 x1863837546424064/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/0 e 0 to 0 dl 1777497801 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271584:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546424064:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497790.271598:0:73210:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1863837546424064 00000100:00000040:2.0:1777497790.271604:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271615:0:73210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271631:0:73210:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271636:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a3b89c00 x1863837546424064/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/224 e 0 to 0 dl 1777497801 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271644:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a3b89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546424064:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 63us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497790.271651:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1462 00000100:00000040:2.0:1777497790.271654:0:73210:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f818b2800 : new rpc_count 0 00000020:00000040:2.0:1777497790.271661:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff923f818b2800 : new refcount 10 00000100:00100000:2.0:1777497790.271670:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1463 00000100:00000040:2.0:1777497790.271673:0:73210:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af7800 : new rpc_count 1 00000100:00000040:2.0:1777497790.271676:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924089359500 x1863837546423936/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/0 e 0 to 0 dl 1777497801 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271685:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+51:2414:x1863837546423936:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497790.271695:0:73210:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1863837546423936 00000100:00000040:2.0:1777497790.271699:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271702:0:73210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271713:0:73210:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497790.271717:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924089359500 x1863837546423936/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/224 e 0 to 0 dl 1777497801 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497790.271725:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+51:2414:x1863837546423936:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 42us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497790.271730:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1463 00000100:00000040:2.0:1777497790.271732:0:73210:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af7800 : new rpc_count 0 00000020:00000040:2.0:1777497790.271737:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af7800 : new refcount 50 00000100:00100000:3.0:1777497790.272210:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424192 00000100:00100000:3.0:1777497790.272216:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424192 00000020:00000040:3.0:1777497790.272218:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e10c 00000100:00100000:3.0:1777497790.272253:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5977 00000100:00000040:3.0:1777497790.272258:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b569b480 x1863837546424192/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497790.272281:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2411:x1863837546424192:12345-192.168.202.4@tcp:8:kworker.0 00010000:00020000:3.0:1777497790.272302:0:25487:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1777497790.272316:0:25487:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497790.272319:0:25487:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497790.272322:0:25487:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497790.272356:0:25487:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497790.272360:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b569b480 x1863837546424192/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497790.272367:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b569b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:0+-99:2411:x1863837546424192:12345-192.168.202.4@tcp:8:kworker.0 Request processed in 87us (1275us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497790.272373:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5977 00000100:00080000:3.0:1777497790.272394:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1777497790.272399:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00080000:3.0:1777497790.272402:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1777497790.272403:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00000040:0.0:1777497790.285422:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29500 x1863837546424320 msgsize 224 00000100:00100000:0.0:1777497790.285437:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497790.288262:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424320 00000100:00100000:3.0:1777497790.288275:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424320 00000020:00000040:3.0:1777497790.288277:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e113 00000020:00000040:3.0:1777497790.288283:0:25495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e23000 refcount=7 00000020:00000040:3.0:1777497790.288303:0:25495:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:3.0:1777497790.288365:0:25495:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1777497790.288401:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2716 00000100:00000040:3.0:1777497790.288405:0:25495:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e23000 : new rpc_count 1 00000100:00000040:3.0:1777497790.288411:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29500 x1863837546424320/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/0 e 0 to 0 dl 1777497801 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497790.288424:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546424320:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:3.0:1777497790.288455:0:25495:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546424320 00000100:00000040:3.0:1777497790.288464:0:25495:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497790.288469:0:25495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497790.288511:0:25495:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497790.288516:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29500 x1863837546424320/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:546/0 lens 224/224 e 0 to 0 dl 1777497801 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497790.288526:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546424320:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 103us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497790.288535:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2716 00000100:00000040:3.0:1777497790.288539:0:25495:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e23000 : new rpc_count 0 00000020:00000040:3.0:1777497790.288549:0:25495:0:(genops.c:900:class_export_put()) PUTting export ffff924086e23000 : new refcount 6 00000100:00080000:0.0:1777497790.294518:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1777497790.294527:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00010000:00010000:3.0:1777497790.628581:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:2.0:1777497791.524773:0:72710:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1777497791.524852:0:72710:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000981d52dc] to pc [ptlrpcd_00_00+0] req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497791.524901:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:2.0:1777497791.524909:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497791.524923:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565081344:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1777497791.524959:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497791.524967:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497791.525018:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff92409c253480 x1863837565081344 msgsize 224 00000100:00100000:2.0:1777497791.525023:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497791.525050:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497791.525065:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4958 usecs (5 jiffies) 00000100:00100000:2.0:1777497791.525118:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081344 00000100:00100000:2.0:1777497791.525128:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081344 00000020:00000040:2.0:1777497791.525132:0:8400:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:2.0:1777497791.525136:0:8400:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:2.0:1777497791.525153:0:8400:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:2.0:1777497791.525182:0:8400:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1777497791.525218:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2211 00000100:00000040:2.0:1777497791.525223:0:8400:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:2.0:1777497791.525231:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c253480 x1863837565081344/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:547/0 lens 224/0 e 0 to 0 dl 1777497802 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497791.525248:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565081344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1777497791.525279:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1777497791.525294:0:8400:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565081344 00000100:00000040:2.0:1777497791.525306:0:8400:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497791.525321:0:8400:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497791.525340:0:8400:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497791.525358:0:8400:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497791.525363:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253480 x1863837565081344/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:547/0 lens 224/368 e 0 to 0 dl 1777497802 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497791.525372:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565081344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 128us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497791.525379:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2211 00000100:00000040:2.0:1777497791.525382:0:8400:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:2.0:1777497791.525394:0:8400:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00000040:2.0:1777497791.525429:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1777497791.525434:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497791.525445:0:3658:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:2.0:1777497791.525449:0:3658:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1777497791.525457:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497791.525465:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565081344:0@lo:13:osp-pre-1-1.0 00000100:00000040:2.0:1777497791.525472:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565081344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497807 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497791.525596:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1777497791.525602:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000020:00000040:2.0:1777497791.527614:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1777497791.656926:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497792.674771:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497793.698706:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1777497794.594198:0:72706:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1777497794.594255:0:72706:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d3967dcf] to pc [ptlrpcd_00_01+1] req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497794.594348:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:1.0:1777497794.594364:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497794.594395:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565081472:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1777497794.594428:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497794.594437:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497794.594481:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d81c00 x1863837565081472 msgsize 224 00000100:00100000:1.0:1777497794.594485:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497794.594509:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497794.594520:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1852536 usecs (1853 jiffies) 00000100:00100000:2.0:1777497794.595706:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081472 00000100:00100000:2.0:1777497794.595717:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081472 00000020:00000040:2.0:1777497794.595728:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:2.0:1777497794.595743:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:2.0:1777497794.595770:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1777497794.595816:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4111 00000100:00000040:2.0:1777497794.595820:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:2.0:1777497794.595826:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d81c00 x1863837565081472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.595855:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565081472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497794.595895:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00010000:00000040:2.0:1777497794.595907:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565081472 00000100:00000040:2.0:1777497794.595917:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497794.595923:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497794.595958:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.595982:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497794.595987:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d81c00 x1863837565081472/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:550/0 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.595994:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565081472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 144us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497794.596000:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4111 00000100:00000040:2.0:1777497794.596003:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:2.0:1777497794.596013:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00000040:2.0:1777497794.596051:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1777497794.596056:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497794.596068:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352833 avail=317130 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:2.0:1777497794.596075:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.596088:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565081472:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1777497794.596114:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28380 x1863837565081472/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497794.596125:0:3657:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000020:00000040:0.0:1777497794.596209:0:90586:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1777497794.596234:0:90586:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000fdfe072c] to pc [ptlrpcd_00_02+2] req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.596274:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1777497794.596283:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.596293:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565081600:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1777497794.596314:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.596321:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497794.596338:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2ad80 x1863837565081600 msgsize 224 00000100:00100000:0.0:1777497794.596341:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497794.596356:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.596367:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4273 usecs (5 jiffies) 00000100:00100000:0.0:1777497794.596382:0:8407:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081600 00000100:00100000:0.0:1777497794.596386:0:8407:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081600 00000020:00000040:0.0:1777497794.596387:0:8407:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:0.0:1777497794.596390:0:8407:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00000040:0.0:1777497794.596402:0:8407:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1777497794.596418:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4112 00000100:00000040:0.0:1777497794.596422:0:8407:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:0.0:1777497794.596426:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2ad80 x1863837565081600/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.596435:0:8407:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565081600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1777497794.596456:0:8407:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00010000:00000040:0.0:1777497794.596464:0:8407:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565081600 00000100:00000040:0.0:1777497794.596469:0:8407:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497794.596473:0:8407:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497794.596488:0:8407:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.596511:0:8407:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497794.596515:0:8407:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2ad80 x1863837565081600/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/368 e 0 to 0 dl 1777497805 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.596521:0:8407:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565081600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497794.596527:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4112 00000100:00000040:0.0:1777497794.596529:0:8407:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:0.0:1777497794.596535:0:8407:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00000040:0.0:1777497794.596556:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497794.596560:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1777497794.596568:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352888 avail=317185 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023683 state=0: rc = 0 00000100:00000040:0.0:1777497794.596574:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.596580:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565081600:0@lo:41:osp-pre-1-0.0 00000100:00000040:0.0:1777497794.596585:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf29880 x1863837565081600/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497794.596592:0:3660:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1777497794.597631:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.597646:0:38121:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:2.0:1777497794.597663:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.597676:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000981d52dc] to pc [ptlrpcd_00_03+3] req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.597722:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.597743:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565081728:0@lo:400:kworker.0 00000100:00000040:0.0:1777497794.597764:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.597771:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497794.597817:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9240aecd6c50 x1863837565081728 msgsize 224 00000100:00100000:0.0:1777497794.597821:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497794.597823:0:3660:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497794.597850:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.598033:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.598041:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f8275c800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:2.0:1777497794.598051:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.598061:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005a04d752] to pc [ptlrpcd_00_00+0] req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.598076:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.598081:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f82ab3800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1777497794.598087:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.598118:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000002d84089] to pc [ptlrpcd_00_01+1] req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497794.598126:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497794.598135:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1777497794.598138:0:38121:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497794.598142:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3918 00000100:00080000:2.0:1777497794.598146:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00000040:2.0:1777497794.598149:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:2.0:1777497794.598151:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:2.0:1777497794.598154:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bb6 00000020:00000040:2.0:1777497794.598157:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a89000 refcount=4 00000100:00000040:2.0:1777497794.598160:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:2.0:1777497794.598162:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:2.0:1777497794.598164:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a89000 : new refcount 3 00000100:00080000:2.0:1777497794.598167:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:2.0:1777497794.598179:0:38121:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1777497794.598465:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081728 00000100:00100000:3.0:1777497794.598475:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081728 00000020:00000040:3.0:1777497794.598477:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497794.598480:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=20 00000100:00000040:3.0:1777497794.598503:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497794.598529:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1777497794.598532:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497794.598537:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240aecd6c50 x1863837565081728/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.598548:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565081728:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.598566:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565081728 00000100:00000040:3.0:1777497794.598573:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.598578:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.598599:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.602430:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.602449:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e1166a52] to pc [ptlrpcd_rcv+-1] req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.602477:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.602488:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:2.0:1777497794.602497:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.602507:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002b89333c] to pc [ptlrpcd_00_02+2] req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.602728:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.602750:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240aecd6c50 x1863837565081728/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.602760:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240aecd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:3660:x1863837565081728:12345-0@lo:400:kworker.0 Request processed in 4212us (4941us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.602770:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00000040:3.0:1777497794.602774:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497794.602797:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 19 00000100:00000040:3.0:1777497794.602863:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.602876:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565081984:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.602896:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.602904:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.602940:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8c700 x1863837565081984 msgsize 224 00000100:00100000:3.0:1777497794.602945:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.602964:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.602974:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8570 usecs (9 jiffies) 00000100:00100000:3.0:1777497794.602989:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1777497794.602994:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.603003:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565081856:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.603015:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603038:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.603053:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8c380 x1863837565081856 msgsize 224 00000100:00100000:3.0:1777497794.603056:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.603068:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603077:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8983 usecs (9 jiffies) 00000100:00000040:3.0:1777497794.603114:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.603124:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565082112:0@lo:8:kworker.0 00000100:00000040:3.0:1777497794.603137:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603143:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.603158:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8f800 x1863837565082112 msgsize 520 00000100:00100000:3.0:1777497794.603161:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.603175:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603617:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5268 usecs (6 jiffies) 00000100:00000040:3.0:1777497794.603666:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.603677:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565082240:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.603693:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603699:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.603716:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8f100 x1863837565082240 msgsize 224 00000100:00100000:3.0:1777497794.603720:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.603747:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.603774:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4946 usecs (5 jiffies) 00000100:00100000:3.0:1777497794.603817:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081984 00000100:00100000:3.0:1777497794.603825:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081984 00000020:00000040:3.0:1777497794.603828:0:63729:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917c5e 00000020:00000040:3.0:1777497794.603959:0:63729:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb61800 refcount=5 00000020:00000040:3.0:1777497794.603978:0:63729:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00000040:3.0:1777497794.604003:0:63729:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497794.604026:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565081856 00000100:00100000:3.0:1777497794.604030:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565081856 00000020:00000040:3.0:1777497794.604031:0:63729:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691deff 00000020:00000040:3.0:1777497794.604034:0:63729:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1e800 refcount=5 00000020:00000040:3.0:1777497794.604040:0:63729:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00100000:3.0:1777497794.604060:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00000040:3.0:1777497794.604063:0:63729:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb61800 : new rpc_count 1 00000100:00000040:3.0:1777497794.604068:0:63729:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8c700 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604080:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565081984:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.604126:0:63729:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565081984 00000100:00000040:3.0:1777497794.604136:0:63729:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.604140:0:63729:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.604159:0:63729:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.604177:0:63729:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.604182:0:63729:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8c700 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604452:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565081984:12345-0@lo:400:kworker.0 Request processed in 373us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.604459:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00000040:3.0:1777497794.604468:0:63729:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb61800 : new rpc_count 0 00000020:00000040:3.0:1777497794.604477:0:63729:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb61800 : new refcount 4 00000100:00100000:3.0:1777497794.604489:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00000040:3.0:1777497794.604491:0:63729:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1e800 : new rpc_count 1 00000100:00000040:3.0:1777497794.604495:0:63729:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8c380 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604506:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565081856:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.604515:0:63729:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565081856 00000100:00000040:3.0:1777497794.604520:0:63729:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.604523:0:63729:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.604539:0:63729:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.604552:0:63729:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.604556:0:63729:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8c380 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604563:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565081856:12345-0@lo:400:kworker.0 Request processed in 59us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.604568:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00000040:3.0:1777497794.604570:0:63729:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1e800 : new rpc_count 0 00000020:00000040:3.0:1777497794.604576:0:63729:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1e800 : new refcount 4 00000100:00080000:3.0:1777497794.604594:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:3.0:1777497794.604597:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00080000:3.0:1777497794.604601:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:3.0:1777497794.604603:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00000040:3.0:1777497794.604633:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497794.604639:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.604648:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604661:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565081856:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.604677:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497794.604681:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.604688:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.604693:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565081984:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.604700:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c252680 x1863837565081856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.604710:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f8275c800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1777497794.604720:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c252a00 x1863837565081984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.604727:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f82ab3800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1777497794.604869:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.604878:0:38121:0:(genops.c:1231:class_import_get()) import ffff92409c5dd800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:2.0:1777497794.604897:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.604919:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008694c38c] to pc [ptlrpcd_00_03+3] req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497794.604934:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1777497794.604938:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1777497794.604941:0:38121:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1777497794.604946:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3918 00000100:00080000:2.0:1777497794.604951:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00000040:2.0:1777497794.604954:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:2.0:1777497794.604956:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:2.0:1777497794.604959:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddbd 00000020:00000040:2.0:1777497794.604961:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f839d0800 refcount=4 00000100:00000040:2.0:1777497794.604964:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 50 to 0@lo 00000100:00000040:2.0:1777497794.604966:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 51 to 0@lo 00000020:00000040:2.0:1777497794.604967:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f839d0800 : new refcount 3 00000100:00080000:2.0:1777497794.604969:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:2.0:1777497794.604980:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:2.0:1777497794.604991:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.604999:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001d2a96ee] to pc [ptlrpcd_rcv+-1] req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.605010:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.605015:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1777497794.605021:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.605028:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000053e74dd7] to pc [ptlrpcd_00_00+0] req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.605045:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:2.0:1777497794.605051:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bb6f5800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1777497794.605058:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497794.605067:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004e5ec73e] to pc [ptlrpcd_00_01+1] req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.605076:0:38121:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (3928) 00000100:00100000:2.0:1777497794.605114:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082112 00000100:00100000:2.0:1777497794.605119:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082112 00000020:00000040:2.0:1777497794.605120:0:25494:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bcb 00000100:00100000:2.0:1777497794.605141:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082240 00000100:00100000:2.0:1777497794.605144:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082240 00000020:00000040:2.0:1777497794.605145:0:25494:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:2.0:1777497794.605148:0:25494:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:2.0:1777497794.605155:0:25494:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:2.0:1777497794.605168:0:25494:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1777497794.605195:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2717 00000100:00000040:2.0:1777497794.605198:0:25494:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:2.0:1777497794.605202:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8f100 x1863837565082240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.605213:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565082240:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497794.605223:0:25494:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565082240 00000100:00000040:2.0:1777497794.605228:0:25494:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497794.605232:0:25494:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497794.605262:0:25494:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.605276:0:25494:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497794.605286:0:25494:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8f100 x1863837565082240/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.605293:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565082240:12345-0@lo:400:kworker.0 Request processed in 82us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497794.605299:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2717 00000100:00000040:2.0:1777497794.605301:0:25494:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000100:00000040:3.0:1777497794.605669:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.605679:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565082752:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.605699:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.605706:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.605722:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8ca80 x1863837565082752 msgsize 224 00000100:00100000:3.0:1777497794.605726:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.605914:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.605926:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6668 usecs (7 jiffies) 00000100:00100000:3.0:1777497794.605945:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1777497794.605950:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.605958:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565082624:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.605971:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.605977:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.605991:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcc8f480 x1863837565082624 msgsize 224 00000100:00100000:3.0:1777497794.605994:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.606018:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.606027:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5921 usecs (6 jiffies) 00000100:00000040:3.0:1777497794.606047:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.606056:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565082496:0@lo:8:kworker.0 00000100:00000040:3.0:1777497794.606069:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.606077:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.606089:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff92409c252a00 x1863837565082496 msgsize 520 00000100:00100000:3.0:1777497794.606110:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497794.606124:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.606133:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3992 usecs (4 jiffies) 00000100:00100000:3.0:1777497794.606152:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082624 00000100:00100000:3.0:1777497794.606156:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082624 00000020:00000040:3.0:1777497794.606158:0:25493:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:3.0:1777497794.606161:0:25493:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00100000:3.0:1777497794.607532:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082496 00000100:00100000:3.0:1777497794.607547:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082496 00000020:00000040:3.0:1777497794.607549:0:25493:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddc4 00000100:00100000:3.0:1777497794.607578:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2718 00000100:00000040:3.0:1777497794.607583:0:25493:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:3.0:1777497794.607590:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8f480 x1863837565082624/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.607605:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565082624:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.607624:0:25493:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565082624 00000100:00000040:3.0:1777497794.607632:0:25493:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.607637:0:25493:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.607668:0:25493:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.607689:0:25493:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.607693:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8f480 x1863837565082624/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.607700:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565082624:12345-0@lo:400:kworker.0 Request processed in 101us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.607707:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2718 00000100:00000040:3.0:1777497794.607710:0:25493:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:3.0:1777497794.607719:0:25493:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00100000:3.0:1777497794.607728:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5978 00000100:00000040:3.0:1777497794.607732:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8f800 x1863837565082112/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.607740:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3656:x1863837565082112:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1777497794.607761:0:25493:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1777497794.607771:0:25493:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.607792:0:25493:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.607795:0:25493:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.607811:0:25493:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.607828:0:25493:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.608115:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8f800 x1863837565082112/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.608125:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3656:x1863837565082112:12345-0@lo:8:kworker.0 Request processed in 383us (4965us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497794.608132:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5978 00000100:00100000:3.0:1777497794.608149:0:25493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5979 00000100:00000040:3.0:1777497794.608152:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c252a00 x1863837565082496/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.608159:0:25493:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3656:x1863837565082496:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1777497794.608170:0:25493:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:3.0:1777497794.608188:0:25493:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.608191:0:25493:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.608194:0:25493:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.608210:0:25493:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.608223:0:25493:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.608226:0:25493:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252a00 x1863837565082496/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.608234:0:25493:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_013:0+-99:3656:x1863837565082496:12345-0@lo:8:kworker.0 Request processed in 75us (2143us total) trans 0 rc -19/-19 00000100:00100000:3.0:1777497794.608240:0:25493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5979 00000100:00000040:3.0:1777497794.608287:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1777497794.608302:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.609564:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.609577:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.609584:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3660:1863837565081728:0@lo:400:kworker.0 00000100:00000040:0.0:1777497794.609591:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565081728/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497794.609603:0:3660:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497794.609654:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497794.609667:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565082368:0@lo:400:kworker.0 00000100:00000040:0.0:1777497794.609693:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.609701:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497794.609729:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29880 x1863837565082368 msgsize 224 00000100:00100000:0.0:1777497794.609733:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497794.609753:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497794.609765:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 78648 usecs (79 jiffies) 00000100:00000040:3.0:1777497794.609886:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.609893:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565082624:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.609901:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbdc00 x1863837565082624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.609910:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497794.609941:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497794.609950:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497794.609955:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1777497794.609958:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.609966:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565082496:0@lo:8:kworker.0 00000100:00000040:3.0:1777497794.609976:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497794.609983:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497794.609986:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-19) 00000100:00000040:3.0:1777497794.609989:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.609995:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565082112:0@lo:8:kworker.0 00000100:00000040:3.0:1777497794.610000:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbc700 x1863837565082496/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.610022:0:3656:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1777497794.610029:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbd180 x1863837565082112/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.610036:0:3656:0:(genops.c:1244:class_import_put()) import ffff924098a6d000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1777497794.610056:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082752 00000100:00100000:3.0:1777497794.610061:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082752 00000020:00000040:3.0:1777497794.610064:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df0d 00000020:00000040:3.0:1777497794.610067:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409f6c2800 refcount=5 00000100:00000040:3.0:1777497794.610086:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497794.610123:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082368 00000100:00100000:3.0:1777497794.610126:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082368 00000020:00000040:3.0:1777497794.610128:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df06 00000020:00000040:3.0:1777497794.610130:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1f000 refcount=5 00000100:00100000:3.0:1777497794.610150:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00000040:3.0:1777497794.610154:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409f6c2800 : new rpc_count 1 00000100:00000040:3.0:1777497794.610159:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcc8ca80 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.610170:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565082752:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.610200:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565082752 00000100:00000040:3.0:1777497794.610208:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.610213:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.610232:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.610922:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.610928:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcc8ca80 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.610938:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565082752:12345-0@lo:400:kworker.0 Request processed in 769us (5214us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.610954:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00000040:3.0:1777497794.610958:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409f6c2800 : new rpc_count 0 00000020:00000040:3.0:1777497794.610970:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409f6c2800 : new refcount 4 00000100:00100000:3.0:1777497794.610985:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00000040:3.0:1777497794.610987:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1f000 : new rpc_count 1 00000100:00000040:3.0:1777497794.610991:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29880 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:550/0 lens 224/0 e 0 to 0 dl 1777497805 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.611003:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565082368:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497794.611015:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565082368 00000100:00000040:3.0:1777497794.611020:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497794.611023:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497794.611043:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.611061:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497794.611065:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29880 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:550/0 lens 224/224 e 0 to 0 dl 1777497805 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.611073:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1863837565082368:12345-0@lo:400:kworker.0 Request processed in 73us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497794.611078:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00000040:3.0:1777497794.611080:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1f000 : new rpc_count 0 00000020:00000040:3.0:1777497794.611086:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1f000 : new refcount 4 00000100:00000040:3.0:1777497794.611146:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1777497794.611152:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.611161:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.611180:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565082752:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.611581:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbe680 x1863837565082752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.611593:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240bb6f5800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1777497794.611624:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497794.611628:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497794.611636:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497794.611642:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3660:1863837565082368:0@lo:400:kworker.0 00000100:00000040:3.0:1777497794.611647:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbce00 x1863837565082368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497794.611654:0:3660:0:(genops.c:1244:class_import_put()) import ffff92409c5dd800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000020:00000040:2.0:1777497794.611971:0:25494:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00000040:2.0:1777497794.612016:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:2.0:1777497794.612022:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497794.612031:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497794.612037:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565082240:0@lo:400:kworker.0 00000100:00000040:2.0:1777497794.612043:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbed80 x1863837565082240/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497810 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497794.612051:0:3659:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00080000:2.0:1777497794.612072:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497794.612077:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00010000:00010000:3.0:1777497794.725944:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1777497795.106692:0:90590:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497795.106736:0:90590:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005a04d752] to pc [ptlrpcd_00_02+2] req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497795.106807:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:0.0:1777497795.109738:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497795.109786:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565082880:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1777497795.109818:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497795.109827:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497795.110038:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28000 x1863837565082880 msgsize 224 00000100:00100000:0.0:1777497795.110043:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497795.111202:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497795.111219:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5851 usecs (6 jiffies) 00000100:00100000:2.0:1777497795.113034:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565082880 00000100:00100000:2.0:1777497795.113048:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565082880 00000020:00000040:2.0:1777497795.113051:0:10306:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:2.0:1777497795.113055:0:10306:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00000040:2.0:1777497795.113085:0:10306:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:2.0:1777497795.113754:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2212 00000100:00000040:2.0:1777497795.113759:0:10306:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:2.0:1777497795.113765:0:10306:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28000 x1863837565082880/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/0 e 0 to 0 dl 1777497806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.113791:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565082880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1777497795.113841:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:2.0:1777497795.113853:0:10306:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565082880 00000100:00000040:2.0:1777497795.113864:0:10306:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497795.113870:0:10306:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497795.113914:0:10306:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497795.113943:0:10306:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497795.113948:0:10306:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28000 x1863837565082880/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:551/0 lens 224/368 e 0 to 0 dl 1777497806 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.113956:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565082880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 171us (3918us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497795.113963:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2212 00000100:00000040:2.0:1777497795.113967:0:10306:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:2.0:1777497795.113977:0:10306:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00000040:0.0:1777497795.114045:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:0.0:1777497795.114052:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:0.0:1777497795.114063:0:3660:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:0.0:1777497795.114066:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:0.0:1777497795.114073:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497795.114080:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c252680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565082880:0@lo:13:osp-pre-1-0.0 00000100:00000040:0.0:1777497795.114087:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c252680 x1863837565082880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497811 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497795.114114:0:3660:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:2.0:1777497795.392178:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240be1f4850 x1863837546424448 msgsize 224 00000100:00100000:2.0:1777497795.392193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497795.392196:0:3650:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497795.392223:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbed80 x1863837546424576 msgsize 224 00000100:00100000:2.0:1777497795.392228:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497795.392246:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbc000 x1863837546424704 msgsize 224 00000100:00100000:2.0:1777497795.392251:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497795.392266:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbea00 x1863837546424832 msgsize 520 00000100:00100000:2.0:1777497795.392270:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497795.392288:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbce00 x1863837546424960 msgsize 224 00000100:00100000:2.0:1777497795.392292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497795.392325:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424448 00000100:00100000:2.0:1777497795.392335:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424448 00000020:00000040:2.0:1777497795.392338:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:2.0:1777497795.392350:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:2.0:1777497795.392375:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497795.392401:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 188 00000100:00000040:2.0:1777497795.392405:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:2.0:1777497795.392413:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240be1f4850 x1863837546424448/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:551/0 lens 224/0 e 0 to 0 dl 1777497806 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392426:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546424448:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497795.392447:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546424448 00000100:00000040:2.0:1777497795.392458:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392463:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392507:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392512:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240be1f4850 x1863837546424448/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:551/0 lens 224/224 e 0 to 0 dl 1777497806 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392522:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240be1f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2414:x1863837546424448:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 97us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497795.392529:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 188 00000100:00000040:2.0:1777497795.392532:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:2.0:1777497795.392541:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00100000:2.0:1777497795.392566:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424576 00000100:00100000:2.0:1777497795.392569:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424576 00000020:00000040:2.0:1777497795.392571:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd77 00000020:00000040:2.0:1777497795.392573:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af7800 refcount=51 00000020:00000040:2.0:1777497795.392583:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00000100:00000040:2.0:1777497795.392594:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1777497795.392628:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424704 00000100:00100000:2.0:1777497795.392631:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424704 00000020:00000040:2.0:1777497795.392633:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691d36e 00000020:00000040:2.0:1777497795.392635:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f818b2800 refcount=11 00000020:00000040:2.0:1777497795.392643:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00100000:2.0:1777497795.392671:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1468 00000100:00000040:2.0:1777497795.392674:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af7800 : new rpc_count 1 00000100:00000040:2.0:1777497795.392678:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbed80 x1863837546424576/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/0 e 0 to 0 dl 1777497806 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392689:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2414:x1863837546424576:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497795.392703:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1863837546424576 00000100:00000040:2.0:1777497795.392708:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392712:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392728:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392732:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbed80 x1863837546424576/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/224 e 0 to 0 dl 1777497806 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392740:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2414:x1863837546424576:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 53us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497795.392746:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1468 00000100:00000040:2.0:1777497795.392748:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af7800 : new rpc_count 0 00000020:00000040:2.0:1777497795.392753:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af7800 : new refcount 50 00000100:00100000:2.0:1777497795.392762:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1469 00000100:00000040:2.0:1777497795.392765:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f818b2800 : new rpc_count 1 00000100:00000040:2.0:1777497795.392778:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbc000 x1863837546424704/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/0 e 0 to 0 dl 1777497806 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392789:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546424704:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497795.392798:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1863837546424704 00000100:00000040:2.0:1777497795.392802:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392806:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392819:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392829:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbc000 x1863837546424704/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/224 e 0 to 0 dl 1777497806 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392837:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2414:x1863837546424704:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 51us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497795.392843:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1469 00000100:00000040:2.0:1777497795.392846:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f818b2800 : new rpc_count 0 00000020:00000040:2.0:1777497795.392852:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f818b2800 : new refcount 10 00000100:00100000:2.0:1777497795.392870:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424832 00000100:00100000:2.0:1777497795.392874:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424832 00000020:00000040:2.0:1777497795.392875:0:25496:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e10c 00000100:00100000:2.0:1777497795.392892:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546424960 00000100:00100000:2.0:1777497795.392894:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546424960 00000020:00000040:2.0:1777497795.392896:0:25496:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e113 00000020:00000040:2.0:1777497795.392898:0:25496:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e23000 refcount=7 00000020:00000040:2.0:1777497795.392906:0:25496:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:2.0:1777497795.392913:0:25496:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1777497795.392927:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2719 00000100:00000040:2.0:1777497795.392930:0:25496:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e23000 : new rpc_count 1 00000100:00000040:2.0:1777497795.392934:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbce00 x1863837546424960/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/0 e 0 to 0 dl 1777497806 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392944:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546424960:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497795.392954:0:25496:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546424960 00000100:00000040:2.0:1777497795.392958:0:25496:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392962:0:25496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392975:0:25496:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.392979:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbce00 x1863837546424960/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:551/0 lens 224/224 e 0 to 0 dl 1777497806 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.392986:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+7:2414:x1863837546424960:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 45us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497795.392998:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2719 00000100:00000040:2.0:1777497795.393000:0:25496:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e23000 : new rpc_count 0 00000020:00000040:2.0:1777497795.393006:0:25496:0:(genops.c:900:class_export_put()) PUTting export ffff924086e23000 : new refcount 6 00000100:00100000:2.0:1777497795.393015:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5980 00000100:00000040:2.0:1777497795.393018:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbea00 x1863837546424832/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.393025:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2411:x1863837546424832:12345-192.168.202.4@tcp:8:kworker.0 00010000:00020000:2.0:1777497795.393045:0:25496:0:(ldlm_lib.c:1180:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.4@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00000040:2.0:1777497795.393057:0:25496:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.393060:0:25496:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.393063:0:25496:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497795.393075:0:25496:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497795.393079:0:25496:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbea00 x1863837546424832/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:/200/0 rc -19/-19 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497795.393088:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:0+-99:2411:x1863837546424832:12345-192.168.202.4@tcp:8:kworker.0 Request processed in 62us (819us total) trans 0 rc -19/-19 00000100:00100000:2.0:1777497795.393121:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5980 00000100:00080000:2.0:1777497795.393141:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497795.393145:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00080000:2.0:1777497795.393148:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1777497795.393150:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00080000:2.0:1777497795.393152:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1777497795.393153:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 14 - evictor 00010000:00010000:3.0:1777497795.746271:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:0.0:1777497796.646201:0:72710:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1777497796.646240:0:72710:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003c981d96] to pc [ptlrpcd_00_03+3] req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497796.646289:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497796.646303:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565083008:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1777497796.646334:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497796.646342:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497796.646390:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409c252680 x1863837565083008 msgsize 224 00000100:00100000:3.0:1777497796.646395:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497796.646425:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497796.646438:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4966 usecs (5 jiffies) 00000100:00100000:1.0:1777497796.646479:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083008 00000100:00100000:1.0:1777497796.646486:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083008 00000020:00000040:1.0:1777497796.646489:0:8400:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:1.0:1777497796.646492:0:8400:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:1.0:1777497796.646505:0:8400:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:1.0:1777497796.646527:0:8400:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:1.0:1777497796.646549:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00000040:1.0:1777497796.646553:0:8400:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:1.0:1777497796.646558:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c252680 x1863837565083008/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:552/0 lens 224/0 e 0 to 0 dl 1777497807 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497796.646571:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565083008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497796.646594:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1777497796.646604:0:8400:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565083008 00000100:00000040:1.0:1777497796.646615:0:8400:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:1.0:1777497796.646620:0:8400:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497796.646639:0:8400:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497796.646734:0:8400:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:1.0:1777497796.646745:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252680 x1863837565083008/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:552/0 lens 224/368 e 0 to 0 dl 1777497807 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497796.646753:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565083008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 186us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497796.646770:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00000040:1.0:1777497796.646773:0:8400:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:1.0:1777497796.646784:0:8400:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00080000:1.0:1777497796.646798:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1777497796.646801:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:3.0:1777497796.648059:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:3.0:1777497796.648068:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1777497796.648079:0:3660:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1777497796.648082:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1777497796.648090:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497796.648246:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565083008:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1777497796.648255:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28700 x1863837565083008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497812 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497796.648266:0:3660:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1777497796.771230:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1777497797.794286:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1777497797.808410:0:93014:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1777497797.808413:0:93014:0:(obd_mount.c:917:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1777497797.808414:0:93014:0:(obd_mount.c:920:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1777497797.808532:0:93014:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff923f81243800 00000020:01000004:3.0:1777497797.808556:0:93014:0:(tgt_mount.c:2455:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1777497797.808573:0:93014:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1777497797.808587:0:93014:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9240a62e8000) 00000020:00000040:3.0:1777497797.808593:0:93014:0:(lustre_handles.c:77:class_handle_hash()) added object ffff923f81240000 with handle 0x3e357265691ecb2 to hash 00000020:00000040:3.0:1777497797.808599:0:93014:0:(genops.c:900:class_export_put()) PUTting export ffff923f81240000 : new refcount 1 00000020:00000040:3.0:1777497797.808607:0:93014:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9240a62e8000) now 2 - obd_device_list 00000020:00000080:3.0:1777497797.808611:0:93014:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000001:00000040:2.0:1777497798.577303:0:93014:0:(osd_compat.c:233:osd_last_rcvd_subdir_count()) read last_rcvd header, uuid = lustre-OST0000_UUID, subdir count = 32 00100000:10000000:2.0:1777497798.584917:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1777497798.586175:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1777497798.586215:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1777497798.586238:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1777497798.586260:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1777497798.586280:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1777497798.586300:0:93014:0:(osd_scrub.c:1784:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1777497798.587304:0:93014:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000040:2.0:1777497798.587540:0:93014:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9240a62e8000) now 3 - setup 00000020:00000080:2.0:1777497798.587546:0:93014:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1777497798.587559:0:93014:0:(osd_handler.c:8910:osd_obd_connect()) connect #0 00000020:00000040:2.0:1777497798.587567:0:93014:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240865c1000 with handle 0x3e357265691ecb9 to hash 00000020:00000040:2.0:1777497798.587574:0:93014:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9240a62e8000) now 4 - export 00000020:00000040:2.0:1777497798.587577:0:93014:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c1000 : new refcount 1 00000020:00000080:2.0:1777497798.587580:0:93014:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e357265691ecb9 00000020:00000040:2.0:1777497798.587583:0:93014:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecb9 00000020:00000040:2.0:1777497798.587585:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c1000 refcount=2 00000020:01000004:2.0:1777497798.587591:0:93014:0:(tgt_mount.c:2540:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1777497798.587614:0:93014:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.202.104@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1777497798.587618:0:93014:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.202.104@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1777497798.587624:0:93014:0:(tgt_mount.c:1764:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1777497798.587652:0:93014:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1777497798.587657:0:93014:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.104@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000020:00000040:2.0:1777497798.589039:0:93014:0:(genops.c:889:class_export_get()) GET export ffff923f81240000 refcount=2 00000040:00000040:2.0:1777497798.589047:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 00000040:00000040:2.0:1777497798.590405:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff923f83ed3e40 : new refcount 1 00000040:01000000:2.0:1777497798.590411:0:93014:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.104@tcp ctxt 0 is initialized 10000000:00000040:2.0:1777497798.590414:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 10000000:00000040:2.0:1777497798.590417:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff923f83ed3e40 : new refcount 1 00000020:00000040:2.0:1777497798.590420:0:93014:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.104@tcp (ffff9240911f99c0) now 6 - mgc_fs 00000020:01000004:2.0:1777497798.590462:0:93014:0:(tgt_mount.c:1389:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.104@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1777497798.590469:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1777497798.590470:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497798.590471:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497798.590472:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497798.590473:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497798.590474:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497798.590476:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497798.590477:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497798.590478:0:93014:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1777497798.590481:0:93014:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1777497798.590483:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497798.590484:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497798.590485:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497798.590486:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497798.590487:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497798.590488:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497798.590488:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497798.590489:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497798.590490:0:93014:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000020:00000040:2.0:1777497798.590597:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 10000000:01000000:2.0:1777497798.590624:0:93014:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1777497798.590644:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.590658:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083136:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1777497798.590688:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.590791:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.590835:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff923f85f46450 x1863837565083136 msgsize 4848 00000100:00100000:2.0:1777497798.590840:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.590842:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497798.590926:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.590962:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83ed39c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497798.591661:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083136 00000100:00100000:3.0:1777497798.591683:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083136 00000020:00000040:3.0:1777497798.591687:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497798.591691:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=20 00000100:00000040:3.0:1777497798.596306:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.596419:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00000040:3.0:1777497798.596424:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.596433:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f85f46450 x1863837565083136/t0(0) o253->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 4848/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.596452:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:93014:x1863837565083136:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1777497798.596491:0:90574:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1777497798.596504:0:90574:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1777497798.596509:0:90574:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00000040:3.0:1777497798.596913:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083136 00000100:00000040:3.0:1777497798.596926:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.596932:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.596993:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.597033:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.597038:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f85f46450 x1863837565083136/t0(0) o253->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 4848/4768 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.597047:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:93014:x1863837565083136:12345-0@lo:253:mount.lustre.0 Request processed in 602us (6210us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.597054:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00000040:3.0:1777497798.597057:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.597069:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 19 00000100:00000040:1.0:1777497798.597303:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.597315:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.597322:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5bbe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083136:0@lo:253:mount.lustre.0 00000100:00000040:1.0:1777497798.597336:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1777497798.597352:0:93014:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1777497798.597355:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1777497798.597357:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1777497798.597358:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:1.0:1777497798.597359:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:1.0:1777497798.597360:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:1.0:1777497798.597362:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:1.0:1777497798.597363:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1777497798.597365:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1777497798.597366:0:93014:0:(tgt_mount.c:1187:server_mti_print()) LDD_F_OPC_REG 00000100:00000040:1.0:1777497798.597369:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5bbe680 x1863837565083136/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.597380:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000020:01000004:1.0:1777497798.597400:0:93014:0:(tgt_mount.c:101:server_register_mount()) register mount ffff923f81243800 from lustre-OST0000 10000000:01000000:1.0:1777497798.597445:0:93014:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1777497798.597448:0:93014:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:00000040:1.0:1777497798.597456:0:93014:0:(mgc_request.c:108:config_log_get()) log lustre-sptlrpc (ffff92408794d400) refs 5 10000000:01000000:1.0:1777497798.597460:0:93014:0:(mgc_request_server.c:870:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9240911f99c0 local copy 00000020:00000040:1.0:1777497798.597464:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eefa00 refcount=2 00010000:00010000:1.0:1777497798.597472:0:93014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1777497798.597508:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff92409077b600 : new refcount 2 10000000:00000040:1.0:1777497798.597511:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 10000000:00000040:1.0:1777497798.597513:0:93014:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.202.104@tcp: copy local log lustre-sptlrpc 00000020:00000040:1.0:1777497798.597556:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.597562:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.597589:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.597601:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083264:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1777497798.597619:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.597627:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.597647:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff923f85f47850 x1863837565083264 msgsize 512 00000100:00100000:1.0:1777497798.597652:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.597653:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.598077:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.598122:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497798.598488:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083264 00000100:00100000:0.0:1777497798.598505:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083264 00000020:00000040:0.0:1777497798.598509:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497798.598514:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=20 00000100:00000040:0.0:1777497798.598535:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497798.598567:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1777497798.598571:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497798.598576:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f85f47850 x1863837565083264/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.598587:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:93014:x1863837565083264:12345-0@lo:501:mount.lustre.0 00000040:00000040:0.0:1777497798.598605:0:90580:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-sptlrpc 00000040:00000040:0.0:1777497798.598608:0:90580:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:0.0:1777497798.598633:0:90580:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:0.0:1777497798.598638:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083264 00000100:00000040:0.0:1777497798.598645:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497798.598649:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.598674:0:90580:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.598711:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497798.598715:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f85f47850 x1863837565083264/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/272 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.598724:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:93014:x1863837565083264:12345-0@lo:501:mount.lustre.0 Request processed in 139us (1075us total) trans 0 rc -2/-2 00000100:00100000:0.0:1777497798.598730:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00000040:0.0:1777497798.598732:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497798.598751:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 19 00000100:00000040:0.0:1777497798.598790:0:93014:0:(client.c:1495:ptlrpc_check_status()) @@@ check status: rc = -2 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.598816:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.598825:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.598832:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083264:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1777497798.598839:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.598848:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497798.598851:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565083264/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc -2/-2 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.598859:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:01000000:0.0:1777497798.598870:0:93014:0:(mgc_request_server.c:763:mgc_llog_local_copy()) MGC192.168.202.104@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1777497798.598892:0:93014:0:(mgc_request_server.c:893:mgc_get_local_copy()) MGC192.168.202.104@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00000020:00000040:0.0:1777497798.598896:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eefa00 refcount=3 00010000:00010000:0.0:1777497798.598901:0:93014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.598911:0:93014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1777497798.598936:0:93014:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff923f81243800 10000000:01000000:0.0:1777497798.598940:0:93014:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00000020:00000040:0.0:1777497798.598944:0:93014:0:(genops.c:889:class_export_get()) GET export ffff924083958000 refcount=18 10000000:00000040:0.0:1777497798.598947:0:93014:0:(mgc_request.c:108:config_log_get()) log nodemap (ffff9240a6b6d000) refs 4 10000000:01000000:0.0:1777497798.598949:0:93014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1777497798.598951:0:93014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:0.0:1777497798.599304:0:93014:0:(genops.c:889:class_export_get()) GET export ffff924083958000 refcount=19 10000000:01000000:0.0:1777497798.599310:0:93014:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1777497798.599312:0:93014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000020:00000040:0.0:1777497798.599318:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00010000:00000040:0.0:1777497798.599336:0:93014:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff924090680300 count: 8 00000020:00000040:0.0:1777497798.599343:0:93014:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086df9e00 with handle 0x3e357265691ecc0 to hash 00010000:00010000:0.0:1777497798.599349:0:93014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.599357:0:93014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.599365:0:93014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1777497798.599380:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.599390:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083392:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1777497798.599407:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.599413:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.599433:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff923f85f46850 x1863837565083392 msgsize 328 00000100:00100000:0.0:1777497798.599437:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.599439:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497798.599453:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.599472:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083392 00000100:00100000:0.0:1777497798.599476:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083392 00000020:00000040:0.0:1777497798.599478:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497798.599480:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=20 00000100:00000040:0.0:1777497798.599683:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497798.599833:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1777497798.599837:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497798.599841:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f85f46850 x1863837565083392/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.599853:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+20:93014:x1863837565083392:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497798.599864:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1777497798.599873:0:90580:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff9240a6e49c00 count: 10 00000020:00000040:0.0:1777497798.599878:0:90580:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086df8800 with handle 0x3e357265691ecc7 to hash 00010000:00010000:0.0:1777497798.599882:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086df8800/0x3e357265691ecc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ecc0 expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599889:0:90580:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240a6374800 : new locks_count 16 00000020:00000040:0.0:1777497798.599891:0:90580:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=21 00010000:00000040:0.0:1777497798.599909:0:90580:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9240a6e49c00) refcount = 10 00010000:00000040:0.0:1777497798.599912:0:90580:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1777497798.599918:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902aa00/0x3e357265691e2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4cc expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599925:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902a000/0x3e357265691e2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4c5 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599931:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a16200/0x3e357265691e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2da expref: 21 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599937:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff924085eeee00/0x3e357265691e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2b0 expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599943:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f89735800/0x3e357265691e2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2a2 expref: 21 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599971:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902a600/0x3e357265691e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e294 expref: 21 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599977:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f89735a00/0x3e357265691e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e286 expref: 21 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599983:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a16e00/0x3e357265691e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e278 expref: 21 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.599989:0:90580:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a17400/0x3e357265691e271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e26a expref: 21 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.599996:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086df8800/0x3e357265691ecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ecc0 expref: 21 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.600007:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086df8800/0x3e357265691ecc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ecc0 expref: 21 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.600015:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8800, rc 0) 00010000:00000040:0.0:1777497798.600019:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083392 00000100:00000040:0.0:1777497798.600025:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497798.600029:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.600049:0:90580:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.600061:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497798.600065:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f85f46850 x1863837565083392/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/344 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.600073:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f85f46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083392:12345-0@lo:101:mount.lustre.0 Request processed in 223us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497798.600087:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00000040:0.0:1777497798.600090:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497798.600116:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00100000:0.0:1777497798.600610:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f862eb6c0 going to sleep for 11 seconds 00000100:00000040:0.0:1777497798.600634:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.600645:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.600652:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083392:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1777497798.600660:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.600670:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086df9e00 refcount=4 00010000:00000040:0.0:1777497798.600674:0:93014:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff924086df9e00, remote cookie: 0x3e357265691ecc7, flags: 0x0 00010000:00000040:0.0:1777497798.600680:0:93014:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff924090680300) refcount = 8 00010000:00000040:0.0:1777497798.600683:0:93014:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1777497798.600686:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600693:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600712:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600719:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600725:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600750:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.600757:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.600763:0:93014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecc7 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.600771:0:93014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ecc7 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1777497798.600781:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28a80 x1863837565083392/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.600791:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:00000040:0.0:1777497798.600798:0:93014:0:(mgc_request.c:108:config_log_get()) log lustre-OST0000 (ffff9240a6b5d800) refs 2 00000020:00000040:0.0:1777497798.600801:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086df9e00 refcount=3 10000000:00000040:0.0:1777497798.600824:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff92409077b600 : new refcount 2 10000000:00000040:0.0:1777497798.600828:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 10000000:00000040:0.0:1777497798.600832:0:93014:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.202.104@tcp: copy local log lustre-OST0000 00000040:00080000:0.0:1777497798.601160:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1777497798.601467:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1777497798.606794:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1777497798.606858:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1777497798.606876:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1777497798.606887:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1777497798.606899:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1777497798.606919:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1777497798.606945:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1777497798.606951:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000020:00000040:1.0:1777497798.607226:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.607234:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.608848:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.608866:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083520:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1777497798.608896:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.608904:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.608944:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6a1a050 x1863837565083520 msgsize 512 00000100:00100000:1.0:1777497798.608949:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.608951:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.609370:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.609402:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3840 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.609489:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083520 00000100:00100000:2.0:1777497798.609520:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083520 00000020:00000040:2.0:1777497798.609523:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.609527:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:2.0:1777497798.609550:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497798.609587:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1777497798.609591:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497798.609597:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6a1a050 x1863837565083520/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.609609:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083520:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1777497798.609632:0:90575:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-OST0000 00000040:00000040:2.0:1777497798.609635:0:90575:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:2.0:1777497798.609710:0:90575:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00000020:00000040:2.0:1777497798.609720:0:90575:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=22 00000020:00000040:2.0:1777497798.609723:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00010000:00000040:2.0:1777497798.609727:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083520 00000100:00000040:2.0:1777497798.609736:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.609750:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.609772:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.610184:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497798.610190:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6a1a050 x1863837565083520/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/272 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.610199:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083520:12345-0@lo:501:mount.lustre.0 Request processed in 592us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.610206:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00000040:2.0:1777497798.610209:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497798.610218:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00000040:3.0:1777497798.610348:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.610359:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.610376:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083520:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1777497798.610383:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.610393:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.610396:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565083520/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.610404:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.610416:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.610420:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.610437:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.610447:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083648:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1777497798.610478:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.610485:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.610588:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6a19c50 x1863837565083648 msgsize 272 00000100:00100000:3.0:1777497798.610593:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.610595:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.610646:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.610665:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240a38c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.610889:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083648 00000100:00100000:2.0:1777497798.610899:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083648 00000020:00000040:2.0:1777497798.610901:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.610905:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:2.0:1777497798.610920:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497798.611074:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1777497798.611078:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497798.611082:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6a19c50 x1863837565083648/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.611131:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083648:12345-0@lo:503:mount.lustre.0 00000040:00000040:2.0:1777497798.611156:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:2.0:1777497798.611198:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:2.0:1777497798.611201:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083648 00000100:00000040:2.0:1777497798.611208:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.611212:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.611234:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.611251:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497798.611255:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6a19c50 x1863837565083648/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8416 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.611264:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083648:12345-0@lo:503:mount.lustre.0 Request processed in 173us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.611270:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00000040:2.0:1777497798.611273:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497798.611280:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00000040:1.0:1777497798.611362:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.611371:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.611377:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083648:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1777497798.611382:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.611394:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565083648/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.611412:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.611425:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:1.0:1777497798.611833:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:1.0:1777497798.611889:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.611895:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.611916:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.611926:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083776:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1777497798.611950:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.611971:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.611995:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6a18850 x1863837565083776 msgsize 272 00000100:00100000:1.0:1777497798.611999:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.612001:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.612523:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.612573:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1777497798.612782:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083776 00000100:00100000:3.0:1777497798.612789:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083776 00000020:00000040:3.0:1777497798.612791:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497798.612795:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:3.0:1777497798.612816:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.612860:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00000040:3.0:1777497798.612864:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.612869:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6a18850 x1863837565083776/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.612880:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083776:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1777497798.612905:0:90574:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:3.0:1777497798.613527:0:90574:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:3.0:1777497798.613533:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083776 00000100:00000040:3.0:1777497798.613543:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.613550:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.613588:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.613616:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.613621:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6a18850 x1863837565083776/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.613630:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6a18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083776:12345-0@lo:502:mount.lustre.0 Request processed in 752us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.613637:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00000040:3.0:1777497798.613640:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.613650:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00000040:1.0:1777497798.613909:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.613918:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.613926:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083776:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1777497798.613932:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.613944:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565083776/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.613974:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.613983:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:1.0:1777497798.614206:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1777497798.614235:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1777497798.614248:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1777497798.614259:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1777497798.614271:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1777497798.614282:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1777497798.614293:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1777497798.614303:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1777497798.614314:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1777497798.614327:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1777497798.614338:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1777497798.614349:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000020:00000040:1.0:1777497798.614355:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.614359:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.614379:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.614390:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083904:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1777497798.614417:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.614424:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.614448:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5d450 x1863837565083904 msgsize 272 00000100:00100000:1.0:1777497798.614451:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.614454:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.614470:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.614509:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565083904 00000100:00100000:1.0:1777497798.614515:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565083904 00000020:00000040:1.0:1777497798.614517:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:1.0:1777497798.614520:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:1.0:1777497798.614539:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1777497798.614564:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1777497798.614568:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:1.0:1777497798.614571:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5d450 x1863837565083904/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.614582:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083904:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1777497798.614604:0:90575:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:1.0:1777497798.614646:0:90575:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:1.0:1777497798.614650:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565083904 00000100:00000040:1.0:1777497798.614658:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:1.0:1777497798.614662:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.614680:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.614693:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:1.0:1777497798.614709:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5d450 x1863837565083904/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.614717:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565083904:12345-0@lo:502:mount.lustre.0 Request processed in 137us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497798.614723:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00000040:1.0:1777497798.614725:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497798.614734:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00100000:1.0:1777497798.614783:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d36c0 going to sleep for 11 seconds 00000100:00000040:1.0:1777497798.614797:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.614805:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.614811:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565083904:0@lo:502:mount.lustre.0 00000100:00000040:1.0:1777497798.614825:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.614835:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565083904/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.614850:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.614856:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:1.0:1777497798.614880:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1777497798.614888:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 10000000:00000040:1.0:1777497798.615160:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff92409077b600 : new refcount 1 00000020:00000040:1.0:1777497798.615165:0:93014:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-OST0000 00000020:01000000:3.0:1777497798.616843:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1777497798.616853:0:93018:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1777497798.616859:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1777497798.616862:0:93018:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1777497798.616868:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1777497798.616884:0:93018:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9240bb69cd40) 00000020:00000040:3.0:1777497798.616891:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240bcd90000 with handle 0x3e357265691ecce to hash 00000020:00000040:3.0:1777497798.616900:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd90000 : new refcount 1 00000020:00000040:3.0:1777497798.616921:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 2 - obd_device_list 00000020:00000080:3.0:1777497798.616927:0:93018:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000040:3.0:1777497798.616932:0:93018:0:(obd_config.c:1948:class_config_llog_handler()) For 1.8 interoperability, set this index to '0' 00000020:00000080:3.0:1777497798.616935:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1777497798.617469:0:93018:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f81243800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1777497798.617480:0:93018:0:(osd_handler.c:8910:osd_obd_connect()) connect #1 00000020:00000040:2.0:1777497798.617484:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240865c6000 with handle 0x3e357265691ecd5 to hash 00000020:00000040:2.0:1777497798.617488:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9240a62e8000) now 5 - export 00000020:00000040:2.0:1777497798.617589:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6000 : new refcount 1 00000020:00000080:2.0:1777497798.617591:0:93018:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3e357265691ecd5 00000020:00000040:2.0:1777497798.617594:0:93018:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecd5 00000020:00000040:2.0:1777497798.617596:0:93018:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6000 refcount=2 00010000:00010000:2.0:1777497798.625453:0:93018:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-4 is initialized 00000001:00000040:2.0:1777497798.625462:0:93018:0:(obd_cksum.c:33:obd_cksum_types_supported_server()) lustre-OST0000: checksum speed: crc 627, crc32c 3972, adler 511, t10ip512 2599, t10ip4k 2431, t10crc512 500, t10crc4k 686 00002000:00000040:2.0:1777497798.625603:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xb:0x0] 00000001:00000040:2.0:1777497798.625673:0:93018:0:(tgt_lastrcvd.c:690:tgt_server_data_read()) lustre-OST0000: read last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969458: rc = 0 00000001:00000040:2.0:1777497798.625679:0:93018:0:(tgt_lastrcvd.c:2003:tgt_server_data_init()) lustre-OST0000: restored maximum client count: 0 00000001:00000040:2.0:1777497798.625689:0:93018:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8320 uuid = lustre-MDT0000-mdtlov_UUID, last_transno = 4294969476, last_xid = 1863837565069696, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1777497798.625895:0:93018:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0000-mdtlov_UUID idx: 0 lr: 4294969476 srv lr: 4294969458 lx: 1863837565069696 gen 0 00000020:00000040:2.0:1777497798.625904:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240865c2800 with handle 0x3e357265691ecdc to hash 00000020:00000040:2.0:1777497798.625923:0:93018:0:(genops.c:889:class_export_get()) GET export ffff9240865c2800 refcount=3 00000020:00000040:2.0:1777497798.625927:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 3 - export 00000001:00000040:2.0:1777497798.625931:0:93018:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 0 with UUID 'lustre-MDT0000-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1777497798.625934:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c2800 : new refcount 2 00000001:00000040:2.0:1777497798.625940:0:93018:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8448 uuid = lustre-MDT0001-mdtlov_UUID, last_transno = 4294969458, last_xid = 1863837564986496, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1777497798.625943:0:93018:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: lustre-MDT0001-mdtlov_UUID idx: 1 lr: 4294969458 srv lr: 4294969458 lx: 1863837564986496 gen 0 00000020:00000040:2.0:1777497798.625947:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240865c7000 with handle 0x3e357265691ece3 to hash 00000020:00000040:2.0:1777497798.626080:0:93018:0:(genops.c:889:class_export_get()) GET export ffff9240865c7000 refcount=3 00000020:00000040:2.0:1777497798.626083:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 4 - export 00000001:00000040:2.0:1777497798.626085:0:93018:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 1 with UUID 'lustre-MDT0001-mdtlov_UUID' added, generation 0 00000020:00000040:2.0:1777497798.626087:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c7000 : new refcount 2 00000001:00000040:2.0:1777497798.626288:0:93018:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8576 uuid = d146155b-4321-4b14-9284-f644ed9631fb, last_transno = 4294969480, last_xid = 1863837546390912, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00080000:2.0:1777497798.626304:0:93018:0:(tgt_lastrcvd.c:1758:tgt_clients_data_init()) RCVRNG CLIENT uuid: d146155b-4321-4b14-9284-f644ed9631fb idx: 2 lr: 4294969480 srv lr: 4294969458 lx: 1863837546390912 gen 0 00000020:00000040:2.0:1777497798.626309:0:93018:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240865c6800 with handle 0x3e357265691ecea to hash 00000020:00000040:2.0:1777497798.626320:0:93018:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=3 00000020:00000040:2.0:1777497798.626322:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 5 - export 00000001:00000040:2.0:1777497798.626325:0:93018:0:(tgt_lastrcvd.c:1180:tgt_client_add()) lustre-OST0000: client at idx 2 with UUID 'd146155b-4321-4b14-9284-f644ed9631fb' added, generation 0 00000020:00000040:2.0:1777497798.626327:0:93018:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 2 00000001:00000040:2.0:1777497798.626333:0:93018:0:(tgt_lastrcvd.c:530:tgt_client_data_read()) lustre-OST0000: read lcd @8704 uuid = , last_transno = 0, last_xid = 0, last_result = 0, last_data = 0, last_close_transno = 0, last_close_xid = 0, last_close_result = 0, rc = 0 00000001:00000040:2.0:1777497798.626336:0:93018:0:(tgt_lastrcvd.c:1746:tgt_clients_data_init()) skipping zeroed client at offset 3 00000001:00000004:2.0:1777497798.626341:0:93018:0:(tgt_lastrcvd.c:732:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294969480 00000001:00000040:2.0:1777497798.626390:0:93018:0:(tgt_lastrcvd.c:712:tgt_server_data_write()) lustre-OST0000: write last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969480: rc = 0 00000001:00000040:2.0:1777497798.626403:0:93018:0:(tgt_lastrcvd.c:766:tgt_server_data_update()) lustre-OST0000: update last_rcvd server data for UUID = lustre-OST0000_UUID, last_transno = 4294969480: rc = 0 00002000:00000040:2.0:1777497798.626417:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x5:0x0] 40000000:00000040:2.0:1777497798.626458:0:93018:0:(fid_store.c:166:seq_store_read()) srv-lustre-OST0000: Space - [0x0000000280000402-0x00000002c0000400]:0:ost 40000000:00000040:2.0:1777497798.626621:0:93018:0:(fid_handler.c:57:seq_server_set_cli()) srv-lustre-OST0000: Attached sequence controller cli-lustre-OST0000-super 80000000:00000040:2.0:1777497798.626630:0:93018:0:(fld_cache.c:66:fld_cache_init()) srv-lustre-OST0000: FLD cache - Size: 74898, Threshold: 7489 00002000:00000040:2.0:1777497798.626638:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x3:0x0] 80000000:00000040:2.0:1777497798.626678:0:93018:0:(fld_cache.c:417:fld_cache_insert_nolock()) insert range [0x0000000280000400-0x00000002c0000400]:0:ost 80000000:00000040:2.0:1777497798.626686:0:93018:0:(fld_handler.c:101:fld_name_to_index()) get index from srv-lustre-OST0000 00002000:00000040:2.0:1777497798.626827:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x1018:0x0] 00002000:00000040:2.0:1777497798.626854:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xd:0x0] 00000001:00000040:2.0:1777497798.626902:0:93018:0:(nodemap_storage.c:303:nodemap_cache_find_create()) removing old index, creating new one 00002000:00000040:2.0:1777497798.626908:0:93018:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x2:0x0] 00002000:00000040:2.0:1777497798.627378:0:93018:0:(ofd_dev.c:464:ofd_object_free()) object free, fid = [0x200000003:0x2:0x0] 00080000:10000000:2.0:1777497798.627818:0:93018:0:(osd_handler.c:5575:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000040:2.0:1777497798.630857:0:93018:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 6 - setup 00000020:00000080:2.0:1777497798.630863:0:93018:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1777497798.630887:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497798.630895:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630897:0:93018:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1777497798.630902:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1777497798.630904:0:93018:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #28 00000020:01000000:2.0:1777497798.630906:0:93018:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497798.630907:0:93018:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1777497798.630908:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1777497798.630910:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630912:0:93018:0:(obd_config.c:1561:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:2.0:1777497798.630914:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497798.630916:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630917:0:93018:0:(obd_config.c:1561:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1777497798.630920:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1777497798.630922:0:93018:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1777497798.630924:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497798.630926:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630928:0:93018:0:(obd_config.c:1561:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1777497798.630930:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1777497798.630932:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630933:0:93018:0:(obd_config.c:1561:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1777497798.630935:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1777497798.630968:0:93018:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1777497798.630971:0:93018:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1777497798.630973:0:93018:0:(obd_config.c:1561:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1777497798.630976:0:93018:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1777497798.633491:0:93014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1777497798.633637:0:93014:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00000020:00000040:1.0:1777497798.635295:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086df9e00 refcount=3 00010000:00010000:1.0:1777497798.635306:0:93014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecc7 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.635318:0:93014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecc7 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1777497798.635326:0:93014:0:(mgc_request.c:1799:mgc_process_log()) Process log params-ffff923f81243800 from 1 10000000:01000000:1.0:1777497798.635329:0:93014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000020:00000040:1.0:1777497798.635338:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00010000:00000040:1.0:1777497798.635363:0:93014:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff924090680000 count: 4 00000020:00000040:1.0:1777497798.635371:0:93014:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086d88200 with handle 0x3e357265691ecf1 to hash 00010000:00010000:1.0:1777497798.635380:0:93014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.635386:0:93014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.635408:0:93014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1777497798.635435:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.635450:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084032:0@lo:101:mount.lustre.0 00000100:00000040:1.0:1777497798.635475:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.635484:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.635541:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5f850 x1863837565084032 msgsize 328 00000100:00100000:1.0:1777497798.635546:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.635548:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.635577:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.635608:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3540 going to sleep for 11 seconds 00000100:00100000:0.0:1777497798.635914:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084032 00000100:00100000:0.0:1777497798.635922:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084032 00000020:00000040:0.0:1777497798.635925:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497798.635928:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:0.0:1777497798.635951:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497798.635984:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1777497798.635988:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497798.635993:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5f850 x1863837565084032/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.636010:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565084032:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1777497798.636033:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:0.0:1777497798.636042:0:90575:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff924090680a00 count: 5 00000020:00000040:0.0:1777497798.636048:0:90575:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086df8a00 with handle 0x3e357265691ecf8 to hash 00010000:00010000:0.0:1777497798.636052:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086df8a00/0x3e357265691ecf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ecf1 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636059:0:90575:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240a6374800 : new locks_count 17 00000020:00000040:0.0:1777497798.636061:0:90575:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=22 00010000:00000040:0.0:1777497798.636078:0:90575:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff924090680a00) refcount = 5 00010000:00000040:0.0:1777497798.636081:0:90575:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1777497798.636085:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92408150b200/0x3e357265691dea4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de9d expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636091:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9240bb7ff000/0x3e357265691de7a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de73 expref: 22 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636128:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9240bb7fe600/0x3e357265691ddfc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ddf5 expref: 22 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636137:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9240bb7fe000/0x3e357265691dd00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c455 expref: 8 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.636143:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086df8a00/0x3e357265691ecf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ecf1 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.636152:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086df8a00/0x3e357265691ecf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ecf1 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.636160:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086df8a00, rc 0) 00010000:00000040:0.0:1777497798.636169:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084032 00000100:00000040:0.0:1777497798.636178:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497798.636184:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.636205:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.636228:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497798.636232:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5f850 x1863837565084032/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/344 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.636240:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084032:12345-0@lo:101:mount.lustre.0 Request processed in 232us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497798.636247:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00000040:0.0:1777497798.636250:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497798.636260:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:0.0:1777497798.636312:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.636322:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.636329:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084032:0@lo:101:mount.lustre.0 00000100:00000040:0.0:1777497798.636336:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.636346:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086d88200 refcount=4 00010000:00000040:0.0:1777497798.636350:0:93014:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff924086d88200, remote cookie: 0x3e357265691ecf8, flags: 0x0 00010000:00000040:0.0:1777497798.636355:0:93014:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x736d61726170:0x3:0x0].0x0 (ffff924090680000) refcount = 4 00010000:00000040:0.0:1777497798.636357:0:93014:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:0.0:1777497798.636359:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff9240bb7ffe00/0x3e357265691de9d lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691dea4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636374:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f896ca000/0x3e357265691de73 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691de7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1777497798.636379:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff9240bb7ff200/0x3e357265691ddf5 lrc: 1/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ddfc expref: -99 pid: 90568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.636384:0:93014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecf8 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1777497798.636391:0:93014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ecf8 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:0.0:1777497798.636400:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565084032/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.636409:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:00000040:0.0:1777497798.636417:0:93014:0:(mgc_request.c:108:config_log_get()) log params (ffff9240a6b5d000) refs 2 00000020:00000040:0.0:1777497798.636420:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086d88200 refcount=3 10000000:00000040:0.0:1777497798.636447:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff92409077b600 : new refcount 2 10000000:00000040:0.0:1777497798.636451:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 10000000:00000040:0.0:1777497798.636454:0:93014:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.202.104@tcp: copy local log params 00000040:00080000:0.0:1777497798.637259:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1777497798.637534:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1777497798.637892:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1777497798.637919:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1777497798.637938:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1777497798.637943:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000020:00000040:0.0:1777497798.638168:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.638175:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497798.638208:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.638234:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084160:0@lo:501:mount.lustre.0 00000100:00000040:0.0:1777497798.638259:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.638267:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.638298:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5c050 x1863837565084160 msgsize 504 00000100:00100000:0.0:1777497798.638303:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.638305:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497798.643015:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.643355:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240908dc180 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.645301:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084160 00000100:00100000:2.0:1777497798.645315:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084160 00000020:00000040:2.0:1777497798.645319:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.645323:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:2.0:1777497798.645348:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497798.645423:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1777497798.645427:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497798.645435:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5c050 x1863837565084160/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 504/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.645465:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084160:12345-0@lo:501:mount.lustre.0 00000040:00000040:2.0:1777497798.645490:0:90573:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log params 00000040:00000040:2.0:1777497798.645504:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:2.0:1777497798.645573:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:2.0:1777497798.645580:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084160 00000100:00000040:2.0:1777497798.645591:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.645596:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.645642:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.645677:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497798.645682:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5c050 x1863837565084160/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 504/272 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.645691:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084160:12345-0@lo:501:mount.lustre.0 Request processed in 229us (7391us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.645707:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00000040:2.0:1777497798.645711:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497798.645725:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:1.0:1777497798.645807:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.645818:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.645825:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084160:0@lo:501:mount.lustre.0 00000100:00000040:1.0:1777497798.645834:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.645845:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.645849:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28a80 x1863837565084160/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 504/272 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.645869:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.645879:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497798.645884:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:1.0:1777497798.645908:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.645919:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084288:0@lo:503:mount.lustre.0 00000100:00000040:1.0:1777497798.645947:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.645967:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.645986:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5e850 x1863837565084288 msgsize 272 00000100:00100000:1.0:1777497798.645990:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1777497798.645992:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:1.0:1777497798.648434:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.648470:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f863d3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1777497798.650472:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084288 00000100:00100000:0.0:1777497798.650485:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084288 00000020:00000040:0.0:1777497798.650488:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497798.650572:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:0.0:1777497798.650603:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497798.650678:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1777497798.650683:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497798.650778:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5e850 x1863837565084288/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.650795:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084288:12345-0@lo:503:mount.lustre.0 00000040:00000040:0.0:1777497798.650840:0:90580:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:0.0:1777497798.650900:0:90580:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:0.0:1777497798.650907:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084288 00000100:00000040:0.0:1777497798.650919:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:0.0:1777497798.650924:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.651162:0:90580:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.651211:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:0.0:1777497798.651217:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5e850 x1863837565084288/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8416 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.651226:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084288:12345-0@lo:503:mount.lustre.0 Request processed in 435us (5238us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497798.651233:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00000040:0.0:1777497798.651237:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497798.651247:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:0.0:1777497798.651598:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.651612:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.651620:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084288:0@lo:503:mount.lustre.0 00000100:00000040:0.0:1777497798.651631:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.651645:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80000 x1863837565084288/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.651663:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.652285:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:0.0:1777497798.652923:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:0.0:1777497798.653256:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.653262:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497798.653298:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.653311:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084416:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1777497798.653364:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.653372:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.653405:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5ec50 x1863837565084416 msgsize 272 00000100:00100000:0.0:1777497798.653409:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.653411:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497798.653436:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.653461:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240908dcb40 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.653599:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084416 00000100:00100000:2.0:1777497798.653607:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084416 00000020:00000040:2.0:1777497798.653611:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.653615:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:2.0:1777497798.653636:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497798.653668:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00000040:2.0:1777497798.653672:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497798.653676:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5ec50 x1863837565084416/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.653688:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084416:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1777497798.653814:0:90574:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:2.0:1777497798.653861:0:90574:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:2.0:1777497798.653866:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084416 00000100:00000040:2.0:1777497798.653875:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.653880:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.653903:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.653920:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497798.653924:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5ec50 x1863837565084416/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.653933:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084416:12345-0@lo:502:mount.lustre.0 Request processed in 247us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.653940:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00000040:2.0:1777497798.653943:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497798.654118:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:0.0:1777497798.654260:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.654270:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.654277:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084416:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1777497798.654284:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.654295:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28a80 x1863837565084416/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.654309:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.654315:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:0.0:1777497798.654461:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1777497798.654490:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1777497798.654684:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1777497798.654811:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1777497798.654829:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000020:00000040:0.0:1777497798.654837:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.654842:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497798.654869:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.654877:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084544:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1777497798.654899:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.654905:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.654929:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5d850 x1863837565084544 msgsize 272 00000100:00100000:0.0:1777497798.654932:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.654935:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497798.655359:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.655385:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240908dcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1777497798.655589:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084544 00000100:00100000:1.0:1777497798.655597:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084544 00000020:00000040:1.0:1777497798.655600:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:1.0:1777497798.655604:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:1.0:1777497798.655626:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1777497798.655689:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00000040:1.0:1777497798.655703:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:1.0:1777497798.655709:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5d850 x1863837565084544/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.655720:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084544:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1777497798.655757:0:90580:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:1.0:1777497798.655798:0:90580:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:1.0:1777497798.655807:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084544 00000100:00000040:1.0:1777497798.655815:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:1.0:1777497798.655820:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.655846:0:90580:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.655871:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:1.0:1777497798.655876:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5d850 x1863837565084544/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.655883:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084544:12345-0@lo:502:mount.lustre.0 Request processed in 165us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497798.655890:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00000040:1.0:1777497798.655893:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497798.655902:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:0.0:1777497798.656181:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.656191:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.656198:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084544:0@lo:502:mount.lustre.0 00000100:00000040:0.0:1777497798.656207:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.656218:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf28a80 x1863837565084544/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497798.656234:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:0.0:1777497798.656241:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:0.0:1777497798.656284:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1777497798.656296:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 10000000:00000040:0.0:1777497798.656566:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff92409077b600 : new refcount 1 00000020:00000040:0.0:1777497798.656571:0:93014:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog params 00000020:01000000:0.0:1777497798.657930:0:93022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497798.657941:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497798.657943:0:93022:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1777497798.657960:0:93022:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff923f81243800 00000020:00000080:0.0:1777497798.657963:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777497798.657974:0:93022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497798.657977:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497798.657978:0:93022:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1777497798.657980:0:93022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1777497798.657982:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497798.657983:0:93022:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1777497798.657986:0:93022:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff923f81243800 00000020:00000080:0.0:1777497798.657988:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1777497798.658264:0:93022:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1777497798.658268:0:93022:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1777497798.658270:0:93022:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1777497798.658273:0:93022:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 7 00000020:01000000:3.0:1777497798.659233:0:93014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-6 (rc=0) 10000000:01000000:3.0:1777497798.659268:0:93014:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'params' succeeded (0). 00000020:00000040:3.0:1777497798.659290:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924086d88200 refcount=3 00010000:00010000:3.0:1777497798.659296:0:93014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecf8 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.659307:0:93014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924086d88200/0x3e357265691ecf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ecf8 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1777497798.659375:0:93014:0:(mgc_request.c:1941:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1777497798.659378:0:93014:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff923f81243800 10000000:01000000:3.0:1777497798.659380:0:93014:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff923f81243800 10000000:01000000:3.0:1777497798.659384:0:93014:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 00000020:00000040:3.0:1777497798.659388:0:93014:0:(genops.c:889:class_export_get()) GET export ffff924083958000 refcount=20 10000000:01000000:3.0:1777497798.659392:0:93014:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-client-ffff923f81243800 from 1 10000000:01000000:3.0:1777497798.659394:0:93014:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00000020:00000040:3.0:1777497798.659400:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00010000:00000040:3.0:1777497798.659423:0:93014:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff924090680300 count: 9 00000020:00000040:3.0:1777497798.659431:0:93014:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924099078c00 with handle 0x3e357265691ecff to hash 00010000:00010000:3.0:1777497798.659437:0:93014:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.659445:0:93014:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.659455:0:93014:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1777497798.660242:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.660264:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084672:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1777497798.660300:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.660309:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.660352:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5f450 x1863837565084672 msgsize 328 00000100:00100000:3.0:1777497798.660357:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.660359:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.661156:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.661186:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d480 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.662194:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084672 00000100:00100000:2.0:1777497798.662209:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084672 00000020:00000040:2.0:1777497798.662212:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.662217:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:3.0:1777497798.662851:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.662896:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1777497798.662902:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.662909:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5f450 x1863837565084672/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.662922:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:93014:x1863837565084672:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1777497798.662939:0:90573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1777497798.662961:0:90573:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff9240a6e49c00 count: 11 00000020:00000040:3.0:1777497798.662969:0:90573:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924099079a00 with handle 0x3e357265691ed06 to hash 00010000:00010000:3.0:1777497798.662975:0:90573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924099079a00/0x3e357265691ed06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ecff expref: -99 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.662983:0:90573:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240a6374800 : new locks_count 18 00000020:00000040:3.0:1777497798.662985:0:90573:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=23 00010000:00000040:3.0:1777497798.663012:0:90573:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff9240a6e49c00) refcount = 11 00010000:00000040:3.0:1777497798.663015:0:90573:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1777497798.663019:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff924086df8800/0x3e357265691ecc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ecc0 expref: 23 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663213:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902aa00/0x3e357265691e2ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4cc expref: 8 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663219:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902a000/0x3e357265691e2e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c4c5 expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663225:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a16200/0x3e357265691e2e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2da expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663231:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff924085eeee00/0x3e357265691e2b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2b0 expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663236:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f89735800/0x3e357265691e2a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e2a2 expref: 23 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663241:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92409902a600/0x3e357265691e29b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e294 expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663247:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f89735a00/0x3e357265691e28d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e286 expref: 23 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663251:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a16e00/0x3e357265691e27f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e278 expref: 23 pid: 90574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663257:0:90573:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f88a17400/0x3e357265691e271 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691e26a expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.663262:0:90573:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924099079a00/0x3e357265691ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ecff expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.663287:0:90573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924099079a00/0x3e357265691ed06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ecff expref: 23 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.663295:0:90573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099079a00, rc 0) 00010000:00000040:3.0:1777497798.663299:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084672 00000100:00000040:3.0:1777497798.663311:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.663317:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.663359:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.663387:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.663391:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5f450 x1863837565084672/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/344 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.663401:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565084672:12345-0@lo:101:mount.lustre.0 Request processed in 481us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.663407:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00000040:3.0:1777497798.663410:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.663419:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.663462:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.663471:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.663477:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084672:0@lo:101:mount.lustre.0 00000100:00000040:3.0:1777497798.663486:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.663601:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099078c00 refcount=4 00010000:00000040:3.0:1777497798.663614:0:93014:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff924099078c00, remote cookie: 0x3e357265691ed06, flags: 0x0 00010000:00000040:3.0:1777497798.663620:0:93014:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x0:0x0].0x0 (ffff924090680300) refcount = 9 00010000:00000040:3.0:1777497798.663623:0:93014:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1777497798.663626:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff924086df9e00/0x3e357265691ecc0 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ecc7 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663639:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff924085eefa00/0x3e357265691e2da lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2e1 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663645:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a16c00/0x3e357265691e2b0 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2b7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663651:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff924085eefc00/0x3e357265691e2a2 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e2a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663657:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f89734800/0x3e357265691e294 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e29b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663663:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a16600/0x3e357265691e286 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e28d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663669:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f88a17200/0x3e357265691e278 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e27f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497798.663674:0:93014:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff92409902ae00/0x3e357265691e26a lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691e271 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.663680:0:93014:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed06 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.663687:0:93014:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ed06 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1777497798.664148:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565084672/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.664158:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:00000040:3.0:1777497798.664165:0:93014:0:(mgc_request.c:108:config_log_get()) log lustre-client (ffff923f81896c00) refs 2 00000020:00000040:3.0:1777497798.664169:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099078c00 refcount=3 10000000:00000040:3.0:1777497798.664199:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff92409077b600 : new refcount 2 10000000:00000040:3.0:1777497798.664202:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 10000000:00000040:3.0:1777497798.664206:0:93014:0:(mgc_request_server.c:800:mgc_process_server_cfg_log()) MGC192.168.202.104@tcp: copy local log lustre-client 00000040:00080000:3.0:1777497798.664365:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1777497798.666419:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1777497798.670290:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1777497798.670368:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1777497798.670385:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1777497798.670398:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1777497798.670410:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1777497798.670422:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1777497798.670441:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1777497798.670456:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1777497798.670467:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1777497798.670478:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1777497798.670491:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1777497798.671078:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1777497798.671111:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1777497798.671130:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1777497798.671144:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1777497798.671157:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1777497798.671172:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1777497798.671184:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1777497798.671194:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1777497798.671207:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1777497798.671232:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1777497798.671247:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1777497798.671261:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1777497798.671275:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1777497798.671289:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1777497798.671303:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1777497798.671315:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1777497798.671325:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1777497798.671338:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1777497798.671351:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1777497798.671364:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1777497798.671377:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1777497798.671392:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1777497798.671405:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1777497798.671418:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1777497798.671429:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1777497798.671441:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1777497798.671466:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1777497798.671472:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000020:00000040:3.0:1777497798.671572:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.671579:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.671620:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.671633:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084800:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1777497798.671659:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.671668:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.671719:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5e450 x1863837565084800 msgsize 512 00000100:00100000:3.0:1777497798.671723:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.671725:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.671762:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.671796:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906da80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497798.671848:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084800 00000100:00100000:3.0:1777497798.671857:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084800 00000020:00000040:3.0:1777497798.671859:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497798.671863:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:3.0:1777497798.671883:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.671914:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1777497798.671918:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.671923:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5e450 x1863837565084800/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.671935:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565084800:12345-0@lo:501:mount.lustre.0 00000040:00000040:3.0:1777497798.671957:0:90574:0:(llog_server.c:62:llog_origin_handle_open()) MGS: opening log lustre-client 00000040:00000040:3.0:1777497798.671960:0:90574:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:3.0:1777497798.672023:0:90574:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00000020:00000040:3.0:1777497798.672033:0:90574:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=24 00000020:00000040:3.0:1777497798.672037:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 23 00010000:00000040:3.0:1777497798.672043:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084800 00000100:00000040:3.0:1777497798.672054:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.672060:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.672078:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=272 offset=224 replen=272 req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672122:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.672127:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5e450 x1863837565084800/t0(0) o501->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 512/272 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672137:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565084800:12345-0@lo:501:mount.lustre.0 Request processed in 203us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.672143:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00000040:3.0:1777497798.672153:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.672162:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.672204:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672214:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672220:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084800:0@lo:501:mount.lustre.0 00000100:00000040:3.0:1777497798.672227:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.672237:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.672240:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565084800/t0(0) o501->MGC192.168.202.104@tcp@0@lo:26/25 lens 512/272 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.672249:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.672259:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.672262:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.672275:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672283:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084928:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1777497798.672309:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672315:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.672329:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bcd5cc50 x1863837565084928 msgsize 272 00000100:00100000:3.0:1777497798.672332:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.672334:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.672342:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672351:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906da80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497798.672376:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565084928 00000100:00100000:3.0:1777497798.672380:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565084928 00000020:00000040:3.0:1777497798.672382:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497798.672383:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:3.0:1777497798.672392:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.672412:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1777497798.672414:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.672419:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bcd5cc50 x1863837565084928/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672428:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565084928:12345-0@lo:503:mount.lustre.0 00000040:00000040:3.0:1777497798.672447:0:90574:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:3.0:1777497798.672474:0:90574:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:3.0:1777497798.672477:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565084928 00000100:00000040:3.0:1777497798.672482:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.672485:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.672500:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8416 offset=224 replen=8416 req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672517:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.672521:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bcd5cc50 x1863837565084928/t0(0) o503->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8416 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672528:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcd5cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565084928:12345-0@lo:503:mount.lustre.0 Request processed in 102us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.672533:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00000040:3.0:1777497798.672535:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.672540:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.672578:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672585:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.672598:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565084928:0@lo:503:mount.lustre.0 00000100:00000040:3.0:1777497798.672604:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.672615:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565084928/t0(0) o503->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8416 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.672628:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.672633:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:3.0:1777497798.676684:0:93014:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000040:3.0:1777497798.676767:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.676775:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.676810:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.676825:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085056:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.676869:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.676878:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.676917:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2dc450 x1863837565085056 msgsize 272 00000100:00100000:3.0:1777497798.676922:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.676923:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.676953:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.676978:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d480 going to sleep for 11 seconds 00000100:00100000:3.0:1777497798.677009:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085056 00000100:00100000:3.0:1777497798.677015:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085056 00000020:00000040:3.0:1777497798.677018:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497798.677424:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:3.0:1777497798.677450:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497798.677481:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00000040:3.0:1777497798.677485:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497798.677499:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2dc450 x1863837565085056/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.677512:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085056:12345-0@lo:502:mount.lustre.0 00000040:00000040:3.0:1777497798.677543:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:3.0:1777497798.677589:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:3.0:1777497798.677594:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085056 00000100:00000040:3.0:1777497798.677604:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:3.0:1777497798.677609:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.677631:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.677651:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:3.0:1777497798.677656:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2dc450 x1863837565085056/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.677664:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085056:12345-0@lo:502:mount.lustre.0 Request processed in 154us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.677671:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00000040:3.0:1777497798.677674:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497798.677683:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.677890:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.677900:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.677908:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085056:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.677923:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.677934:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565085056/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.677949:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.677956:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:3.0:1777497798.678225:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1777497798.678254:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1777497798.678268:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1777497798.678282:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1777497798.678296:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1777497798.678308:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1777497798.678321:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1777497798.678334:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1777497798.678349:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1777497798.678363:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1777497798.678380:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1777497798.678394:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1777497798.678406:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1777497798.678419:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1777497798.678432:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1777497798.678445:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1777497798.678458:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1777497798.678469:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1777497798.678479:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1777497798.678491:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1777497798.678819:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1777497798.678835:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1777497798.678848:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1777497798.678862:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1777497798.678874:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1777497798.678904:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1777497798.678918:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1777497798.678930:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1777497798.678941:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1777497798.678951:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1777497798.678964:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1777497798.678976:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1777497798.678990:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1777497798.679001:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1777497798.679012:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1777497798.681678:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1777497798.681991:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1777497798.682010:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1777497798.682176:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1777497798.682196:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1777497798.682209:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1777497798.682220:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1777497798.682236:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1777497798.682249:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1777497798.682263:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1777497798.682276:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1777497798.682289:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1777497798.682301:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000020:00000040:3.0:1777497798.682320:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.682329:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.682369:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.682384:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085184:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.682427:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.682436:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.682481:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2dd450 x1863837565085184 msgsize 272 00000100:00100000:3.0:1777497798.682485:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.682487:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.684902:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.684939:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d480 going to sleep for 11 seconds 00000100:00100000:1.0:1777497798.685369:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085184 00000100:00100000:1.0:1777497798.685379:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085184 00000020:00000040:1.0:1777497798.685381:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:1.0:1777497798.685386:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:1.0:1777497798.685410:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1777497798.685443:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1777497798.685447:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:1.0:1777497798.685452:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2dd450 x1863837565085184/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.685465:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085184:12345-0@lo:502:mount.lustre.0 00000040:00000040:1.0:1777497798.685606:0:90573:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:1.0:1777497798.685669:0:90573:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:1.0:1777497798.685674:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085184 00000100:00000040:1.0:1777497798.685685:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:1.0:1777497798.685690:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.685975:0:90573:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.686013:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:1.0:1777497798.686617:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2dd450 x1863837565085184/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.686631:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085184:12345-0@lo:502:mount.lustre.0 Request processed in 1168us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497798.686640:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00000040:1.0:1777497798.686643:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497798.686655:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.686854:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.686865:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.686872:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085184:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.686879:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.686892:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565085184/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.686909:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.686917:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:3.0:1777497798.687722:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1777497798.687764:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000040:00080000:3.0:1777497798.687778:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1777497798.687791:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].52, 224 off17176 00000040:00080000:3.0:1777497798.687803:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].53, 112 off17288 00000040:00080000:3.0:1777497798.687818:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].54, 224 off17512 00000040:00080000:3.0:1777497798.687832:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].55, 224 off17736 00000040:00080000:3.0:1777497798.687844:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].56, 136 off17872 00000040:00080000:3.0:1777497798.687858:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].57, 224 off18096 00000040:00080000:3.0:1777497798.687871:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].58, 224 off18320 00000040:00080000:3.0:1777497798.687883:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].59, 136 off18456 00000040:00080000:3.0:1777497798.687894:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].60, 224 off18680 00000040:00080000:3.0:1777497798.687917:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].61, 224 off18904 00000040:00080000:3.0:1777497798.687929:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].62, 112 off19016 00000020:00000040:3.0:1777497798.687938:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.687944:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497798.687971:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.687983:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085312:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.688038:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.688046:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.688087:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2de450 x1863837565085312 msgsize 272 00000100:00100000:3.0:1777497798.688092:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.688122:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497798.688143:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.688171:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff92409906d480 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.688424:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085312 00000100:00100000:2.0:1777497798.688433:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085312 00000020:00000040:2.0:1777497798.688435:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.688439:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:2.0:1777497798.688463:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497798.688507:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1777497798.688511:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497798.688516:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2de450 x1863837565085312/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.688527:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085312:12345-0@lo:502:mount.lustre.0 00000040:00000040:2.0:1777497798.688562:0:90580:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff9240a69ff180 : new refcount 2 00000040:00000040:2.0:1777497798.688616:0:90580:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff9240a69ff180 : new refcount 1 00010000:00000040:2.0:1777497798.688621:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085312 00000100:00000040:2.0:1777497798.688630:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.688635:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.688656:0:90580:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=8472 offset=224 replen=8472 req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.688681:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 51 to 0@lo 00000100:00000040:2.0:1777497798.688686:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2de450 x1863837565085312/t0(0) o502->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 272/8472 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.688703:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565085312:12345-0@lo:502:mount.lustre.0 Request processed in 178us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.688709:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00000040:2.0:1777497798.688712:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497798.688720:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:3.0:1777497798.689279:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.689290:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.689297:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565085312:0@lo:502:mount.lustre.0 00000100:00000040:3.0:1777497798.689305:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.689317:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565085312/t0(0) o502->MGC192.168.202.104@tcp@0@lo:26/25 lens 272/8472 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.689334:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497798.689343:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000040:00080000:3.0:1777497798.689401:0:93014:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].63, 224 off19240 00000040:00080000:3.0:1777497798.689412:0:93014:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 63 count 63 10000000:00000040:3.0:1777497798.691929:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff92409077b600 : new refcount 1 00000020:00000040:3.0:1777497798.691941:0:93014:0:(obd_config.c:2122:class_config_parse_llog()) looking up llog lustre-client 00000100:00000040:2.0:1777497798.696015:0:93025:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.202.104@tcp 192.168.202.104@tcp cnt=1 00000020:01000004:2.0:1777497798.696186:0:93025:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1777497798.696205:0:93025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) 00000020:00000040:2.0:1777497798.696212:0:93025:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240bb805000 with handle 0x3e357265691ed0d to hash 00000020:00000040:2.0:1777497798.696220:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb805000 : new refcount 1 00000020:00000040:2.0:1777497798.696235:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 2 - obd_device_list 00000020:00000080:2.0:1777497798.696242:0:93025:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1777497798.696407:0:93025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f81243800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1777497798.696412:0:93025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f81243800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1777497798.696414:0:93025:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f81243800 3 00000020:00000040:2.0:1777497798.696430:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 3 - import 00000020:00000040:2.0:1777497798.696435:0:93025:0:(genops.c:1244:class_import_put()) import ffff924086e27000 refcount=1 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:2.0:1777497798.696449:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.696464:0:93025:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 52 to 0@lo 00000100:00000040:2.0:1777497798.696467:0:93025:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.104@tcp -> ffff924089288a00 00010000:00080000:2.0:1777497798.696471:0:93025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff924086e27000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:3.0:1777497798.709338:0:93025:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-11 is initialized 00000020:00000040:3.0:1777497798.709461:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 4 - setup 00000020:00000080:3.0:1777497798.709466:0:93025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1777497798.710188:0:93025:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000040:3.0:1777497798.710196:0:93025:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240bcd90800 with handle 0x3e357265691ed14 to hash 00000020:00000040:3.0:1777497798.710203:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd90800 refcount=3 00000020:00000040:3.0:1777497798.710207:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 5 - export 00000020:00000040:3.0:1777497798.710211:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd90800 : new refcount 2 00000020:00000080:3.0:1777497798.710214:0:93025:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3e357265691ed14 00000020:00000040:3.0:1777497798.710216:0:93025:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed14 00000020:00000040:3.0:1777497798.710218:0:93025:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd90800 refcount=3 00000100:00080000:3.0:1777497798.710228:0:93025:0:(import.c:509:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:3.0:1777497798.710235:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 53 to 0@lo 00000020:00000040:3.0:1777497798.710237:0:93025:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed14 00000020:00000040:3.0:1777497798.710238:0:93025:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd90800 refcount=4 00000100:00000040:3.0:1777497798.710240:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 54 to 0@lo 00000020:00000040:3.0:1777497798.710242:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd90800 : new refcount 3 00000100:00080000:3.0:1777497798.710244:0:93025:0:(import.c:623:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff924086e27000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497798.710260:0:93025:0:(genops.c:1231:class_import_get()) import ffff924086e27000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:3.0:1777497798.710284:0:93025:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.710299:0:93025:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000981d52dc] to pc [ptlrpcd_rcv+-1] req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.710369:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.710383:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565085440:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1777497798.710416:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.710423:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.710460:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbd180 x1863837565085440 msgsize 520 00000100:00100000:2.0:1777497798.710465:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.710487:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.710510:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00080000:3.0:1777497798.710549:0:93025:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:00000040:3.0:1777497798.710552:0:93025:0:(genops.c:1231:class_import_get()) import ffff924086e27000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1777497798.710584:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.710593:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f8275c800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1777497798.710603:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.710614:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000031983dca] to pc [ptlrpcd_00_00+0] req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.710634:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.710640:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f82ab3800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1777497798.710646:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.710654:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cf881137] to pc [ptlrpcd_00_01+1] req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.710662:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.710667:0:38121:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:3.0:1777497798.710672:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.710681:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000006ceefcbe] to pc [ptlrpcd_00_02+2] req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497798.710698:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497798.710701:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1777497798.710704:0:38121:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497798.710709:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 3923 00000100:00080000:3.0:1777497798.710712:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00000040:3.0:1777497798.710714:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 53 to 0@lo 00000100:00000040:3.0:1777497798.710723:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 54 to 0@lo 00000020:00000040:3.0:1777497798.710725:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bb6 00000020:00000040:3.0:1777497798.710727:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a89000 refcount=4 00000100:00000040:3.0:1777497798.710729:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 53 to 0@lo 00000100:00000040:3.0:1777497798.710731:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 54 to 0@lo 00000020:00000040:3.0:1777497798.710733:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a89000 : new refcount 3 00000100:00080000:3.0:1777497798.710735:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497798.710751:0:38121:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:3.0:1777497798.710761:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.710770:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003304ad51] to pc [ptlrpcd_rcv+-1] req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.713704:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.713722:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565085952:0@lo:8:kworker.0 00000100:00000040:2.0:1777497798.713763:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.713771:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.713807:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbc700 x1863837565085952 msgsize 520 00000100:00100000:2.0:1777497798.713812:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.713841:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.713853:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5281 usecs (6 jiffies) 00000100:00100000:2.0:1777497798.713880:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085440 00000100:00100000:2.0:1777497798.713888:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085440 00000020:00000040:2.0:1777497798.713901:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1777497798.713944:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00000040:2.0:1777497798.713951:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbd180 x1863837565085440/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1777497818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.713961:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3656:x1863837565085440:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1777497798.713976:0:65418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 14 - find 00010000:00000040:2.0:1777497798.713990:0:65418:0:(ldlm_lib.c:1252:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1777497798.713996:0:65418:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3928 last 0 00000020:00000040:2.0:1777497798.714005:0:65418:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086e21800 with handle 0x3e357265691ed1b to hash 00000020:00000040:2.0:1777497798.714044:0:65418:0:(genops.c:889:class_export_get()) GET export ffff924086e21800 refcount=3 00000020:00000040:2.0:1777497798.714049:0:65418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 15 - export 00000020:00000040:2.0:1777497798.714053:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff924086e21800 : new refcount 2 00000020:00000080:2.0:1777497798.714055:0:65418:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3e357265691ed1b 00000020:00000040:2.0:1777497798.714057:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed1b 00000020:00000040:2.0:1777497798.714059:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e21800 refcount=3 00000001:00000040:2.0:1777497798.714068:0:65418:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.202.104@tcp 00000001:00000040:2.0:1777497798.714072:0:65418:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 15 00000020:00000040:2.0:1777497798.714075:0:65418:0:(genops.c:889:class_export_get()) GET export ffff924086e21800 refcount=4 00000001:00000040:2.0:1777497798.714077:0:65418:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 16 00000001:00000040:2.0:1777497798.714080:0:65418:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9240867b8c00) : new refcount 15 00000004:00100000:2.0:1777497798.714084:0:65418:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1777497798.714115:0:65418:0:(lprocfs_status_server.c:685:lprocfs_exp_setup()) Found stats ffff9240b548aa80 for nid 0@lo - ref 6 00000020:00000040:2.0:1777497798.714122:0:65418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - import 00000020:00000040:2.0:1777497798.714129:0:65418:0:(genops.c:1244:class_import_put()) import ffff9240a3afb000 refcount=1 obd=lustre-MDT0000 00000020:00000040:2.0:1777497798.714135:0:65418:0:(genops.c:889:class_export_get()) GET export ffff924086e21800 refcount=5 00000100:00000040:2.0:1777497798.714138:0:65418:0:(service.c:1080:ptlrpc_request_change_export()) RPC GETting export ffff924086e21800 : new rpc_count 1 00000100:00000040:2.0:1777497798.714142:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 55 to 0@lo 00000100:00000040:2.0:1777497798.714145:0:65418:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 55 to 0@lo 00000020:00000040:2.0:1777497798.714147:0:65418:0:(genops.c:889:class_export_get()) GET export ffff924086e21800 refcount=6 00000100:00000040:2.0:1777497798.714160:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00080000:2.0:1777497798.714168:0:65418:0:(import.c:65:import_set_state_nolock()) ffff9240a3afb000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1777497798.714172:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff924086e21800 : new refcount 5 00000020:00000040:2.0:1777497798.714175:0:65418:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - find 00010000:00000040:2.0:1777497798.714189:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085440 00000100:00000040:2.0:1777497798.714197:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.714202:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.714220:0:65418:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714242:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.714247:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbd180 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1777497818 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714256:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3656:x1863837565085440:12345-0@lo:38:llog_process_th.0 Request processed in 295us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.714262:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00000040:2.0:1777497798.714265:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e21800 : new rpc_count 0 00000020:00000040:2.0:1777497798.714275:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff924086e21800 : new refcount 4 00000100:00000040:2.0:1777497798.714292:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714302:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565085568:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.714314:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714321:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.714335:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbdc00 x1863837565085568 msgsize 224 00000100:00100000:2.0:1777497798.714339:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.714351:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714361:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8982 usecs (9 jiffies) 00000100:00100000:2.0:1777497798.714377:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1777497798.714382:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714390:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565085696:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.714403:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714409:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.714420:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5bbe680 x1863837565085696 msgsize 224 00000100:00100000:2.0:1777497798.714424:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.714435:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714444:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8568 usecs (9 jiffies) 00000100:00100000:2.0:1777497798.714458:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085568 00000100:00100000:2.0:1777497798.714462:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085568 00000020:00000040:2.0:1777497798.714463:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691deff 00000020:00000040:2.0:1777497798.714466:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1e800 refcount=5 00000020:00000040:2.0:1777497798.714475:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00000040:2.0:1777497798.714660:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1777497798.714682:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085696 00000100:00100000:2.0:1777497798.714686:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085696 00000020:00000040:2.0:1777497798.714687:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917c5e 00000020:00000040:2.0:1777497798.714690:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb61800 refcount=5 00000020:00000040:2.0:1777497798.714699:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00100000:2.0:1777497798.714718:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00000040:2.0:1777497798.714721:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1e800 : new rpc_count 1 00000100:00000040:2.0:1777497798.714725:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbdc00 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714736:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565085568:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.714757:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085568 00000100:00000040:2.0:1777497798.714767:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.714771:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.714789:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714805:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.714809:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbdc00 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714817:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3657:x1863837565085568:12345-0@lo:400:kworker.0 Request processed in 83us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.714823:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00000040:2.0:1777497798.714826:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1e800 : new rpc_count 0 00000020:00000040:2.0:1777497798.714832:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1e800 : new refcount 4 00000100:00100000:2.0:1777497798.714841:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00000040:2.0:1777497798.714843:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb61800 : new rpc_count 1 00000100:00000040:2.0:1777497798.714847:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbe680 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714856:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565085696:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.714865:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565085696 00000100:00000040:2.0:1777497798.714870:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.714873:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.714886:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.714896:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.714900:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbe680 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.714907:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565085696:12345-0@lo:400:kworker.0 Request processed in 52us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.714921:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00000040:2.0:1777497798.714923:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb61800 : new rpc_count 0 00000020:00000040:2.0:1777497798.714929:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb61800 : new refcount 4 00000100:00080000:2.0:1777497798.714944:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1777497798.714948:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 10 - evictor 00000100:00080000:2.0:1777497798.714950:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1777497798.714952:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00000040:2.0:1777497798.714987:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1777497798.714992:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.715001:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.715007:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565085696:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.715017:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:2.0:1777497798.715089:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.715118:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.715125:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3657:1863837565085568:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.715130:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3800 x1863837565085696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.715138:0:3657:0:(genops.c:1244:class_import_put()) import ffff923f82ab3800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:2.0:1777497798.715147:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1f80 x1863837565085568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.715153:0:3657:0:(genops.c:1244:class_import_put()) import ffff923f8275c800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1777497798.715184:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:2.0:1777497798.715187:0:3656:0:(client.c:3211:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:2.0:1777497798.715192:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497798.715202:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 28 00000020:00000040:2.0:1777497798.715204:0:3656:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed14 00000020:00000040:2.0:1777497798.715207:0:3656:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd90800 refcount=4 00000100:00080000:2.0:1777497798.715213:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:2.0:1777497798.715215:0:3656:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd90800 : new refcount 3 00000100:00080000:2.0:1777497798.715219:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1777497798.715221:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924086e27000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000040:2.0:1777497798.715227:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.715234:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3656:1863837565085440:0@lo:38:llog_process_th.0 00000100:00000040:2.0:1777497798.715239:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565085440/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.715246:0:3656:0:(genops.c:1244:class_import_put()) import ffff924086e27000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00100000:0.0:1777497798.715375:0:25486:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085952 00000100:00100000:0.0:1777497798.715380:0:25486:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085952 00000020:00000040:0.0:1777497798.715382:0:25486:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bcb 00000100:00100000:0.0:1777497798.715414:0:25486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5981 00000100:00000040:0.0:1777497798.715419:0:25486:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5bbc700 x1863837565085952/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.715428:0:25486:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3656:x1863837565085952:12345-0@lo:8:kworker.0 00000020:00000040:0.0:1777497798.715442:0:25486:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 7 - find 00010000:00000040:0.0:1777497798.715446:0:25486:0:(ldlm_lib.c:1201:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:0.0:1777497798.715448:0:25486:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 7 - find 00000100:00000040:0.0:1777497798.715457:0:25486:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:0.0:1777497798.715459:0:25486:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:0.0:1777497798.715462:0:25486:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.715481:0:25486:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.715625:0:25486:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:0.0:1777497798.715629:0:25486:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5bbc700 x1863837565085952/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497818 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.715636:0:25486:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:0+-99:3656:x1863837565085952:12345-0@lo:8:kworker.0 Request processed in 208us (1828us total) trans 0 rc -11/-11 00000100:00100000:0.0:1777497798.715642:0:25486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5981 00000100:00000040:1.0:1777497798.715699:0:3656:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969458 00000100:00000040:1.0:1777497798.715705:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497798.715713:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1777497798.715716:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:1.0:1777497798.715719:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.715725:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565085952:0@lo:8:kworker.0 00000100:00000040:1.0:1777497798.715730:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b2680 x1863837565085952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497798.715746:0:3656:0:(genops.c:1244:class_import_put()) import ffff924098a6d000 refcount=3 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1777497798.716433:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.716447:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565085824:0@lo:400:kworker.0 00000100:00000040:0.0:1777497798.716470:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.716477:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.716512:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28a80 x1863837565085824 msgsize 224 00000100:00100000:0.0:1777497798.716517:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.716535:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.716547:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1846842 usecs (1847 jiffies) 00000100:00000040:3.0:1777497798.718235:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.718259:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1777497798.718291:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718310:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007c6c658c] to pc [ptlrpcd_00_03+3] req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718327:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.718332:0:38121:0:(genops.c:1231:class_import_get()) import ffff92409c5dd800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1777497798.718341:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718348:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cdddd431] to pc [ptlrpcd_00_00+0] req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718363:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.718368:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1777497798.718392:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718401:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000e20a1433] to pc [ptlrpcd_00_01+1] req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497798.718408:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497798.718412:0:38121:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1777497798.718416:0:38121:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1777497798.718421:0:38121:0:(import.c:509:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 3923 00000100:00080000:3.0:1777497798.718427:0:38121:0:(import.c:588:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00000040:3.0:1777497798.718430:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 55 to 0@lo 00000100:00000040:3.0:1777497798.718434:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 56 to 0@lo 00000020:00000040:3.0:1777497798.718436:0:38121:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddbd 00000020:00000040:3.0:1777497798.718440:0:38121:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f839d0800 refcount=4 00000100:00000040:3.0:1777497798.718443:0:38121:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 55 to 0@lo 00000100:00000040:3.0:1777497798.718445:0:38121:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 56 to 0@lo 00000020:00000040:3.0:1777497798.718448:0:38121:0:(genops.c:900:class_export_put()) PUTting export ffff923f839d0800 : new refcount 3 00000100:00080000:3.0:1777497798.718451:0:38121:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497798.718464:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1777497798.718475:0:38121:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718485:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000004b854ddb] to pc [ptlrpcd_rcv+-1] req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718506:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.718512:0:38121:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497798.718521:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718540:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005443ca26] to pc [ptlrpcd_00_02+2] req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718549:0:38121:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497798.718554:0:38121:0:(genops.c:1231:class_import_get()) import ffff9240bb6f5800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1777497798.718562:0:38121:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497798.718569:0:38121:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003304ad51] to pc [ptlrpcd_00_03+3] req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718581:0:38121:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (3933) 00000100:00000040:3.0:1777497798.718614:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.718626:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565086080:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.718655:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718662:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.718701:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9240865b1f80 x1863837565086080 msgsize 224 00000100:00100000:3.0:1777497798.718706:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.718731:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718754:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4957 usecs (5 jiffies) 00000100:00000040:3.0:1777497798.718762:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.718770:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565086720:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.718784:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718796:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.718811:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9240865b3800 x1863837565086720 msgsize 224 00000100:00100000:3.0:1777497798.718815:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.718828:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718837:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6738 usecs (7 jiffies) 00000100:00100000:3.0:1777497798.718850:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1777497798.718855:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.718863:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565086592:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.718875:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718881:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.718895:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b3100 x1863837565086592 msgsize 224 00000100:00100000:3.0:1777497798.718899:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.718912:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718921:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5967 usecs (6 jiffies) 00000100:00000040:3.0:1777497798.718946:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.718954:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565086336:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.718966:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.718972:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.718986:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b1f80 x1863837565086336 msgsize 224 00000100:00100000:3.0:1777497798.718989:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.719003:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719019:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4117 usecs (5 jiffies) 00000100:00100000:3.0:1777497798.719045:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:3.0:1777497798.719050:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719058:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565086208:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.719073:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719080:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.719116:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b0700 x1863837565086208 msgsize 224 00000100:00100000:3.0:1777497798.719121:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.719133:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719142:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 78303 usecs (79 jiffies) 00000100:00100000:3.0:1777497798.719162:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086080 00000100:00100000:3.0:1777497798.719169:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086080 00000020:00000040:3.0:1777497798.719171:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:3.0:1777497798.719174:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:3.0:1777497798.719190:0:25487:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:3.0:1777497798.719213:0:25487:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:3.0:1777497798.719239:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086592 00000100:00100000:3.0:1777497798.719242:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086592 00000020:00000040:3.0:1777497798.719244:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:3.0:1777497798.719247:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00100000:3.0:1777497798.719270:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2720 00000100:00000040:3.0:1777497798.719274:0:25487:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:3.0:1777497798.719278:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240865b1f80 x1863837565086080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719287:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565086080:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497798.719312:0:25487:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565086080 00000100:00000040:3.0:1777497798.719319:0:25487:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:3.0:1777497798.719323:0:25487:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.719337:0:25487:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719354:0:25487:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:3.0:1777497798.719358:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1f80 x1863837565086080/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719365:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565086080:12345-0@lo:400:kworker.0 Request processed in 79us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.719372:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2720 00000100:00000040:3.0:1777497798.719376:0:25487:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:3.0:1777497798.719386:0:25487:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00100000:3.0:1777497798.719395:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2721 00000100:00000040:3.0:1777497798.719397:0:25487:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:3.0:1777497798.719400:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b3100 x1863837565086592/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719410:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565086592:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497798.719417:0:25487:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565086592 00000100:00000040:3.0:1777497798.719421:0:25487:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:3.0:1777497798.719424:0:25487:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.719435:0:25487:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719447:0:25487:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:3.0:1777497798.719450:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b3100 x1863837565086592/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719468:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565086592:12345-0@lo:400:kworker.0 Request processed in 60us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.719475:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2721 00000100:00000040:3.0:1777497798.719477:0:25487:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:3.0:1777497798.719482:0:25487:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00000040:3.0:1777497798.719514:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1777497798.719519:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719528:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719534:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565086592:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.719546:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:3.0:1777497798.719550:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.719557:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.719563:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565086080:0@lo:400:kworker.0 00000100:00000040:3.0:1777497798.719567:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b2a00 x1863837565086592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.719576:0:3660:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497798.719584:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3b80 x1863837565086080/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.719590:0:3660:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1777497798.719853:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.719864:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240865b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565086464:0@lo:8:kworker.0 00000100:00000040:0.0:1777497798.719880:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.719887:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497798.719902:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28700 x1863837565086464 msgsize 520 00000100:00100000:0.0:1777497798.719907:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497798.719931:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497798.719947:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4072 usecs (5 jiffies) 00000100:00100000:3.0:1777497798.720281:0:8396:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086464 00000100:00100000:3.0:1777497798.720293:0:8396:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086464 00000020:00000040:3.0:1777497798.720296:0:8396:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddc4 00000100:00100000:3.0:1777497798.720359:0:8396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5982 00000100:00000040:3.0:1777497798.720364:0:8396:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28700 x1863837565086464/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.720373:0:8396:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1863837565086464:12345-0@lo:8:kworker.0 00000020:00000040:3.0:1777497798.720390:0:8396:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 7 - find 00010000:00000040:3.0:1777497798.720395:0:8396:0:(ldlm_lib.c:1201:target_handle_connect()) lustre-OST0000: Temporarily refusing client connection from 0@lo 00000020:00000040:3.0:1777497798.720398:0:8396:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 7 - find 00000100:00000040:3.0:1777497798.720410:0:8396:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:3.0:1777497798.720412:0:8396:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:3.0:1777497798.720415:0:8396:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.720436:0:8396:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497823 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.720455:0:8396:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:3.0:1777497798.720458:0:8396:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28700 x1863837565086464/t0(0) o8->@:0/0 lens 520/224 e 0 to 0 dl 1777497818 ref 1 fl Interpret:/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.720466:0:8396:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3656:x1863837565086464:12345-0@lo:8:kworker.0 Request processed in 92us (562us total) trans 0 rc -11/-11 00000100:00100000:3.0:1777497798.720472:0:8396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5982 00000100:00100000:2.0:1777497798.720821:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565085824 00000100:00100000:2.0:1777497798.720827:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565085824 00000020:00000040:2.0:1777497798.720829:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:2.0:1777497798.720833:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:2.0:1777497798.720850:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1777497798.720875:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086336 00000100:00100000:2.0:1777497798.720878:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086336 00000020:00000040:2.0:1777497798.720880:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:2.0:1777497798.720883:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00100000:2.0:1777497798.720904:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4113 00000100:00000040:2.0:1777497798.720907:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:2.0:1777497798.720919:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28a80 x1863837565085824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.720931:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565085824:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.720946:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565085824 00000100:00000040:2.0:1777497798.720953:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.720956:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.720978:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.720997:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.721001:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28a80 x1863837565085824/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721009:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565085824:12345-0@lo:400:kworker.0 Request processed in 80us (4496us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.721015:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4113 00000100:00000040:2.0:1777497798.721018:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:2.0:1777497798.721038:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00100000:2.0:1777497798.721049:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4114 00000100:00000040:2.0:1777497798.721051:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:2.0:1777497798.721054:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b1f80 x1863837565086336/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721063:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565086336:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.721073:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565086336 00000100:00000040:2.0:1777497798.721077:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.721080:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.721117:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721148:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.721152:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b1f80 x1863837565086336/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721159:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565086336:12345-0@lo:400:kworker.0 Request processed in 97us (2171us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.721165:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4114 00000100:00000040:2.0:1777497798.721167:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:2.0:1777497798.721172:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00000040:2.0:1777497798.721218:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1777497798.721223:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721232:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721238:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565085824:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.721245:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b3100 x1863837565085824/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.721254:0:3659:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1777497798.721277:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1777497798.721282:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721290:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721296:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565086336:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.721302:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1180 x1863837565086336/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.721316:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00080000:2.0:1777497798.721331:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497798.721336:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00100000:2.0:1777497798.721366:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086720 00000100:00100000:2.0:1777497798.721369:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086720 00000020:00000040:2.0:1777497798.721371:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df0d 00000020:00000040:2.0:1777497798.721373:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409f6c2800 refcount=5 00000100:00000040:2.0:1777497798.721383:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:2.0:1777497798.721399:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086208 00000100:00100000:2.0:1777497798.721401:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086208 00000020:00000040:2.0:1777497798.721403:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df06 00000020:00000040:2.0:1777497798.721405:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1f000 refcount=5 00000100:00100000:2.0:1777497798.721420:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00000040:2.0:1777497798.721422:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409f6c2800 : new rpc_count 1 00000100:00000040:2.0:1777497798.721426:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240865b3800 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721436:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240865b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565086720:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.721446:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565086720 00000100:00000040:2.0:1777497798.721450:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.721453:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.721470:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721486:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.721490:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b3800 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721685:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240865b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565086720:12345-0@lo:400:kworker.0 Request processed in 247us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.721690:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00000040:2.0:1777497798.721699:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409f6c2800 : new rpc_count 0 00000020:00000040:2.0:1777497798.721706:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409f6c2800 : new refcount 4 00000100:00100000:2.0:1777497798.721716:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00000040:2.0:1777497798.721719:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1f000 : new rpc_count 1 00000100:00000040:2.0:1777497798.721722:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b0700 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:554/0 lens 224/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721732:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565086208:12345-0@lo:400:kworker.0 00010000:00000040:2.0:1777497798.721751:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565086208 00000100:00000040:2.0:1777497798.721756:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.721759:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.721775:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721793:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 56 to 0@lo 00000100:00000040:2.0:1777497798.721797:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b0700 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:554/0 lens 224/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721804:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1863837565086208:12345-0@lo:400:kworker.0 Request processed in 74us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.721810:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00000040:2.0:1777497798.721812:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1f000 : new rpc_count 0 00000020:00000040:2.0:1777497798.721816:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1f000 : new refcount 4 00000100:00000040:2.0:1777497798.721841:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1777497798.721846:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721853:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721860:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565086720:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.721874:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b2680 x1863837565086720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.721883:0:3660:0:(genops.c:1244:class_import_put()) import ffff9240bb6f5800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:2.0:1777497798.721907:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:2.0:1777497798.721911:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.721918:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.721925:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3658:1863837565086208:0@lo:400:kworker.0 00000100:00000040:2.0:1777497798.721930:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b0e00 x1863837565086208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.721937:0:3658:0:(genops.c:1244:class_import_put()) import ffff92409c5dd800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1777497798.722070:0:3656:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: skip recheck: last_committed 4294969459 00000100:00000040:3.0:1777497798.722077:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Rpc:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497798.722085:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1777497798.722088:0:3656:0:(import.c:1506:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00000040:3.0:1777497798.722092:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Interpret:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.722117:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240865b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565086464:0@lo:8:kworker.0 00000100:00000040:3.0:1777497798.722129:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240865b1c00 x1863837565086464/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/224 e 0 to 0 dl 1777497823 ref 1 fl Complete:RNQU/200/0 rc -11/-11 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.722138:0:3656:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000020:00000040:3.0:1777497798.722173:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd90800 refcount=4 00000020:00000040:3.0:1777497798.722181:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd90800 refcount=5 00000100:00000040:3.0:1777497798.722251:0:93025:0:(lustre_peer.c:111:class_add_uuid()) found uuid 192.168.202.104@tcp 192.168.202.104@tcp cnt=1 00000020:01000004:3.0:1777497798.722269:0:93025:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1777497798.722283:0:93025:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) 00000020:00000040:3.0:1777497798.722288:0:93025:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240bcd94800 with handle 0x3e357265691ed22 to hash 00000020:00000040:3.0:1777497798.722293:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd94800 : new refcount 1 00000020:00000040:3.0:1777497798.722307:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 2 - obd_device_list 00000020:00000080:3.0:1777497798.722313:0:93025:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:00000040:2.0:1777497798.723127:0:93027:0:(genops.c:889:class_export_get()) GET export ffff9240bcd90800 refcount=6 00000020:00000040:2.0:1777497798.723133:0:93027:0:(genops.c:889:class_export_get()) GET export ffff9240bcd90800 refcount=7 00000020:00000040:2.0:1777497798.723137:0:93027:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd90800 : new refcount 6 00000020:01000004:2.0:1777497798.723297:0:93025:0:(tgt_mount.c:153:server_get_mount()) get mount ffff923f81243800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1777497798.723302:0:93025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff923f81243800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1777497798.723304:0:93025:0:(obd_mount.c:701:lustre_put_lsi()) put ffff923f81243800 3 00000020:00000040:2.0:1777497798.723323:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 3 - import 00000020:00000040:2.0:1777497798.723328:0:93025:0:(genops.c:1244:class_import_put()) import ffff92409fb63000 refcount=1 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:2.0:1777497798.723340:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.723343:0:93025:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 57 to 0@lo 00000100:00000040:2.0:1777497798.723345:0:93025:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.104@tcp -> ffff924089288a00 00010000:00080000:2.0:1777497798.723349:0:93025:0:(ldlm_lib.c:102:import_set_conn()) imp ffff92409fb63000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.104@tcp at head 00010000:00010000:2.0:1777497798.728839:0:93025:0:(ldlm_pool.c:924:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-12 is initialized 00000020:00000040:2.0:1777497798.728966:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 4 - setup 00000020:00000080:2.0:1777497798.728971:0:93025:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1777497798.729030:0:93025:0:(lwp_dev.c:496:lwp_obd_connect()) connect #0 00000020:00000040:2.0:1777497798.729036:0:93025:0:(lustre_handles.c:77:class_handle_hash()) added object ffff9240bcd91800 with handle 0x3e357265691ed29 to hash 00000020:00000040:2.0:1777497798.729043:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd91800 refcount=3 00000020:00000040:2.0:1777497798.729047:0:93025:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 5 - export 00000020:00000040:2.0:1777497798.729050:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd91800 : new refcount 2 00000020:00000080:2.0:1777497798.729053:0:93025:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x3e357265691ed29 00000020:00000040:2.0:1777497798.729056:0:93025:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed29 00000020:00000040:2.0:1777497798.729058:0:93025:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd91800 refcount=3 00000100:00080000:2.0:1777497798.729068:0:93025:0:(import.c:509:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00000040:2.0:1777497798.729074:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 58 to 0@lo 00000020:00000040:2.0:1777497798.729076:0:93025:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed29 00000020:00000040:2.0:1777497798.729077:0:93025:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd91800 refcount=4 00000100:00000040:2.0:1777497798.729080:0:93025:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 59 to 0@lo 00000020:00000040:2.0:1777497798.729081:0:93025:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd91800 : new refcount 3 00000100:00080000:2.0:1777497798.729083:0:93025:0:(import.c:623:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff92409fb63000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:2.0:1777497798.729115:0:93025:0:(genops.c:1231:class_import_get()) import ffff92409fb63000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00100000:2.0:1777497798.729140:0:93025:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.729155:0:93025:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000981d52dc] to pc [ptlrpcd_rcv+-1] req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497798.729180:0:93025:0:(pinger.c:371:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000020:00000040:2.0:1777497798.729183:0:93025:0:(genops.c:1231:class_import_get()) import ffff92409fb63000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1777497798.729692:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.729707:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1863837565086848:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1777497798.729752:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.729761:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.729798:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b0000 x1863837565086848 msgsize 520 00000100:00100000:3.0:1777497798.729803:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497798.729859:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.729871:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000040:3.0:1777497798.729916:0:38121:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (3933) 00000100:00100000:2.0:1777497798.732894:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086848 00000100:00100000:2.0:1777497798.732913:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086848 00000020:00000040:2.0:1777497798.732917:0:73210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x0 00000100:00100000:2.0:1777497798.732966:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00000040:2.0:1777497798.732976:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b0000 x1863837565086848/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1777497818 ref 1 fl New:/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.732986:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3656:x1863837565086848:12345-0@lo:38:llog_process_th.0 00000020:00000040:2.0:1777497798.733012:0:73210:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 10 - find 00010000:00000040:2.0:1777497798.733175:0:73210:0:(ldlm_lib.c:1252:target_handle_connect()) lustre-MDT0001: ocd_connect_flags: 0x2041401043000022 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1777497798.733184:0:73210:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 3928 last 0 00000020:00000040:2.0:1777497798.733194:0:73210:0:(lustre_handles.c:77:class_handle_hash()) added object ffff923f81b73000 with handle 0x3e357265691ed30 to hash 00000020:00000040:2.0:1777497798.733228:0:73210:0:(genops.c:889:class_export_get()) GET export ffff923f81b73000 refcount=3 00000020:00000040:2.0:1777497798.733233:0:73210:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 11 - export 00000020:00000040:2.0:1777497798.733237:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff923f81b73000 : new refcount 2 00000020:00000080:2.0:1777497798.733239:0:73210:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x3e357265691ed30 00000020:00000040:2.0:1777497798.733242:0:73210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed30 00000020:00000040:2.0:1777497798.733244:0:73210:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f81b73000 refcount=3 00000001:00000040:2.0:1777497798.733255:0:73210:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.202.104@tcp 00000001:00000040:2.0:1777497798.733259:0:73210:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 16 00000020:00000040:2.0:1777497798.733263:0:73210:0:(genops.c:889:class_export_get()) GET export ffff923f81b73000 refcount=4 00000001:00000040:2.0:1777497798.733265:0:73210:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 17 00000001:00000040:2.0:1777497798.733268:0:73210:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9240867b8c00) : new refcount 16 00000004:00100000:2.0:1777497798.733273:0:73210:0:(mdt_handler.c:7287:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000040:2.0:1777497798.733283:0:73210:0:(lprocfs_status_server.c:685:lprocfs_exp_setup()) Found stats ffff92409922a2a0 for nid 0@lo - ref 4 00000020:00000040:2.0:1777497798.733290:0:73210:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 12 - import 00000020:00000040:2.0:1777497798.733296:0:73210:0:(genops.c:1244:class_import_put()) import ffff923f81b74000 refcount=1 obd=lustre-MDT0001 00000020:00000040:2.0:1777497798.733303:0:73210:0:(genops.c:889:class_export_get()) GET export ffff923f81b73000 refcount=5 00000100:00000040:2.0:1777497798.733305:0:73210:0:(service.c:1080:ptlrpc_request_change_export()) RPC GETting export ffff923f81b73000 : new rpc_count 1 00000100:00000040:2.0:1777497798.733311:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 60 to 0@lo 00000100:00000040:2.0:1777497798.733313:0:73210:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 60 to 0@lo 00000020:00000040:2.0:1777497798.733316:0:73210:0:(genops.c:889:class_export_get()) GET export ffff923f81b73000 refcount=6 00000100:00000040:2.0:1777497798.733322:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00080000:2.0:1777497798.733330:0:73210:0:(import.c:65:import_set_state_nolock()) ffff923f81b74000 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1777497798.733335:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff923f81b73000 : new refcount 5 00000020:00000040:2.0:1777497798.733337:0:73210:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 12 - find 00010000:00000040:2.0:1777497798.733352:0:73210:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565086848 00000100:00000040:2.0:1777497798.733367:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:2.0:1777497798.733373:0:73210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.733415:0:73210:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1777497808 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.733449:0:73210:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:2.0:1777497798.733454:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b0000 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1777497818 ref 1 fl Interpret:/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.733464:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3656:x1863837565086848:12345-0@lo:38:llog_process_th.0 Request processed in 477us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.733471:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00000040:2.0:1777497798.733473:0:73210:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f81b73000 : new rpc_count 0 00000020:00000040:2.0:1777497798.733484:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff923f81b73000 : new refcount 4 00000100:00100000:3.0:1777497798.733963:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00000040:3.0:1777497798.733968:0:3656:0:(client.c:3211:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00000040:3.0:1777497798.733974:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497798.733996:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 19 00000020:00000040:3.0:1777497798.733999:0:3656:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed29 00000020:00000040:3.0:1777497798.734001:0:3656:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bcd91800 refcount=4 00000100:00080000:3.0:1777497798.734008:0:3656:0:(import.c:958:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000020:00000040:3.0:1777497798.734010:0:3656:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd91800 : new refcount 3 00000100:00080000:3.0:1777497798.734014:0:3656:0:(import.c:1211:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1777497798.734016:0:3656:0:(import.c:65:import_set_state_nolock()) ffff92409fb63000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00000040:3.0:1777497798.734132:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.734141:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3656:1863837565086848:0@lo:38:llog_process_th.0 00000100:00000040:3.0:1777497798.734148:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565086848/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1777497808 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.734159:0:3656:0:(genops.c:1244:class_import_put()) import ffff92409fb63000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000020:00000040:2.0:1777497798.734870:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd91800 refcount=4 00000020:00000040:2.0:1777497798.734885:0:93025:0:(genops.c:889:class_export_get()) GET export ffff9240bcd91800 refcount=5 00000040:00080000:2.0:1777497798.734972:0:93025:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64 count 63 00000020:01000000:2.0:1777497798.735643:0:93014:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-63 (rc=0) 10000000:01000000:2.0:1777497798.735676:0:93014:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-client' succeeded (0). 00000020:00000040:2.0:1777497798.735697:0:93014:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099078c00 refcount=3 00010000:00010000:2.0:1777497798.735705:0:93014:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed06 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.735715:0:93014:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924099078c00/0x3e357265691ecff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed06 expref: -99 pid: 93014 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1777497798.735774:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1777497798.735776:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497798.735777:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497798.735778:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497798.735779:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497798.735781:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497798.735782:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497798.735788:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497798.735789:0:93014:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1777497798.735794:0:93014:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1777497798.735797:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1777497798.735798:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1777497798.735799:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:2.0:1777497798.735800:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:2.0:1777497798.735801:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:2.0:1777497798.735801:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:2.0:1777497798.735802:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1777497798.735803:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1777497798.735804:0:93014:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000020:00000040:2.0:1777497798.735811:0:93014:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 10000000:01000000:2.0:1777497798.735832:0:93014:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00000040:2.0:1777497798.735850:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.735861:0:93014:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565086976:0@lo:253:mount.lustre.0 00000100:00000040:2.0:1777497798.735886:0:93014:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.735894:0:93014:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.735929:0:93014:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2df450 x1863837565086976 msgsize 4848 00000100:00100000:2.0:1777497798.735952:0:93014:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.735953:0:93014:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497798.735969:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.735995:0:93014:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1777497798.736197:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565086976 00000100:00100000:0.0:1777497798.736205:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565086976 00000020:00000040:0.0:1777497798.736207:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497798.736210:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:0.0:1777497798.736229:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497798.736256:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00000040:0.0:1777497798.736260:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497798.736265:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2df450 x1863837565086976/t0(0) o253->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 4848/0 e 0 to 0 dl 1777497809 ref 1 fl New:/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497798.736277:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:93014:x1863837565086976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1777497798.736304:0:90575:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1777497798.736317:0:90575:0:(mgs_nids.c:461:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000020:00000040:0.0:1777497798.736441:0:93029:0:(genops.c:900:class_export_put()) PUTting export ffff9240bcd91800 : new refcount 4 20000000:01000000:1.0:1777497798.745636:0:90575:0:(mgs_nids.c:813:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1777497798.745659:0:90575:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1777497798.745784:0:90578:0:(mgs_nids.c:710:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1777497798.745789:0:90578:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00000040:2.0:1777497798.745802:0:90578:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff92408cba5100 count: 4 00000020:00000040:2.0:1777497798.745814:0:90578:0:(lustre_handles.c:77:class_handle_hash()) added object ffff923f82fd8600 with handle 0x3e357265691ed37 to hash 00010000:00010000:2.0:1777497798.745823:0:90578:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.745863:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de2d expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.745870:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691de49 expref: 23 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.745879:0:90578:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.745886:0:90578:0:(ldlm_resource.c:1716:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.745892:0:90578:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff92408cba5100) refcount = 4 00010000:00000040:2.0:1777497798.745895:0:90578:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:2.0:1777497798.745898:0:90578:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.745904:0:90578:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x3e357265691de49 expref: 23 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.745910:0:90578:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000020 nid: 0@lo remote: 0x3e357265691de2d expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.745915:0:90578:0:(ldlm_resource.c:1860:ldlm_resource_dump()) Waiting locks: 00010000:00000040:2.0:1777497798.745917:0:90578:0:(ldlm_resource.c:1862:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1777497798.745943:0:90578:0:(genops.c:1231:class_import_get()) import ffff9240bb782800 refcount=2 obd=MGS 00010000:00010000:2.0:1777497798.745964:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 8 pid: 90573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.745989:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 8 pid: 90573 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.746006:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746028:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087104:192.168.202.4@tcp:104: 00000100:00000040:2.0:1777497798.746055:0:90578:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746062:0:90578:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000020:00000040:2.0:1777497798.746155:0:90578:0:(genops.c:1231:class_import_get()) import ffff9240a6375000 refcount=2 obd=MGS 00010000:00010000:2.0:1777497798.746166:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de49 expref: 23 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746174:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de49 expref: 23 pid: 90580 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.746185:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746193:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087232:0@lo:104: 00000100:00000040:2.0:1777497798.746205:0:90578:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746212:0:90578:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.746247:0:90578:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fce00 x1863837565087232 msgsize 328 00000100:00100000:2.0:1777497798.746252:0:90578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.746273:0:90578:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1777497798.746288:0:90578:0:(genops.c:1231:class_import_get()) import ffff9240a6375000 refcount=3 obd=MGS 00010000:00010000:2.0:1777497798.746302:0:90578:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3e357265691de2d expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746310:0:90578:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3e357265691de2d expref: 23 pid: 90575 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.746319:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746325:0:90578:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087360:0@lo:104: 00000100:00000040:2.0:1777497798.746336:0:90578:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=0 req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746342:0:90578:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.746354:0:90578:0:(events.c:337:request_in_callback()) incoming req@ffff9240866ff480 x1863837565087360 msgsize 328 00000100:00100000:2.0:1777497798.746358:0:90578:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.746373:0:90578:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746384:0:90578:0:(client.c:2691:ptlrpc_set_wait()) set ffff9240bb94dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1777497798.746408:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087232 00000100:00100000:2.0:1777497798.746416:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087232 00000020:00000040:2.0:1777497798.746418:0:13186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e35726568d106b 00000020:00000040:2.0:1777497798.746422:0:13186:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92408395b800 refcount=3 00000100:00000040:2.0:1777497798.746450:0:13186:0:(service.c:1430:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:2.0:1777497798.746475:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00000040:2.0:1777497798.746478:0:13186:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92408395b800 : new rpc_count 1 00000100:00000040:2.0:1777497798.746483:0:13186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fce00 x1863837565087232/t0(0) o104->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746510:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565087232:12345-0@lo:104: 00000020:00000040:2.0:1777497798.746518:0:13186:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eee800 refcount=2 00010000:00010000:2.0:1777497798.746524:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.746549:0:13186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:2.0:1777497798.746554:0:13186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.746571:0:13186:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746589:0:13186:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00010000:00010000:2.0:1777497798.746600:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00000040:2.0:1777497798.746605:0:13186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fce00 x1863837565087232/t0(0) o104->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746613:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565087232:12345-0@lo:104: Request processed in 120us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.746620:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00000040:2.0:1777497798.746623:0:13186:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92408395b800 : new rpc_count 0 00000020:00000040:2.0:1777497798.746633:0:13186:0:(genops.c:900:class_export_put()) PUTting export ffff92408395b800 : new refcount 2 00000100:00100000:2.0:1777497798.746642:0:13186:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087360 00000100:00100000:2.0:1777497798.746646:0:13186:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087360 00000020:00000040:2.0:1777497798.746647:0:13186:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e35726568d106b 00000020:00000040:2.0:1777497798.746649:0:13186:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92408395b800 refcount=3 00000100:00000040:2.0:1777497798.746656:0:13186:0:(service.c:1430:ptlrpc_at_set_timer()) armed ldlm_cbd at +6s 00000100:00100000:2.0:1777497798.746670:0:13186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00000040:2.0:1777497798.746672:0:13186:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92408395b800 : new rpc_count 1 00000100:00000040:2.0:1777497798.746675:0:13186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866ff480 x1863837565087360/t0(0) o104->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746685:0:13186:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565087360:12345-0@lo:104: 00000020:00000040:2.0:1777497798.746690:0:13186:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eef200 refcount=2 00010000:00010000:2.0:1777497798.746693:0:13186:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1777497798.746700:0:3652:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746713:0:13186:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:2.0:1777497798.746716:0:13186:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.746729:0:13186:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.746751:0:13186:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00010000:00010000:2.0:1777497798.746763:0:13186:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00000040:2.0:1777497798.746767:0:13186:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866ff480 x1863837565087360/t0(0) o104->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.746775:0:13186:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+3:90578:x1863837565087360:12345-0@lo:104: Request processed in 91us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.746780:0:13186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00000040:2.0:1777497798.746783:0:13186:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92408395b800 : new rpc_count 0 00000020:00000040:2.0:1777497798.746788:0:13186:0:(genops.c:900:class_export_put()) PUTting export ffff92408395b800 : new refcount 2 00010000:00010000:2.0:1777497798.746806:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1777497798.746811:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746818:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eee800 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497798.746822:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1777497798.746828:0:6502:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eee800 refcount=3 00010000:00010000:2.0:1777497798.746831:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497798.746838:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497798.746854:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1777497798.746858:0:6502:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=1) 10000000:00000040:2.0:1777497798.746860:0:6502:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1777497798.746870:0:6502:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff92409151b200) refs 2 00000020:00000040:2.0:1777497798.746875:0:6502:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff924085eee800 with handle 0x3e357265691de49 from hash 00000020:00000040:2.0:1777497798.746883:0:6502:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00010000:00010000:2.0:1777497798.746894:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746899:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1777497798.746909:0:6502:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000a8597e46] to pc [ptlrpcd_00_00+0] req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777497798.746928:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746935:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eee800/0x3e357265691de49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de50 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746948:0:6502:0:(ldlm_lockd.c:2794:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1777497798.746951:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.746956:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff924085eef200 already unused, calling callback (ffffffffc139bc20) 10000000:00010000:2.0:1777497798.746959:0:6502:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:2.0:1777497798.746964:0:6502:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924085eef200 refcount=3 00010000:00010000:2.0:1777497798.746967:0:6502:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1777497798.746983:0:6502:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1777497798.746989:0:6502:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:00000040:2.0:1777497798.746992:0:6502:0:(mgc_request.c:723:mgc_requeue_add()) log lustre-mdtir: requeue (r=2 sp=0 st=3) 10000000:00000040:2.0:1777497798.746993:0:6502:0:(mgc_request.c:726:mgc_requeue_add()) lockh 0x0 10000000:00000040:2.0:1777497798.746996:0:6502:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff923f8621c400) refs 2 00000020:00000040:2.0:1777497798.746999:0:6502:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff924085eef200 with handle 0x3e357265691de2d from hash 00000020:00000040:2.0:1777497798.747004:0:6502:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=6 obd=MGC192.168.202.104@tcp 00010000:00010000:2.0:1777497798.747013:0:6502:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.747018:0:6502:0:(ldlm_request.c:1490:ldlm_cancel_pack()) 1 locks packed 00000100:00000040:2.0:1777497798.747024:0:6502:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a3d107d] to pc [ptlrpcd_00_01+1] req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777497798.747032:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497798.747038:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.104@tcp lock: ffff924085eef200/0x3e357265691de2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3e357265691de34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.747044:0:6502:0:(ldlm_resource.c:1670:ldlm_resource_putref()) putref res: ffff92409c15eb00 count: 0 00010000:00010000:2.0:1777497798.747053:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497798.747055:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497798.747056:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1777497798.747081:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747091:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565087616:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1777497798.747134:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.747141:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.747157:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fdc00 x1863837565087616 msgsize 328 00000100:00100000:2.0:1777497798.747161:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.747175:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747195:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00000040:2.0:1777497798.747199:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747207:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565087488:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1777497798.747217:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.747223:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.747233:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240866ffb80 x1863837565087488 msgsize 328 00000100:00100000:2.0:1777497798.747237:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497798.747248:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747272:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087616 00000100:00100000:2.0:1777497798.747276:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087616 00000020:00000040:2.0:1777497798.747278:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.747280:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=24 00000100:00000040:2.0:1777497798.747291:0:6500:0:(service.c:1430:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:2.0:1777497798.747297:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff92408150bc00 refcount=5 00010000:00010000:2.0:1777497798.747302:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de2d expref: 24 pid: 90575 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497798.747321:0:6500:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087488 00000100:00100000:2.0:1777497798.747323:0:6500:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087488 00000020:00000040:2.0:1777497798.747330:0:6500:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497798.747332:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=25 00000020:00000040:2.0:1777497798.747343:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff92408150a400 refcount=5 00010000:00010000:2.0:1777497798.747347:0:6500:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de49 expref: 25 pid: 90580 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1777497798.747366:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2598 00000100:00000040:2.0:1777497798.747369:0:6500:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 2 00000100:00000040:2.0:1777497798.747372:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fdc00 x1863837565087616/t0(0) o103->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747383:0:6500:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837565087616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1777497798.747393:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497798.747393:0:6500:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:2.0:1777497798.747395:0:6500:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff92408150bc00 refcount=5 00010000:00000040:2.0:1777497798.747398:0:6500:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff92408cba5100 count: 5 00010000:00010000:2.0:1777497798.747402:0:6500:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de2d expref: 25 pid: 90575 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497798.747405:0:10268:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2599 00000100:00000040:3.0:1777497798.747407:0:10268:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 3 00000100:00000040:3.0:1777497798.747411:0:10268:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866ffb80 x1863837565087488/t0(0) o103->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1777497798.747411:0:6500:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de2d expref: 25 pid: 90575 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1777497798.747422:0:10268:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837565087488:12345-0@lo:103:ldlm_bl.0 00000020:00000040:2.0:1777497798.747424:0:6500:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff92408150bc00 with handle 0x3e357265691de34 from hash 00010000:00000040:2.0:1777497798.747428:0:6500:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff923f82fd8600 00010000:00010000:3.0:1777497798.747429:0:10268:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:3.0:1777497798.747431:0:10268:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff92408150a400 refcount=5 00010000:00010000:2.0:1777497798.747432:0:6500:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:2.0:1777497798.747437:0:6500:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:2.0:1777497798.747440:0:6500:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497798.747455:0:6500:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.747472:0:6500:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:2.0:1777497798.747475:0:6500:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fdc00 x1863837565087616/t0(0) o103->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747493:0:6500:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+25:3658:x1863837565087616:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497798.747499:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2598 00000100:00000040:2.0:1777497798.747502:0:6500:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 2 00000020:00000040:2.0:1777497798.747509:0:6500:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 24 00010000:00000040:3.0:1777497798.747519:0:10268:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff92408cba5100 count: 5 00010000:00010000:3.0:1777497798.747524:0:10268:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3e357265691de49 expref: 24 pid: 90580 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497798.747537:0:10268:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3e357265691de49 expref: 24 pid: 90580 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.747537:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.747545:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.747552:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565087616:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1777497798.747558:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fea00 x1863837565087616/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497798.747567:0:3658:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:2.0:1777497798.747595:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.747604:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.747611:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087232:0@lo:104: 00000100:00000040:2.0:1777497798.747619:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:2.0:1777497798.747627:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150bc00/0x3e357265691de34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de2d expref: 24 pid: 90575 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497798.747634:0:90578:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9240a6374800 : new locks_count 17 00000020:00000040:2.0:1777497798.747636:0:90578:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 23 00000020:00000040:3.0:1777497798.747639:0:10268:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff92408150a400 with handle 0x3e357265691de50 from hash 00010000:00010000:3.0:1777497798.747643:0:10268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff92408150a400/0x3e357265691de50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3e357265691de49 expref: 23 pid: 90580 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.747647:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00000040:3.0:1777497798.747648:0:10268:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9240a6374800 : new locks_count 16 00000020:00000040:3.0:1777497798.747650:0:10268:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00100000:2.0:1777497798.747654:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fd880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087360:0@lo:104: 00010000:00000040:3.0:1777497798.747655:0:10268:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff923f82fd8600 00010000:00010000:3.0:1777497798.747658:0:10268:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00000040:3.0:1777497798.747662:0:10268:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:3.0:1777497798.747665:0:10268:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497798.747681:0:10268:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.747713:0:10268:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:3.0:1777497798.747717:0:10268:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866ffb80 x1863837565087488/t0(0) o103->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 328/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.747724:0:10268:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:3658:x1863837565087488:12345-0@lo:103:ldlm_bl.0 Request processed in 304us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497798.747729:0:10268:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2599 00000100:00000040:3.0:1777497798.747731:0:10268:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 1 00000020:00000040:3.0:1777497798.747746:0:10268:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00010000:00000040:1.0:1777497798.747793:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565086976 00000100:00000040:1.0:1777497798.747802:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497798.747806:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497798.747829:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=4768 offset=224 replen=4768 req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497798.747864:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:1.0:1777497798.747870:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2df450 x1863837565086976/t0(0) o253->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:554/0 lens 4848/4768 e 0 to 0 dl 1777497809 ref 1 fl Interpret:/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.747877:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:93014:x1863837565086976:12345-0@lo:253:mount.lustre.0 Request processed in 11602us (11947us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497798.747884:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00000040:1.0:1777497798.747886:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497798.747894:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 20 00000100:00000040:3.0:1777497798.748019:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.748029:0:93014:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497798.748047:0:93014:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c253b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:93014:1863837565086976:0@lo:253:mount.lustre.0 00000100:00000040:3.0:1777497798.748054:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1777497798.749521:0:93014:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1777497798.749530:0:93014:0:(tgt_mount.c:1146:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1777497798.749532:0:93014:0:(tgt_mount.c:1147:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1777497798.749533:0:93014:0:(tgt_mount.c:1148:server_mti_print()) fs: lustre 00000020:01000004:3.0:1777497798.749534:0:93014:0:(tgt_mount.c:1149:server_mti_print()) uuid: 00000020:01000004:3.0:1777497798.749535:0:93014:0:(tgt_mount.c:1150:server_mti_print()) ver: 0 00000020:01000004:3.0:1777497798.749536:0:93014:0:(tgt_mount.c:1151:server_mti_print()) flags: 00000020:01000004:3.0:1777497798.749548:0:93014:0:(tgt_mount.c:1155:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1777497798.749551:0:93014:0:(tgt_mount.c:1185:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1777497798.749552:0:93014:0:(tgt_mount.c:1191:server_mti_print()) LDD_F_OPC_READY 00000100:00000040:3.0:1777497798.749560:0:93014:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c253b80 x1863837565086976/t0(0) o253->MGC192.168.202.104@tcp@0@lo:26/25 lens 4848/4768 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'mount.lustre.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497798.749579:0:93014:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:02000000:3.0:1777497798.749596:0:93014:0:(tgt_mount.c:2644:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00002000:00000040:3.0:1777497798.749764:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x3:0x0] 00002000:00000040:3.0:1777497798.749780:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0xf:0x0] 00002000:00000040:3.0:1777497798.749833:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x4:0x0] 00002000:00000040:3.0:1777497798.749869:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x1:0x0] 00002000:00000040:3.0:1777497798.749902:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x10:0x0] 00002000:00000040:3.0:1777497798.749934:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x5:0x0] 00002000:00000040:3.0:1777497798.749956:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x2:0x0] 00002000:00000040:3.0:1777497798.749986:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x16:0x0] 00002000:00000040:3.0:1777497798.750015:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000003:0x6:0x0] 00002000:00000040:3.0:1777497798.750038:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000005:0x3:0x0] 00000100:00000040:2.0:1777497798.750160:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497798.750170:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497798.750177:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3658:1863837565087488:0@lo:103:ldlm_bl.0 00000100:00000040:2.0:1777497798.750185:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fc700 x1863837565087488/t0(0) o103->MGC192.168.202.104@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497798.750187:0:3651:0:(events.c:149:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224 req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1777497798.750194:0:3658:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000100:00000040:2.0:1777497798.750219:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:2.0:1777497798.750230:0:90578:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1777497798.750236:0:90578:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fe300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:90578:1863837565087104:192.168.202.4@tcp:104: 00000100:00000040:2.0:1777497798.750245:0:90578:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fca80 x1863837565087232/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1777497798.750252:0:90578:0:(genops.c:1244:class_import_put()) import ffff9240a6375000 refcount=2 obd=MGS 00000100:00000040:2.0:1777497798.750257:0:90578:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fd880 x1863837565087360/t0(0) o104->MGS@0@lo:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1777497798.750262:0:90578:0:(genops.c:1244:class_import_put()) import ffff9240a6375000 refcount=1 obd=MGS 00000100:00000040:2.0:1777497798.750267:0:90578:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fe300 x1863837565087104/t0(0) o104->MGS@192.168.202.4@tcp:15/16 lens 328/224 e 0 to 0 dl 1777497814 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000040:2.0:1777497798.750273:0:90578:0:(genops.c:1244:class_import_put()) import ffff9240bb782800 refcount=1 obd=MGS 00010000:00010000:2.0:1777497798.750285:0:90578:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497798.752701:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240992d7450 x1863837546425088 msgsize 328 00000100:00100000:2.0:1777497798.752716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497798.752718:0:3650:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00002000:00000040:3.0:1777497798.753519:0:93014:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x200000001:0x12:0x0] 00010000:00080000:3.0:1777497798.753674:0:93014:0:(ldlm_lib.c:3036:target_recovery_init()) RECOVERY: service lustre-OST0000, 3 recoverable clients, last_transno 4294969480 00000100:00100000:1.0:1777497798.753866:0:6501:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425088 00000100:00100000:1.0:1777497798.753880:0:6501:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425088 00000020:00000040:1.0:1777497798.753884:0:6501:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:1.0:1777497798.753888:0:6501:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:1.0:1777497798.753913:0:6501:0:(service.c:1430:ptlrpc_at_set_timer()) armed ldlm_canceld at +6s 00000020:00000040:1.0:1777497798.753924:0:6501:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9240baa5a800 refcount=4 00010000:00010000:1.0:1777497798.753935:0:6501:0:(ldlm_lockd.c:2676:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1777497798.753970:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2600 00000100:00000040:1.0:1777497798.753974:0:6501:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:1.0:1777497798.753983:0:6501:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240992d7450 x1863837546425088/t0(0) o103->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:554/0 lens 328/0 e 0 to 0 dl 1777497809 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.753995:0:6501:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240992d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546425088:12345-192.168.202.4@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1777497798.754011:0:6501:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000040:1.0:1777497798.754014:0:6501:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff9240baa5a800 refcount=4 00010000:00000040:1.0:1777497798.754017:0:6501:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff92408cba5100 count: 3 00010000:00010000:1.0:1777497798.754021:0:6501:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754634:0:6501:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1777497798.754647:0:6501:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff9240baa5a800 with handle 0x3e357265691def1 from hash 00010000:00010000:1.0:1777497798.754651:0:6501:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9240baa5a800/0x3e357265691def1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c46a expref: 9 pid: 90573 timeout: 4028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1777497798.754655:0:6501:0:(ldlm_lock.c:204:ldlm_lock_put()) lock PUTting export ffff9240bb786000 : new locks_count 3 00000020:00000040:1.0:1777497798.754657:0:6501:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00010000:00000040:1.0:1777497798.754663:0:6501:0:(ldlm_lock.c:1987:ldlm_reprocess_queue()) Reprocessing lock ffff923f82fd8600 00010000:00010000:1.0:1777497798.754668:0:6501:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1777497798.754674:0:6501:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff92408cba5100) refcount = 2 00010000:00010000:1.0:1777497798.754677:0:6501:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1777497798.754691:0:6501:0:(mgs_nids.c:686:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.026738010s 00000020:00000040:1.0:1777497798.754694:0:6501:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff923f82fd8600 refcount=5 00010000:00010000:1.0:1777497798.754697:0:6501:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754704:0:6501:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754711:0:6501:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754717:0:6501:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754733:0:6501:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff923f82fd8600 already unused, calling callback (ffffffffc0d802e0) 00010000:00010000:1.0:1777497798.754748:0:6501:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1777497798.754755:0:6501:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff923f82fd8600 refcount=6 00010000:00010000:1.0:1777497798.754759:0:6501:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000040:1.0:1777497798.754777:0:6501:0:(lustre_handles.c:91:class_handle_unhash_nolock()) removing object ffff923f82fd8600 with handle 0x3e357265691ed37 from hash 00010000:00010000:1.0:1777497798.754783:0:6501:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497798.754795:0:6501:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1777497798.754799:0:90578:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1777497798.754805:0:6501:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00010000:00010000:3.0:1777497798.754807:0:90578:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1777497798.754811:0:6501:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00010000:00010000:3.0:1777497798.754813:0:90578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff923f82fd8600/0x3e357265691ed37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:1.0:1777497798.754860:0:6501:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497798.754866:0:6501:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240992d7450 x1863837546425088/t0(0) o103->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:554/0 lens 328/224 e 0 to 0 dl 1777497809 ref 1 fl Interpret:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497798.754875:0:6501:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240992d7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:34a4158d-137e-4629-9769-4a4bd53f7f61+8:2415:x1863837546425088:12345-192.168.202.4@tcp:103:ldlm_bl.0 Request processed in 882us (2175us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497798.754882:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2600 00000100:00000040:1.0:1777497798.754886:0:6501:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:1.0:1777497798.754896:0:6501:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 7 00010000:00000040:3.0:1777497798.754918:0:90578:0:(ldlm_resource.c:1670:ldlm_resource_putref()) putref res: ffff92408cba5100 count: 0 00010000:00080000:1.0:1777497798.761479:0:93031:0:(ldlm_lib.c:2839:target_recovery_thread()) lustre-OST0000: started recovery thread pid 93031 00010000:02000000:1.0:1777497798.761642:0:93031:0:(ldlm_lib.c:2321:target_recovery_overseer()) lustre-OST0000: in recovery but waiting for the first client to connect 00010000:00080000:1.0:1777497798.761648:0:93031:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00080000:1.0:1777497798.761652:0:93031:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 0 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:01000004:0.0:1777497798.761751:0:93014:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:00000040:0.0:1777497798.761759:0:93014:0:(lustre_log.h:386:llog_ctxt_get()) GETting ctxt ffff923f83ed3e40 : new refcount 2 00000040:00000040:0.0:1777497798.761764:0:93014:0:(lustre_log.h:401:llog_ctxt_put()) PUTting ctxt ffff923f83ed3e40 : new refcount 1 00000020:00000040:0.0:1777497798.761798:0:93014:0:(genops.c:900:class_export_put()) PUTting export ffff923f81240000 : new refcount 1 00000020:00000040:0.0:1777497798.761810:0:93014:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.104@tcp (ffff9240911f99c0) now 6 - mgc_fs 10000000:01000000:0.0:1777497798.761814:0:93014:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.104@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1777497798.761896:0:93014:0:(tgt_mount.c:2413:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1777497798.761926:0:93014:0:(super25.c:187:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1777497798.793861:0:93014:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1777497798.794903:0:93014:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1777497798.820685:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1777497799.715660:0:90586:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:3.0:1777497799.715704:0:90586:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000069017c41] to pc [ptlrpcd_00_02+2] req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497799.715750:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00000040:3.0:1777497799.715764:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497799.715777:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b50b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565087744:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1777497799.715804:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497799.715813:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497799.715864:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff92409c253b80 x1863837565087744 msgsize 224 00000100:00100000:3.0:1777497799.715869:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497799.715890:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497799.715902:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 4097 usecs (5 jiffies) 00000100:00100000:3.0:1777497799.715928:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087744 00000100:00100000:3.0:1777497799.715948:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087744 00000020:00000040:3.0:1777497799.715951:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:3.0:1777497799.715955:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00000040:3.0:1777497799.715975:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:3.0:1777497799.716007:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4115 00000100:00000040:3.0:1777497799.716011:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:3.0:1777497799.716016:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c253b80 x1863837565087744/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1777497810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497799.716027:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565087744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497799.716061:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00010000:00000040:3.0:1777497799.716071:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565087744 00000100:00000040:3.0:1777497799.716081:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:3.0:1777497799.716085:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497799.716128:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497799.716144:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:3.0:1777497799.716148:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c253b80 x1863837565087744/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:555/0 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497799.716155:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565087744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497799.716161:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4115 00000100:00000040:3.0:1777497799.716164:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:3.0:1777497799.716172:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00000040:3.0:1777497799.716206:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1777497799.716211:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1777497799.716222:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352888 avail=317185 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023683 state=0: rc = 0 00000100:00000040:3.0:1777497799.716238:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497799.716245:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b50b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565087744:0@lo:41:osp-pre-1-0.0 00000100:00000040:3.0:1777497799.716250:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b50b1880 x1863837565087744/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497799.716261:0:3660:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:1.0:1777497799.722191:0:72706:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:1.0:1777497799.722232:0:72706:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005d21f1a1] to pc [ptlrpcd_00_03+3] req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497799.722320:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497799.722334:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565087872:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1777497799.722366:0:3660:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497799.722374:0:3660:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497799.722412:0:3660:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fe300 x1863837565087872 msgsize 224 00000100:00100000:2.0:1777497799.722416:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497799.722448:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497799.722461:0:3660:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1841217 usecs (1842 jiffies) 00000100:00100000:1.0:1777497799.722522:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565087872 00000100:00100000:1.0:1777497799.722531:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565087872 00000020:00000040:1.0:1777497799.722533:0:80394:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:1.0:1777497799.722537:0:80394:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:1.0:1777497799.722561:0:80394:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:1.0:1777497799.722596:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4116 00000100:00000040:1.0:1777497799.722600:0:80394:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:1.0:1777497799.722605:0:80394:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fe300 x1863837565087872/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/0 e 0 to 0 dl 1777497810 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497799.722616:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565087872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1777497799.722652:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00010000:00000040:1.0:1777497799.722665:0:80394:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565087872 00000100:00000040:1.0:1777497799.722675:0:80394:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497799.722680:0:80394:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497799.722700:0:80394:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497799.722719:0:80394:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:1.0:1777497799.722724:0:80394:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fe300 x1863837565087872/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:555/0 lens 224/368 e 0 to 0 dl 1777497810 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497799.722741:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3660:x1863837565087872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 127us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497799.722747:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4116 00000100:00000040:1.0:1777497799.722751:0:80394:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:1.0:1777497799.722760:0:80394:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00000040:1.0:1777497799.722803:0:3660:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:1.0:1777497799.722809:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:1.0:1777497799.722832:0:3660:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352833 avail=317130 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:1.0:1777497799.722840:0:3660:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497799.722847:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565087872:0@lo:41:osp-pre-0-1.0 00000100:00000040:1.0:1777497799.722853:0:3660:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d81180 x1863837565087872/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497799.722862:0:3660:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00010000:00010000:3.0:1777497799.844984:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777497799.870684:0:93081:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497799.871166:0:93081:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00000040:3.0:1777497800.023082:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2dc050 x1863837546425216 msgsize 328 00000100:00100000:3.0:1777497800.023124:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:3.0:1777497800.023126:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:2.0:1777497800.023209:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425216 00000100:00100000:2.0:1777497800.023219:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425216 00000020:00000040:2.0:1777497800.023222:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:2.0:1777497800.023227:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=8 00000100:00000040:2.0:1777497800.023253:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497800.023281:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00000040:2.0:1777497800.023284:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:2.0:1777497800.023292:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2dc050 x1863837546425216/t0(0) o101->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 328/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.023305:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+8:70262:x1863837546425216:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1777497800.023322:0:90580:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000020:00000040:2.0:1777497800.023341:0:90580:0:(lustre_handles.c:77:class_handle_hash()) added object ffff923f82fd8a00 with handle 0x3e357265691ed3e to hash 00010000:00010000:2.0:1777497800.023354:0:90580:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff923f82fd8a00/0x3e357265691ed3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96df4dfe1628c7ce expref: -99 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:2.0:1777497800.023363:0:90580:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240bb786000 : new locks_count 4 00000020:00000040:2.0:1777497800.023365:0:90580:0:(genops.c:889:class_export_get()) GET export ffff9240bb786000 refcount=9 00010000:00000040:2.0:1777497800.023385:0:90580:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff923f85215b00) refcount = 1 00010000:00010000:2.0:1777497800.023391:0:90580:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff923f82fd8a00/0x3e357265691ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ce expref: 9 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497800.023402:0:90580:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff923f82fd8a00/0x3e357265691ed3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ce expref: 9 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497800.023411:0:90580:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff923f82fd8a00, rc 0) 00010000:00000040:2.0:1777497800.023414:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546425216 00000100:00000040:2.0:1777497800.023424:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.023430:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.023478:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.023484:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2dc050 x1863837546425216/t0(0) o101->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 328/344 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.023493:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546425216:12345-192.168.202.4@tcp:101:ll_cfg_requeue.0 Request processed in 190us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497800.023499:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 208 00000100:00000040:2.0:1777497800.023502:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:2.0:1777497800.023512:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00000040:3.0:1777497800.029515:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2ddc50 x1863837546425344 msgsize 304 00000100:00100000:3.0:1777497800.029540:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:3.0:1777497800.029542:0:3652:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:0.0:1777497800.030228:0:90573:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425344 00000100:00100000:0.0:1777497800.030242:0:90573:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425344 00000020:00000040:0.0:1777497800.030245:0:90573:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:0.0:1777497800.030249:0:90573:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:0.0:1777497800.030278:0:90573:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497800.030319:0:90573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00000040:0.0:1777497800.030323:0:90573:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:0.0:1777497800.030330:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2ddc50 x1863837546425344/t0(0) o256->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 304/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.030356:0:90573:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546425344:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 20000000:01000000:0.0:1777497800.030382:0:90573:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 16384. 20000000:00000040:0.0:1777497800.030394:0:90573:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:0.0:1777497800.030401:0:90573:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1777497800.030404:0:90573:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:0.0:1777497800.030412:0:90573:0:(genops.c:889:class_export_get()) GET export ffff9240bb786000 refcount=10 00000020:00000040:0.0:1777497800.036268:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 9 00010000:00000040:0.0:1777497800.036293:0:90573:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546425344 00000100:00000040:0.0:1777497800.036308:0:90573:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.036316:0:90573:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.036363:0:90573:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 8 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.036372:0:90573:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2ddc50 x1863837546425344/t0(0) o256->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 304/240 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.036394:0:90573:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:34a4158d-137e-4629-9769-4a4bd53f7f61+9:70262:x1863837546425344:12345-192.168.202.4@tcp:256:ll_cfg_requeue.0 Request processed in 6039us (6879us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497800.036404:0:90573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 209 00000100:00000040:0.0:1777497800.036408:0:90573:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:0.0:1777497800.036422:0:90573:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00000040:3.0:1777497800.044054:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409c8cc450 x1863837546425472 msgsize 520 00000100:00100000:3.0:1777497800.044072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:3.0:1777497800.044074:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00100000:1.0:1777497800.044209:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425472 00000100:00100000:1.0:1777497800.044219:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425472 00000020:00000040:1.0:1777497800.044222:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e10c 00000100:00100000:1.0:1777497800.044265:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5983 00000100:00000040:1.0:1777497800.044274:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c8cc450 x1863837546425472/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.044284:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2411:x1863837546425472:12345-192.168.202.4@tcp:8:ll_cfg_requeue.0 00000020:00000040:1.0:1777497800.044304:0:23437:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 7 - find 00010000:00000040:1.0:1777497800.044317:0:23437:0:(ldlm_lib.c:1252:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa0465af2e3640038 tmp_exp_old_falloc: 0 00010000:00080000:1.0:1777497800.044323:0:23437:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'd146155b-4321-4b14-9284-f644ed9631fb' at ffff9240865c6800, cookie 0x3e357265691ecea 00010000:00080000:1.0:1777497800.044327:0:23437:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp recovering/t4294969460 exp ffff9240865c6800 cur 3929 last 1777497798 00010000:02000400:1.0:1777497800.044335:0:23437:0:(ldlm_lib.c:2022:target_start_recovery_timer()) lustre-OST0000: Will be in recovery for at least 1:00, or until 3 clients reconnect 00010000:00080000:1.0:1777497800.044341:0:23437:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 70 seconds 00000001:00000040:1.0:1777497800.044357:0:23437:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 17 00000020:00000040:1.0:1777497800.044362:0:23437:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=4 00000001:00000040:1.0:1777497800.044364:0:23437:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 18 00000001:00000040:1.0:1777497800.044367:0:23437:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9240867b8c00) : new refcount 17 00002000:00100000:1.0:1777497800.044370:0:23437:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff9240865c6800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1777497800.044389:0:23437:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000040:1.0:1777497800.044400:0:23437:0:(lprocfs_status_server.c:685:lprocfs_exp_setup()) Found stats ffff924099014e40 for nid 192.168.202.4@tcp - ref 2 00000020:00000040:1.0:1777497800.044492:0:23437:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 8 - import 00000020:00000040:1.0:1777497800.044499:0:23437:0:(genops.c:1244:class_import_put()) import ffff923f839d0000 refcount=1 obd=lustre-OST0000 00000020:00000040:1.0:1777497800.044506:0:23437:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=5 00000100:00000040:1.0:1777497800.044509:0:23437:0:(service.c:1080:ptlrpc_request_change_export()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.044519:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.044522:0:23437:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff9240a6a10500 refcount 9 to 192.168.202.4@tcp 00000020:00000040:1.0:1777497800.044525:0:23437:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=6 00000100:00000040:1.0:1777497800.044545:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00080000:1.0:1777497800.044556:0:23437:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 : changing import state from RECOVER to FULL 00000020:00000040:1.0:1777497800.044562:0:23437:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 5 00000020:00000040:1.0:1777497800.044565:0:23437:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 8 - find 00010000:00000040:1.0:1777497800.044578:0:23437:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 0, xid 1863837546425472 00000100:00000040:1.0:1777497800.044587:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.044593:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.044634:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.044639:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c8cc450 x1863837546425472/t0(0) o8->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:0/0 lens 520/416 e 0 to 0 dl 1777497820 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.044647:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c8cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546425472:12345-192.168.202.4@tcp:8:ll_cfg_requeue.0 Request processed in 363us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497800.044653:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5983 00000100:00000040:1.0:1777497800.044656:0:23437:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.044674:0:23437:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 4 00000100:00000040:0.0:1777497800.056576:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28380 x1863837546396032 msgsize 440 00000100:00100000:0.0:1777497800.056590:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.056742:0:8402:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546396032 00000100:00100000:1.0:1777497800.056752:0:8402:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546396032 00000020:00000040:1.0:1777497800.056755:0:8402:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.056759:0:8402:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=5 00000100:00000040:1.0:1777497800.056784:0:8402:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.056842:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1048 00000100:00000040:1.0:1777497800.056846:0:8402:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.056854:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28380 x1863837546396032/t0(4294969481) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.056867:0:8402:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546396032:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:1.0:1777497800.056882:0:8402:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf28380 x1863837546396032/t0(4294969481) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.056892:0:8402:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969481, current: 4294969481, replaying 00010000:00000040:1.0:1777497800.056895:0:8402:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.056914:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28380 x1863837546396032/t0(4294969481) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.056923:0:8402:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546396032:12345-192.168.202.4@tcp:10:dd.0 Request processed in 58us (348us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.056929:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1048 00000100:00000040:1.0:1777497800.056933:0:8402:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.057055:0:93031:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 1 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000020:00000040:0.0:1777497800.226460:0:90590:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1777497800.226511:0:90590:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000d6a1e767] to pc [ptlrpcd_00_00+0] req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.226598:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.226613:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565088000:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1777497800.226641:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.226656:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.226704:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fd880 x1863837565088000 msgsize 224 00000100:00100000:2.0:1777497800.226709:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.226743:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.226755:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5802 usecs (6 jiffies) 00000100:00100000:0.0:1777497800.226990:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088000 00000100:00100000:0.0:1777497800.226999:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088000 00000020:00000040:0.0:1777497800.227008:0:8399:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:0.0:1777497800.227012:0:8399:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000020:00000040:0.0:1777497800.227024:0:8399:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:0.0:1777497800.227052:0:8399:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1777497800.227077:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2214 00000100:00000040:0.0:1777497800.227081:0:8399:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:0.0:1777497800.227114:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fd880 x1863837565088000/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.227128:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565088000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497800.227160:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1777497800.227169:0:8399:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565088000 00000100:00000040:0.0:1777497800.227179:0:8399:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:0.0:1777497800.227183:0:8399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497800.227205:0:8399:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497800.227223:0:8399:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:0.0:1777497800.227227:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fd880 x1863837565088000/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/368 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.227235:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565088000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497800.227241:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2214 00000100:00000040:0.0:1777497800.227243:0:8399:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:0.0:1777497800.227253:0:8399:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00080000:2.0:1777497800.227314:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497800.227319:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:2.0:1777497800.227353:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:2.0:1777497800.227359:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497800.227369:0:3657:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1777497800.227372:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1777497800.227379:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.227387:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409bf2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565088000:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1777497800.227392:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409bf2bb80 x1863837565088000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497816 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.227401:0:3657:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1777497800.520417:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2df850 x1863837546425600 msgsize 224 00000100:00100000:0.0:1777497800.520433:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497800.520436:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497800.521285:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29f80 x1863837546425856 msgsize 224 00000100:00100000:0.0:1777497800.521295:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497800.521340:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28e00 x1863837546425728 msgsize 224 00000100:00100000:0.0:1777497800.521344:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497800.521376:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29c00 x1863837546425984 msgsize 224 00000100:00100000:0.0:1777497800.521381:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.521418:0:25488:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425984 00000100:00100000:0.0:1777497800.521427:0:25488:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425984 00000020:00000040:0.0:1777497800.521430:0:25488:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e113 00000020:00000040:0.0:1777497800.521434:0:25488:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e23000 refcount=7 00000020:00000040:0.0:1777497800.521450:0:25488:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:0.0:1777497800.521487:0:25488:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:0.0:1777497800.521516:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2722 00000100:00000040:0.0:1777497800.521520:0:25488:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e23000 : new rpc_count 1 00000100:00000040:0.0:1777497800.521528:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29c00 x1863837546425984/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.521541:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546425984:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:0.0:1777497800.521563:0:25488:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546425984 00000100:00000040:0.0:1777497800.521573:0:25488:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.521579:0:25488:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.521620:0:25488:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.521626:0:25488:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29c00 x1863837546425984/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/224 e 0 to 0 dl 1777497811 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.521636:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546425984:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497800.521643:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2722 00000100:00000040:0.0:1777497800.521646:0:25488:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e23000 : new rpc_count 0 00000020:00000040:0.0:1777497800.521656:0:25488:0:(genops.c:900:class_export_put()) PUTting export ffff924086e23000 : new refcount 6 00000100:00100000:1.0:1777497800.521798:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425856 00000100:00100000:1.0:1777497800.521804:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425856 00000020:00000040:1.0:1777497800.521805:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691d36e 00000020:00000040:1.0:1777497800.521808:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f818b2800 refcount=11 00000020:00000040:1.0:1777497800.521818:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00000040:1.0:1777497800.521828:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:1.0:1777497800.521855:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425728 00000100:00100000:1.0:1777497800.521865:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425728 00000020:00000040:1.0:1777497800.521866:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd77 00000020:00000040:1.0:1777497800.521869:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af7800 refcount=51 00000020:00000040:1.0:1777497800.521876:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00100000:1.0:1777497800.521900:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1474 00000100:00000040:1.0:1777497800.521902:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f818b2800 : new rpc_count 1 00000100:00000040:1.0:1777497800.521906:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29f80 x1863837546425856/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.521918:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546425856:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:1.0:1777497800.521930:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1863837546425856 00000100:00000040:1.0:1777497800.521935:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.521938:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.521959:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.521964:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29f80 x1863837546425856/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/224 e 0 to 0 dl 1777497811 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.521972:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546425856:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 57us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497800.521978:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1474 00000100:00000040:1.0:1777497800.521980:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f818b2800 : new rpc_count 0 00000020:00000040:1.0:1777497800.521987:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f818b2800 : new refcount 10 00000100:00100000:1.0:1777497800.521999:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1475 00000100:00000040:1.0:1777497800.522002:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af7800 : new rpc_count 1 00000100:00000040:1.0:1777497800.522006:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28e00 x1863837546425728/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.522016:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2415:x1863837546425728:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:1.0:1777497800.522027:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1863837546425728 00000100:00000040:1.0:1777497800.522038:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.522042:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.522056:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.522063:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28e00 x1863837546425728/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 224/224 e 0 to 0 dl 1777497811 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.522071:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2415:x1863837546425728:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 57us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497800.522077:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1475 00000100:00000040:1.0:1777497800.522080:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af7800 : new rpc_count 0 00000020:00000040:1.0:1777497800.522086:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af7800 : new refcount 50 00000100:00100000:2.0:1777497800.522989:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546425600 00000100:00100000:2.0:1777497800.522999:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546425600 00000020:00000040:2.0:1777497800.523001:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:2.0:1777497800.523005:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:2.0:1777497800.523024:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497800.523116:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00000040:2.0:1777497800.523120:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:2.0:1777497800.523125:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2df850 x1863837546425600/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.523148:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546425600:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:2.0:1777497800.523161:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546425600 00000100:00000040:2.0:1777497800.523168:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.523172:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.523205:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.523210:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2df850 x1863837546425600/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:556/0 lens 224/224 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.523217:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546425600:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 73us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497800.523223:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 210 00000100:00000040:2.0:1777497800.523226:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:2.0:1777497800.523234:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00080000:2.0:1777497800.526856:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1777497800.526866:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00080000:2.0:1777497800.526870:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1777497800.526873:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00080000:2.0:1777497800.526876:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497800.526879:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 10000000:00000040:2.0:1777497800.547155:0:6511:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff923f8621c400) refs 2 10000000:01000000:2.0:1777497800.547167:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1777497800.547170:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff92409c468800 from 125 10000000:01000000:2.0:1777497800.547174:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:2.0:1777497800.547183:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:2.0:1777497800.547221:0:6511:0:(lustre_handles.c:77:class_handle_hash()) added object ffff923f82fd9000 with handle 0x3e357265691ed45 to hash 00010000:00010000:2.0:1777497800.547229:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497800.547249:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497800.547260:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497800.547284:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.547296:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088128:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.547324:0:6511:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.547331:0:6511:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.547372:0:6511:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2dc850 x1863837565088128 msgsize 328 00000100:00100000:2.0:1777497800.547377:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.547379:0:6511:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497800.547403:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.547428:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83ed3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1777497800.547611:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088128 00000100:00100000:3.0:1777497800.547618:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088128 00000020:00000040:3.0:1777497800.547621:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:3.0:1777497800.547624:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=21 00000100:00000040:3.0:1777497800.547645:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497800.547679:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1777497800.547684:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:3.0:1777497800.547689:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2dc850 x1863837565088128/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 328/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.547701:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+21:6511:x1863837565088128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1777497800.547715:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:3.0:1777497800.547740:0:90575:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff923f85215b00 count: 2 00000020:00000040:3.0:1777497800.547746:0:90575:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924099078800 with handle 0x3e357265691ed4c to hash 00010000:00010000:3.0:1777497800.547750:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924099078800/0x3e357265691ed4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ed45 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:3.0:1777497800.547757:0:90575:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240a6374800 : new locks_count 17 00000020:00000040:3.0:1777497800.547759:0:90575:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=22 00010000:00000040:3.0:1777497800.547777:0:90575:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff923f85215b00) refcount = 2 00010000:00000040:3.0:1777497800.547781:0:90575:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1777497800.547787:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f82fd8a00/0x3e357265691ed3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ce expref: 8 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.547794:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924099078800/0x3e357265691ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ed45 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.547805:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924099078800/0x3e357265691ed4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ed45 expref: 22 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.547814:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924099078800, rc 0) 00010000:00000040:3.0:1777497800.547817:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565088128 00000100:00000040:3.0:1777497800.547826:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:3.0:1777497800.547831:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497800.547849:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.547865:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:3.0:1777497800.547870:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2dc850 x1863837565088128/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 328/344 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.547879:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565088128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497800.547885:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00000040:3.0:1777497800.547893:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:3.0:1777497800.547903:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:2.0:1777497800.548007:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.548017:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.548024:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088128:0@lo:101:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.548031:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.548040:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff923f82fd9000 refcount=4 00010000:00000040:2.0:1777497800.548049:0:6511:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff923f82fd9000, remote cookie: 0x3e357265691ed4c, flags: 0x0 00010000:00000040:2.0:1777497800.548054:0:6511:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff923f85215a00) refcount = 1 00010000:00010000:2.0:1777497800.548057:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1777497800.548066:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ed4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:2.0:1777497800.548075:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fca80 x1863837565088128/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.548084:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:00000040:2.0:1777497800.548117:0:6511:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff923f8621c400) refs 3 00000020:00000040:2.0:1777497800.548120:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff923f82fd9000 refcount=3 00000020:00000040:2.0:1777497800.548136:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:2.0:1777497800.548148:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:2.0:1777497800.548159:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.548168:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088256:0@lo:256:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.548185:0:6511:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.548191:0:6511:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.548207:0:6511:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2df050 x1863837565088256 msgsize 304 00000100:00100000:2.0:1777497800.548211:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.548213:0:6511:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497800.548226:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.548242:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83ed3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1777497800.548301:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088256 00000100:00100000:1.0:1777497800.548306:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088256 00000020:00000040:1.0:1777497800.548307:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:1.0:1777497800.548310:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:1.0:1777497800.548322:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1777497800.548343:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1777497800.548346:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:1.0:1777497800.548350:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2df050 x1863837565088256/t0(0) o256->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 304/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.548359:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565088256:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1777497800.548373:0:90574:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:1.0:1777497800.548386:0:90574:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:1.0:1777497800.548393:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1777497800.548395:0:90574:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:1.0:1777497800.548401:0:90574:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=23 00000020:00000040:1.0:1777497800.548447:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00010000:00000040:1.0:1777497800.548460:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565088256 00000100:00000040:1.0:1777497800.548478:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497800.548482:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497800.548500:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497800.548512:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:1.0:1777497800.548517:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2df050 x1863837565088256/t0(0) o256->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 304/240 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.548524:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565088256:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 166us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497800.548531:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00000040:1.0:1777497800.548533:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497800.548540:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 21 00000100:00000040:3.0:1777497800.548858:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.548866:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.548873:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.548878:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240866fca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088256:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1777497800.548884:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1777497800.548892:0:6511:0:(mgc_request.c:1597:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:3.0:1777497800.548904:0:6511:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1777497800.548913:0:6511:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.202.104@tcp has 192.168.202.104@tcp. 10000000:00000040:3.0:1777497800.548927:0:6511:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0000 target is obsoleted(1/2), reconnect 00000100:00080000:3.0:1777497800.548931:0:6511:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff9240aef6a000 already not connected (conn 5, was 0): DISCONN 00000100:00000040:3.0:1777497800.548941:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:3.0:1777497800.548944:0:6511:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:3.0:1777497800.548946:0:6511:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.104@tcp -> ffff924089288a00 00010000:00080000:3.0:1777497800.548949:0:6511:0:(ldlm_lib.c:85:import_set_conn()) imp ffff9240aef6a000@lustre-OST0000-osc-MDT0000: found existing conn 192.168.202.104@tcp, moved to head 00010000:00000040:3.0:1777497800.548952:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00080000:3.0:1777497800.548956:0:6511:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:3.0:1777497800.548961:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 60 to 0@lo 00000100:00000040:3.0:1777497800.548963:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 61 to 0@lo 00000020:00000040:3.0:1777497800.548965:0:6511:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddbd 00000020:00000040:3.0:1777497800.548967:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f839d0800 refcount=4 00000100:00000040:3.0:1777497800.548970:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 60 to 0@lo 00000100:00000040:3.0:1777497800.548978:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 61 to 0@lo 00000020:00000040:3.0:1777497800.548980:0:6511:0:(genops.c:900:class_export_put()) PUTting export ffff923f839d0800 : new refcount 3 00000100:00080000:3.0:1777497800.548983:0:6511:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9240aef6a000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:3.0:1777497800.548994:0:6511:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00100000:3.0:1777497800.549006:0:6511:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497800.549018:0:6511:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c10483bd] to pc [ptlrpcd_rcv+-1] req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:3.0:1777497800.549030:0:6511:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0000 00000100:00000040:3.0:1777497800.549037:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240866fca80 x1863837565088256/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497800.549044:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497800.549046:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:01000000:3.0:1777497800.549066:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:3.0:1777497800.549071:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff923f82fd9000 refcount=3 00010000:00010000:3.0:1777497800.549075:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.549084:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:3.0:1777497800.549120:0:6511:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff92409151b200) refs 2 10000000:00000040:3.0:1777497800.549123:0:6511:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff923f8621c400) refs 3 10000000:01000000:3.0:1777497800.549126:0:6511:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1777497800.549128:0:6511:0:(mgc_request.c:1799:mgc_process_log()) Process log lustre-mdtir-ffff9240b521d800 from 125 10000000:01000000:3.0:1777497800.549131:0:6511:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000020:00000040:3.0:1777497800.549135:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00010000:00000040:3.0:1777497800.549145:0:6511:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff923f85215a00 count: 2 00000020:00000040:3.0:1777497800.549150:0:6511:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924099079c00 with handle 0x3e357265691ed53 to hash 00010000:00010000:3.0:1777497800.549161:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.549168:0:6511:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.549175:0:6511:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1777497800.549187:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.549196:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088512:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1777497800.549209:0:6511:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.549217:0:6511:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497800.549233:0:6511:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2de050 x1863837565088512 msgsize 328 00000100:00100000:3.0:1777497800.549237:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497800.549239:0:6511:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497800.549254:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.549271:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83cf6780 going to sleep for 11 seconds 00000100:00100000:1.0:1777497800.549329:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088512 00000100:00100000:1.0:1777497800.549334:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088512 00000020:00000040:1.0:1777497800.549336:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:1.0:1777497800.549338:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=22 00000100:00000040:1.0:1777497800.549351:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:1.0:1777497800.549376:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1777497800.549379:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:1.0:1777497800.549383:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2de050 x1863837565088512/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 328/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.549395:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+22:6511:x1863837565088512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1777497800.549402:0:90575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000040:1.0:1777497800.549407:0:90575:0:(ldlm_resource.c:1622:ldlm_resource_getref()) getref res: ffff923f85215b00 count: 3 00000020:00000040:1.0:1777497800.549412:0:90575:0:(lustre_handles.c:77:class_handle_hash()) added object ffff924086d88a00 with handle 0x3e357265691ed5a to hash 00010000:00010000:1.0:1777497800.549415:0:90575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff924086d88a00/0x3e357265691ed5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3e357265691ed53 expref: -99 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1777497800.549421:0:90575:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export ffff9240a6374800 : new locks_count 18 00000020:00000040:1.0:1777497800.549423:0:90575:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=23 00010000:00000040:1.0:1777497800.549441:0:90575:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff923f85215b00) refcount = 3 00010000:00000040:1.0:1777497800.549444:0:90575:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:1.0:1777497800.549448:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff924099078800/0x3e357265691ed4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ed45 expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:1.0:1777497800.549456:0:90575:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGS lock: ffff923f82fd8a00/0x3e357265691ed3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.4@tcp remote: 0x96df4dfe1628c7ce expref: 8 pid: 90580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497800.549478:0:90575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff924086d88a00/0x3e357265691ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3e357265691ed53 expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497800.549488:0:90575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff924086d88a00/0x3e357265691ed5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3e357265691ed53 expref: 23 pid: 90575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497800.549494:0:90575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff924086d88a00, rc 0) 00010000:00000040:1.0:1777497800.549497:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565088512 00000100:00000040:1.0:1777497800.549502:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497800.549506:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497800.549522:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497800.549538:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 61 to 0@lo 00000100:00000040:1.0:1777497800.549542:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2de050 x1863837565088512/t0(0) o101->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 328/344 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.549549:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565088512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497800.549554:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00000040:1.0:1777497800.549557:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:1.0:1777497800.549564:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:2.0:1777497800.549754:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.549778:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565088384:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.549793:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.549799:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.549815:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fc700 x1863837565088384 msgsize 520 00000100:00100000:2.0:1777497800.549818:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.549833:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.549843:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 4086 usecs (5 jiffies) 00000100:00100000:2.0:1777497800.549863:0:25490:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088384 00000100:00100000:2.0:1777497800.549866:0:25490:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088384 00000020:00000040:2.0:1777497800.549868:0:25490:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddc4 00000100:00100000:2.0:1777497800.549891:0:25490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5984 00000100:00000040:2.0:1777497800.549896:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fc700 x1863837565088384/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.549904:0:25490:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:0+-99:3656:x1863837565088384:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:2.0:1777497800.549917:0:25490:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 8 - find 00010000:00000040:2.0:1777497800.549926:0:25490:0:(ldlm_lib.c:1252:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:2.0:1777497800.549932:0:25490:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0000-mdtlov_UUID' at ffff9240865c2800, cookie 0x3e357265691ecdc 00010000:00080000:2.0:1777497800.549936:0:25490:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo recovering/t4294969476 exp ffff9240865c2800 cur 3929 last 1777497798 00000001:00000040:2.0:1777497800.549947:0:25490:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.202.104@tcp 00000001:00000040:2.0:1777497800.549951:0:25490:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 18 00000020:00000040:2.0:1777497800.549955:0:25490:0:(genops.c:889:class_export_get()) GET export ffff9240865c2800 refcount=4 00000001:00000040:2.0:1777497800.549956:0:25490:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 19 00000001:00000040:2.0:1777497800.549959:0:25490:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9240867b8c00) : new refcount 18 00002000:00100000:2.0:1777497800.549962:0:25490:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9240865c2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1777497800.549973:0:25490:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1777497800.549976:0:25490:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:2.0:1777497800.549985:0:25490:0:(lprocfs_status_server.c:685:lprocfs_exp_setup()) Found stats ffff923f8603d720 for nid 0@lo - ref 2 00000020:00000040:2.0:1777497800.550086:0:25490:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 9 - import 00000020:00000040:2.0:1777497800.550114:0:25490:0:(genops.c:1244:class_import_put()) import ffff9240bb807800 refcount=1 obd=lustre-OST0000 00000020:00000040:2.0:1777497800.550122:0:25490:0:(genops.c:889:class_export_get()) GET export ffff9240865c2800 refcount=5 00000100:00000040:2.0:1777497800.550124:0:25490:0:(service.c:1080:ptlrpc_request_change_export()) RPC GETting export ffff9240865c2800 : new rpc_count 1 00000100:00000040:2.0:1777497800.550127:0:25490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:2.0:1777497800.550130:0:25490:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 62 to 0@lo 00000020:00000040:2.0:1777497800.550132:0:25490:0:(genops.c:889:class_export_get()) GET export ffff9240865c2800 refcount=6 00000100:00000040:2.0:1777497800.550137:0:25490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 63 to 0@lo 00000100:00080000:2.0:1777497800.550145:0:25490:0:(import.c:65:import_set_state_nolock()) ffff9240bb807800 : changing import state from RECOVER to FULL 00000020:00000040:2.0:1777497800.550152:0:25490:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c2800 : new refcount 5 00000020:00000040:2.0:1777497800.550154:0:25490:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 9 - find 00010000:00000040:2.0:1777497800.550162:0:25490:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969476, transno 0, xid 1863837565088384 00000100:00000040:2.0:1777497800.550167:0:25490:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 64 to 0@lo 00000100:00000040:2.0:1777497800.550170:0:25490:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.550185:0:25490:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.550203:0:25490:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 63 to 0@lo 00000100:00000040:2.0:1777497800.550207:0:25490:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fc700 x1863837565088384/t0(0) o8->lustre-MDT0000-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1777497820 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550215:0:25490:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565088384:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 311us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497800.550221:0:25490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5984 00000100:00000040:2.0:1777497800.550224:0:25490:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c2800 : new rpc_count 0 00000020:00000040:2.0:1777497800.550230:0:25490:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c2800 : new refcount 4 00010000:00080000:2.0:1777497800.550258:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550272:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969476 gen 2 00000100:00000040:2.0:1777497800.550277:0:3656:0:(client.c:3157:ptlrpc_free_committed()) @@@ commit (last_committed 4294969476) req@ffff9240a6d94000 x1863837565069696/t4294969476(4294969476) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1777497784 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.550284:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d94000 x1863837565069696/t4294969476(4294969476) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1777497784 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.550292:0:3656:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1777497800.550297:0:3656:0:(client.c:3211:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=1 replay=1/1 committed=0/0 00000100:00000040:2.0:1777497800.550302:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1777497800.550311:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000020:00000040:2.0:1777497800.550313:0:3656:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddbd 00000020:00000040:2.0:1777497800.550315:0:3656:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f839d0800 refcount=4 00000020:00000040:2.0:1777497800.550321:0:3656:0:(genops.c:900:class_export_put()) PUTting export ffff923f839d0800 : new refcount 3 00000100:00080000:2.0:1777497800.550325:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:2.0:1777497800.550329:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:2.0:1777497800.550331:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294969476 gen 2 00000100:00000040:2.0:1777497800.550333:0:3656:0:(client.c:3211:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:2.0:1777497800.550335:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff9240aef6a000 from lustre-OST0000_UUID committed 4294969476 last 0 00000100:00080000:2.0:1777497800.550338:0:3656:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:2.0:1777497800.550341:0:3656:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1777497800.550441:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550448:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c250700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565088384:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.550453:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c250700 x1863837565088384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.550487:0:3656:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00010000:00080000:2.0:1777497800.550505:0:93109:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0000 to lustre-OST0000_UUID@0@lo 00010000:00010000:2.0:1777497800.550509:0:93109:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0000 (0) 00010000:00010000:2.0:1777497800.550513:0:93109:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0000 00000100:00080000:2.0:1777497800.550548:0:93109:0:(import.c:65:import_set_state_nolock()) ffff9240aef6a000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:2.0:1777497800.550554:0:93109:0:(genops.c:1231:class_import_get()) import ffff9240aef6a000 refcount=4 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1777497800.550568:0:93109:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002a3d107d] to pc [ptlrpcd_rcv+-1] req@ffff9240866fea00 x1863837565088640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497800.550580:0:93109:0:(genops.c:1244:class_import_put()) import ffff9240aef6a000 refcount=3 obd=lustre-OST0000-osc-MDT0000 00000100:00000040:2.0:1777497800.550588:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240866fea00 x1863837565088640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550596:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240866fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3656:1863837565088640:0@lo:400:ldlm_lock_repla.0 00000100:00000040:2.0:1777497800.550610:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff9240866fea00 x1863837565088640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497816 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.550617:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.550631:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fc380 x1863837565088640 msgsize 224 00000100:00100000:2.0:1777497800.550634:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.550647:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240866fea00 x1863837565088640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497816 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.550656:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 3998 usecs (4 jiffies) 00000100:00100000:2.0:1777497800.550674:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088640 00000100:00100000:2.0:1777497800.550678:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088640 00000020:00000040:2.0:1777497800.550679:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecdc 00000020:00000040:2.0:1777497800.550682:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c2800 refcount=5 00000100:00000040:2.0:1777497800.550695:0:25491:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost at +6s 00000100:00100000:2.0:1777497800.550713:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2723 00000100:00000040:2.0:1777497800.550732:0:25491:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c2800 : new rpc_count 1 00000100:00000040:2.0:1777497800.550737:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fc380 x1863837565088640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550748:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565088640:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:2.0:1777497800.550757:0:25491:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fc380 x1863837565088640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:2.0:1777497800.550766:0:25491:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c2800 : new rpc_count 2 00010000:00080000:2.0:1777497800.550769:0:25491:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff9240866fc380 x1863837565088640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.550790:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fc380 x1863837565088640/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.550798:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0000-mdtlov_UUID+5:3656:x1863837565088640:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 53us (166us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.550805:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2723 00000100:00000040:2.0:1777497800.550807:0:25491:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c2800 : new rpc_count 1 00000100:00000040:3.0:1777497800.551114:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.551125:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.551131:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088512:0@lo:101:ll_cfg_requeue.0 00000100:00000040:3.0:1777497800.551138:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497800.551160:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099079c00 refcount=4 00010000:00000040:3.0:1777497800.551165:0:6511:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: ffff924099079c00, remote cookie: 0x3e357265691ed5a, flags: 0x0 00010000:00000040:3.0:1777497800.551172:0:6511:0:(ldlm_resource.c:1842:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (ffff923f85215a00) refcount = 2 00010000:00000040:3.0:1777497800.551175:0:6511:0:(ldlm_resource.c:1845:ldlm_resource_dump()) Granted locks (in reverse order): 00010000:00000040:3.0:1777497800.551178:0:6511:0:(ldlm_resource.c:1848:ldlm_resource_dump()) ### ### ns: MGC192.168.202.104@tcp lock: ffff923f82fd9000/0x3e357265691ed45 lrc: 1/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ed4c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.551186:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1777497800.551194:0:6511:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3e357265691ed5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000040:3.0:1777497800.551203:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c251c00 x1863837565088512/t0(0) o101->MGC192.168.202.104@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1777497816 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497800.551211:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:00000040:3.0:1777497800.551218:0:6511:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (ffff92409151b200) refs 3 00000020:00000040:3.0:1777497800.551221:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099079c00 refcount=3 00000020:00000040:3.0:1777497800.551238:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:3.0:1777497800.551249:0:6511:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=5 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497800.551259:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.551268:0:6511:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409c251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088768:0@lo:256:ll_cfg_requeue.0 00000100:00000040:3.0:1777497800.551284:0:6511:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.551292:0:6511:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497800.551310:0:6511:0:(events.c:337:request_in_callback()) incoming req@ffff9240bc2de850 x1863837565088768 msgsize 304 00000100:00100000:3.0:1777497800.551314:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497800.551321:0:6511:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:3.0:1777497800.551344:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 2 req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.551365:0:6511:0:(client.c:2691:ptlrpc_set_wait()) set ffff923f83cf6780 going to sleep for 11 seconds 00000100:00100000:2.0:1777497800.551556:0:90574:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088768 00000100:00100000:2.0:1777497800.551561:0:90574:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088768 00000020:00000040:2.0:1777497800.551563:0:90574:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:2.0:1777497800.551565:0:90574:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:2.0:1777497800.551579:0:90574:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:2.0:1777497800.551605:0:90574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1777497800.551608:0:90574:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:2.0:1777497800.551612:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240bc2de850 x1863837565088768/t0(0) o256->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 304/0 e 0 to 0 dl 1777497811 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.551623:0:90574:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565088768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1777497800.551639:0:90574:0:(mgs_nids.c:912:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000040:2.0:1777497800.551654:0:90574:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1777497800.551660:0:90574:0:(mgs_nids.c:305:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1777497800.551663:0:90574:0:(mgs_nids.c:316:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 125 00000020:00000040:2.0:1777497800.551671:0:90574:0:(genops.c:889:class_export_get()) GET export ffff9240a6374800 refcount=24 00000020:00000040:2.0:1777497800.551793:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 23 00010000:00000040:2.0:1777497800.551806:0:90574:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565088768 00000100:00000040:2.0:1777497800.551812:0:90574:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 64 to 0@lo 00000100:00000040:2.0:1777497800.551816:0:90574:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.551831:0:90574:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.551855:0:90574:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 63 to 0@lo 00000100:00000040:2.0:1777497800.551859:0:90574:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240bc2de850 x1863837565088768/t0(0) o256->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:556/0 lens 304/240 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.551865:0:90574:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bc2de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:6511:x1863837565088768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 246us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497800.551871:0:90574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00000040:2.0:1777497800.551874:0:90574:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:2.0:1777497800.551881:0:90574:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:1.0:1777497800.551939:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497800.551959:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497800.551966:0:6511:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497800.551973:0:6511:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff92409c251c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:6511:1863837565088768:0@lo:256:ll_cfg_requeue.0 00000100:00000040:1.0:1777497800.551978:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1777497800.551987:0:6511:0:(mgc_request.c:1597:mgc_process_recover_log()) Latest version 125, more 0. 10000000:00000040:1.0:1777497800.551998:0:6511:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1777497800.552010:0:6511:0:(lustre_peer.c:213:class_check_uuid()) check if uuid 192.168.202.104@tcp has 192.168.202.104@tcp. 10000000:00000040:1.0:1777497800.552023:0:6511:0:(mgc_request.c:1469:mgc_apply_recover_logs()) IR: lustre-OST0000-osc-MDT0001 target is obsoleted(1/2), reconnect 00000100:00080000:1.0:1777497800.552028:0:6511:0:(import.c:213:ptlrpc_set_import_discon()) osp: import ffff924098a6d000 already not connected (conn 6, was 0): DISCONN 00000100:00000040:1.0:1777497800.552037:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 64 to 0@lo 00000100:00000040:1.0:1777497800.552040:0:6511:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 64 to 0@lo 00000100:00000040:1.0:1777497800.552042:0:6511:0:(client.c:137:ptlrpc_uuid_to_connection()) 192.168.202.104@tcp -> ffff924089288a00 00010000:00080000:1.0:1777497800.552045:0:6511:0:(ldlm_lib.c:85:import_set_conn()) imp ffff924098a6d000@lustre-OST0000-osc-MDT0001: found existing conn 192.168.202.104@tcp, moved to head 00010000:00000040:1.0:1777497800.552049:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 63 to 0@lo 00000100:00080000:1.0:1777497800.552053:0:6511:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000040:1.0:1777497800.552057:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497800.552059:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 63 to 0@lo 00000020:00000040:1.0:1777497800.552061:0:6511:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bb6 00000020:00000040:1.0:1777497800.552064:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a89000 refcount=4 00000100:00000040:1.0:1777497800.552066:0:6511:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 62 to 0@lo 00000100:00000040:1.0:1777497800.552068:0:6511:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 63 to 0@lo 00000020:00000040:1.0:1777497800.552070:0:6511:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a89000 : new refcount 3 00000100:00080000:1.0:1777497800.552073:0:6511:0:(import.c:623:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff924098a6d000 using connection 192.168.202.104@tcp/0@lo 00000020:00000040:1.0:1777497800.552089:0:6511:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00100000:1.0:1777497800.552129:0:6511:0:(import.c:825:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:1.0:1777497800.552140:0:6511:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001f9a85bc] to pc [ptlrpcd_rcv+-1] req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 10000000:00000040:1.0:1777497800.552157:0:6511:0:(mgc_request.c:1486:mgc_apply_recover_logs()) ir apply logs 125/125 for lustre-OST0000-osc-MDT0001 00000100:00000040:1.0:1777497800.552164:0:6511:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff92409c251c00 x1863837565088768/t0(0) o256->MGC192.168.202.104@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1777497816 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:1.0:1777497800.552172:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000020:00000040:1.0:1777497800.552175:0:6511:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 10000000:01000000:1.0:1777497800.552194:0:6511:0:(mgc_request.c:1876:mgc_process_log()) MGC192.168.202.104@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00000020:00000040:1.0:1777497800.552199:0:6511:0:(lustre_handles.c:131:class_handle2object()) GET ldlm ffff924099079c00 refcount=3 00010000:00010000:1.0:1777497800.552203:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1777497800.552212:0:6511:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.104@tcp lock: ffff924099079c00/0x3e357265691ed53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3e357265691ed5a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00000040:1.0:1777497800.552221:0:6511:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(ffff92409151b200) refs 3 00010000:00080000:3.0:1777497800.552287:0:93031:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 2 stale 0 max_recoverable_clients 3 abort 0 expired 0 00000100:00000040:2.0:1777497800.552340:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497800.552350:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565088896:0@lo:8:ll_cfg_requeue.0 00000100:00000040:2.0:1777497800.552367:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.552374:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497800.552389:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fe680 x1863837565088896 msgsize 520 00000100:00100000:2.0:1777497800.552393:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497800.552447:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497800.552457:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5282 usecs (6 jiffies) 00000100:00100000:3.0:1777497800.558875:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565088896 00000100:00100000:3.0:1777497800.558890:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565088896 00000020:00000040:3.0:1777497800.558892:0:25485:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bcb 00000100:00100000:0.0:1777497800.559031:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5985 00000100:00000040:0.0:1777497800.559041:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fe680 x1863837565088896/t0(0) o8->@:0/0 lens 520/0 e 0 to 0 dl 1777497820 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.559061:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:0+-99:3656:x1863837565088896:12345-0@lo:8:ll_cfg_requeue.0 00000020:00000040:0.0:1777497800.559082:0:25485:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 9 - find 00010000:00000040:0.0:1777497800.559135:0:25485:0:(ldlm_lib.c:1252:target_handle_connect()) lustre-OST0000: ocd_connect_flags: 0xa044401443000026 tmp_exp_old_falloc: 0 00010000:00080000:0.0:1777497800.559142:0:25485:0:(ldlm_lib.c:926:target_handle_reconnect()) connect export for UUID 'lustre-MDT0001-mdtlov_UUID' at ffff9240865c7000, cookie 0x3e357265691ece3 00010000:00080000:0.0:1777497800.559147:0:25485:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo recovering/t0 exp ffff9240865c7000 cur 3929 last 1777497798 00000001:00000040:0.0:1777497800.559166:0:25485:0:(nodemap_handler.c:499:nodemap_classify_nid()) found nid 192.168.202.104@tcp 00000001:00000040:0.0:1777497800.559171:0:25485:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 19 00000020:00000040:0.0:1777497800.559176:0:25485:0:(genops.c:889:class_export_get()) GET export ffff9240865c7000 refcount=4 00000001:00000040:0.0:1777497800.559177:0:25485:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=ffff9240867b8c00) : new refcount 20 00000001:00000040:0.0:1777497800.559182:0:25485:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=ffff9240867b8c00) : new refcount 19 00002000:00100000:0.0:1777497800.559186:0:25485:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9240865c7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211345d ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1777497800.559190:0:25485:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:0.0:1777497800.559193:0:25485:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000020:00000040:0.0:1777497800.559203:0:25485:0:(lprocfs_status_server.c:685:lprocfs_exp_setup()) Found stats ffff923f8603d720 for nid 0@lo - ref 3 00000020:00000040:0.0:1777497800.559212:0:25485:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 10 - import 00000020:00000040:0.0:1777497800.559218:0:25485:0:(genops.c:1244:class_import_put()) import ffff923f8de96000 refcount=1 obd=lustre-OST0000 00000020:00000040:0.0:1777497800.559227:0:25485:0:(genops.c:889:class_export_get()) GET export ffff9240865c7000 refcount=5 00000100:00000040:0.0:1777497800.559229:0:25485:0:(service.c:1080:ptlrpc_request_change_export()) RPC GETting export ffff9240865c7000 : new rpc_count 1 00000100:00000040:0.0:1777497800.559236:0:25485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 64 to 0@lo 00000100:00000040:0.0:1777497800.559239:0:25485:0:(connection.c:149:ptlrpc_connection_get()) conn=ffff924089288a00 refcount 64 to 0@lo 00000020:00000040:0.0:1777497800.559242:0:25485:0:(genops.c:889:class_export_get()) GET export ffff9240865c7000 refcount=6 00000100:00000040:0.0:1777497800.559248:0:25485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00080000:0.0:1777497800.559258:0:25485:0:(import.c:65:import_set_state_nolock()) ffff923f8de96000 : changing import state from RECOVER to FULL 00000020:00000040:0.0:1777497800.559271:0:25485:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c7000 : new refcount 5 00000020:00000040:0.0:1777497800.559274:0:25485:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 10 - find 00010000:00000040:0.0:1777497800.559287:0:25485:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969458, transno 0, xid 1863837565088896 00000100:00000040:0.0:1777497800.559303:0:25485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497800.559308:0:25485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497800.559365:0:25485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497800.559399:0:25485:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497800.559404:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fe680 x1863837565088896/t0(0) o8->lustre-MDT0001-mdtlov_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1777497820 ref 1 fl Interpret:/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.559412:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3656:x1863837565088896:12345-0@lo:8:ll_cfg_requeue.0 Request processed in 351us (7020us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497800.559418:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5985 00000100:00000040:0.0:1777497800.559421:0:25485:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c7000 : new rpc_count 0 00000020:00000040:0.0:1777497800.559430:0:25485:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c7000 : new refcount 4 00010000:00080000:0.0:1777497800.559609:0:3656:0:(ldlm_request.c:1663:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497800.559619:0:3656:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: skip recheck: last_committed 4294969458 00000100:00000040:0.0:1777497800.559625:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497800.559636:0:3656:0:(import.c:1130:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000020:00000040:0.0:1777497800.559638:0:3656:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bb6 00000020:00000040:0.0:1777497800.559643:0:3656:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a89000 refcount=4 00000020:00000040:0.0:1777497800.559652:0:3656:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a89000 : new refcount 3 00000100:00080000:0.0:1777497800.559658:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from CONNECTING to REPLAY 00000100:00080000:0.0:1777497800.559663:0:3656:0:(import.c:1694:ptlrpc_import_recovery_state_machine()) replay requested by lustre-OST0000_UUID 00000100:00100000:0.0:1777497800.559666:0:3656:0:(client.c:3101:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294969458 gen 2 00000100:00000040:0.0:1777497800.559669:0:3656:0:(client.c:3211:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: normal: skip=0 replay=0/0 committed=0/0 00000100:00080000:0.0:1777497800.559671:0:3656:0:(recover.c:53:ptlrpc_replay_next()) import ffff924098a6d000 from lustre-OST0000_UUID committed 4294969458 last 0 00000100:00080000:0.0:1777497800.559674:0:3656:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from REPLAY to REPLAY_LOCKS 00000020:00000040:0.0:1777497800.559683:0:3656:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:3.0:1777497800.559871:0:93031:0:(ldlm_lib.c:2531:check_for_recovery_ready()) connected 3 stale 0 max_recoverable_clients 3 abort 0 expired 0 00010000:00000040:3.0:1777497800.559876:0:93031:0:(ldlm_lib.c:2860:target_recovery_thread()) 1: request replay stage - 2 clients from t4294969481 00010000:00080000:3.0:1777497800.559879:0:93031:0:(ldlm_lib.c:2669:replay_request_or_update()) Waiting for transno 4294969481 00010000:00080000:3.0:1777497800.559885:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 1, req_transno: 4294969481, next_transno: 4294969481 00010000:00080000:3.0:1777497800.559887:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969481) 00010000:00080000:3.0:1777497800.559895:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546396032 t4294969481 from 192.168.202.4@tcp req@ffff92409bf28380 x1863837546396032/t0(4294969481) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.559913:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf28380 x1863837546396032/t0(4294969481) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1777497800.559938:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x362:0x0] 00000001:00000040:3.0:1777497800.560709:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 1 00000020:00000040:3.0:1777497800.560713:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=6 00010000:00000040:3.0:1777497800.560773:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969481, xid 1863837546396032 00000100:00000040:3.0:1777497800.560782:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.560788:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.560879:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.560893:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 101 seconds 00010000:00000040:3.0:1777497800.560899:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.560910:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 5 00010000:00080000:3.0:1777497800.560914:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969482 00010000:00080000:3.0:1777497800.560917:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 1, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:3.0:1777497800.562287:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.562299:0:3656:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240a6d80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565088896:0@lo:8:ll_cfg_requeue.0 00000100:00000040:3.0:1777497800.562307:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240a6d80e00 x1863837565088896/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1777497825 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'ll_cfg_requeue.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497800.562319:0:3656:0:(genops.c:1244:class_import_put()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00010000:00080000:0.0:1777497800.562404:0:93111:0:(ldlm_request.c:2960:ldlm_lock_replay_thread()) lock replay thread lustre-OST0000-osc-MDT0001 to lustre-OST0000_UUID@0@lo 00010000:00010000:0.0:1777497800.562409:0:93111:0:(ldlm_request.c:2876:ldlm_cancel_unused_locks_for_replay()) Dropping as many unused locks as possible before replay for namespace lustre-OST0000-osc-MDT0001 (0) 00010000:00010000:0.0:1777497800.562415:0:93111:0:(ldlm_request.c:2889:ldlm_cancel_unused_locks_for_replay()) Canceled 0 unused locks from namespace lustre-OST0000-osc-MDT0001 00000100:00080000:0.0:1777497800.562452:0:93111:0:(import.c:65:import_set_state_nolock()) ffff924098a6d000 lustre-OST0000_UUID: changing import state from REPLAY_LOCKS to REPLAY_WAIT 00000020:00000040:0.0:1777497800.562460:0:93111:0:(genops.c:1231:class_import_get()) import ffff924098a6d000 refcount=5 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:0.0:1777497800.562497:0:93111:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000cca7fd73] to pc [ptlrpcd_rcv+-1] req@ffff92409bf2aa00 x1863837565089024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497800.562508:0:93111:0:(genops.c:1244:class_import_put()) import ffff924098a6d000 refcount=4 obd=lustre-OST0000-osc-MDT0001 00000100:00000040:3.0:1777497800.562818:0:3656:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff92409bf2aa00 x1863837565089024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:QU/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497800.562831:0:3656:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff92409bf2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3656:1863837565089024:0@lo:400:ldlm_lock_repla.0 00000100:00000040:3.0:1777497800.562862:0:3656:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=2c0 req@ffff92409bf2aa00 x1863837565089024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497816 ref 2 fl Rpc:r/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.562871:0:3656:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497800.562911:0:3656:0:(events.c:337:request_in_callback()) incoming req@ffff92409c250a80 x1863837565089024 msgsize 224 00000100:00100000:3.0:1777497800.562916:0:3656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497800.562946:0:3656:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff92409bf2aa00 x1863837565089024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497816 ref 2 fl Rpc:Qr/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497800.562958:0:3656:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0001: using a timeout of 5293 usecs (6 jiffies) 00000100:00100000:0.0:1777497800.564620:0:8398:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089024 00000100:00100000:0.0:1777497800.564634:0:8398:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089024 00000020:00000040:0.0:1777497800.564637:0:8398:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ece3 00000020:00000040:0.0:1777497800.564641:0:8398:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c7000 refcount=5 00000100:00100000:0.0:1777497800.564693:0:8398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2724 00000100:00000040:0.0:1777497800.564698:0:8398:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c7000 : new rpc_count 1 00000100:00000040:0.0:1777497800.564704:0:8398:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c250a80 x1863837565089024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl New:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.564716:0:8398:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1863837565089024:12345-0@lo:400:ldlm_lock_repla.0 00000020:00000040:0.0:1777497800.564740:0:8398:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c250a80 x1863837565089024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1777497800.564749:0:8398:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c7000 : new rpc_count 2 00010000:00080000:0.0:1777497800.564752:0:8398:0:(ldlm_lib.c:3120:target_queue_recovery_request()) @@@ queue final req req@ffff92409c250a80 x1863837565089024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497800.564769:0:8398:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c250a80 x1863837565089024/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:556/0 lens 224/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:H/2c0/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497800.564776:0:8398:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3656:x1863837565089024:12345-0@lo:400:ldlm_lock_repla.0 Request processed in 62us (1864us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.564789:0:8398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2724 00000100:00000040:0.0:1777497800.564792:0:8398:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c7000 : new rpc_count 1 00010000:00080000:0.0:1777497800.564811:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969482 00000100:00000040:2.0:1777497800.573767:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fd500 x1863837546398336 msgsize 440 00000100:00100000:2.0:1777497800.573782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.574388:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398336 00000100:00100000:3.0:1777497800.574399:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398336 00000020:00000040:3.0:1777497800.574403:0:24168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.574408:0:24168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=6 00000100:00000040:3.0:1777497800.574434:0:24168:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.575066:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1049 00000100:00000040:3.0:1777497800.575070:0:24168:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.575078:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fd500 x1863837546398336/t0(4294969482) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.575123:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546398336:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.575144:0:24168:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fd500 x1863837546398336/t0(4294969482) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.575153:0:24168:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969482, current: 4294969482, replaying 00010000:00000040:3.0:1777497800.575157:0:24168:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.575173:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fd500 x1863837546398336/t0(4294969482) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.575181:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+6:2411:x1863837546398336:12345-192.168.202.4@tcp:10:dd.0 Request processed in 93us (1415us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.575188:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1049 00000100:00000040:3.0:1777497800.575192:0:24168:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.576496:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969482, next_transno: 4294969482 00010000:00080000:0.0:1777497800.576504:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969482) 00010000:00080000:0.0:1777497800.576516:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546398336 t4294969482 from 192.168.202.4@tcp req@ffff9240866fd500 x1863837546398336/t0(4294969482) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.576537:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fd500 x1863837546398336/t0(4294969482) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.576567:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x363:0x0] 00000001:00000040:0.0:1777497800.576719:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 2 00000020:00000040:0.0:1777497800.576732:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=7 00010000:00000040:0.0:1777497800.576772:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969482, xid 1863837546398336 00000100:00000040:0.0:1777497800.576782:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.576789:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.576851:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.576862:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.576869:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.576879:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 6 00010000:00080000:0.0:1777497800.576883:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00010000:00080000:0.0:1777497800.576887:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969483 00000100:00000040:2.0:1777497800.588175:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fca80 x1863837546398848 msgsize 440 00000100:00100000:2.0:1777497800.588188:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.588454:0:24914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546398848 00000100:00100000:0.0:1777497800.588474:0:24914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546398848 00000020:00000040:0.0:1777497800.588477:0:24914:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.588481:0:24914:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=7 00000100:00000040:0.0:1777497800.588503:0:24914:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.588552:0:24914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1050 00000100:00000040:0.0:1777497800.588567:0:24914:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.588575:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fca80 x1863837546398848/t0(4294969483) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.588587:0:24914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546398848:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:0.0:1777497800.588599:0:24914:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fca80 x1863837546398848/t0(4294969483) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.588608:0:24914:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969483, current: 4294969483, replaying 00010000:00000040:0.0:1777497800.588611:0:24914:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.588630:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fca80 x1863837546398848/t0(4294969483) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.588639:0:24914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+7:2411:x1863837546398848:12345-192.168.202.4@tcp:10:dd.0 Request processed in 54us (465us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.588645:0:24914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1050 00000100:00000040:0.0:1777497800.588648:0:24914:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497800.588886:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969483, next_transno: 4294969483 00010000:00080000:3.0:1777497800.588892:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969483) 00010000:00080000:3.0:1777497800.588900:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546398848 t4294969483 from 192.168.202.4@tcp req@ffff9240866fca80 x1863837546398848/t0(4294969483) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.588917:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fca80 x1863837546398848/t0(4294969483) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1777497800.588944:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x364:0x0] 00000001:00000040:3.0:1777497800.589122:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 3 00000020:00000040:3.0:1777497800.589126:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=8 00010000:00000040:3.0:1777497800.589156:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969483, xid 1863837546398848 00000100:00000040:3.0:1777497800.589165:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.589171:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.589215:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.589222:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497800.589227:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.589236:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 7 00010000:00080000:3.0:1777497800.589245:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00010000:00080000:3.0:1777497800.589249:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969484 00000100:00000040:2.0:1777497800.597476:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240866fdc00 x1863837546399232 msgsize 440 00000100:00100000:2.0:1777497800.597493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.597556:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546399232 00000100:00100000:0.0:1777497800.597566:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546399232 00000020:00000040:0.0:1777497800.597570:0:24658:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.597574:0:24658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=8 00000100:00000040:0.0:1777497800.597600:0:24658:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.597651:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1051 00000100:00000040:0.0:1777497800.597655:0:24658:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.597669:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866fdc00 x1863837546399232/t0(4294969484) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.597690:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546399232:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:0.0:1777497800.597701:0:24658:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fdc00 x1863837546399232/t0(4294969484) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.597733:0:24658:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969484, current: 4294969484, replaying 00010000:00000040:0.0:1777497800.597737:0:24658:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.597761:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866fdc00 x1863837546399232/t0(4294969484) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.597773:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546399232:12345-192.168.202.4@tcp:10:dd.0 Request processed in 84us (296us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.597780:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1051 00000100:00000040:0.0:1777497800.597783:0:24658:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.597853:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969484, next_transno: 4294969484 00010000:00080000:1.0:1777497800.597858:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969484) 00010000:00080000:1.0:1777497800.597866:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546399232 t4294969484 from 192.168.202.4@tcp req@ffff9240866fdc00 x1863837546399232/t0(4294969484) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.597881:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866fdc00 x1863837546399232/t0(4294969484) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1777497800.597911:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x366:0x0] 00000001:00000040:1.0:1777497800.598063:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 4 00000020:00000040:1.0:1777497800.598072:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=9 00010000:00000040:1.0:1777497800.598149:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969484, xid 1863837546399232 00000100:00000040:1.0:1777497800.598161:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.598167:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.598216:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.598225:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.598230:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.598239:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 8 00010000:00080000:1.0:1777497800.598243:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00010000:00080000:1.0:1777497800.598247:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969485 00000100:00000040:2.0:1777497800.602362:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240866ffb80 x1863837546401152 msgsize 440 00000100:00100000:2.0:1777497800.602378:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.602470:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546401152 00000100:00100000:3.0:1777497800.602481:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546401152 00000020:00000040:3.0:1777497800.602484:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.602489:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=9 00000100:00000040:3.0:1777497800.602516:0:8403:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.602565:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1052 00000100:00000040:3.0:1777497800.602569:0:8403:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.602576:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240866ffb80 x1863837546401152/t0(4294969485) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.602589:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546401152:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.602601:0:8403:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866ffb80 x1863837546401152/t0(4294969485) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.602611:0:8403:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969485, current: 4294969485, replaying 00010000:00000040:3.0:1777497800.602615:0:8403:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.602633:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240866ffb80 x1863837546401152/t0(4294969485) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.602641:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240866ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546401152:12345-192.168.202.4@tcp:10:dd.0 Request processed in 54us (279us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.602647:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1052 00000100:00000040:3.0:1777497800.602650:0:8403:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.602712:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969485, next_transno: 4294969485 00010000:00080000:1.0:1777497800.602718:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969485) 00010000:00080000:1.0:1777497800.602735:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546401152 t4294969485 from 192.168.202.4@tcp req@ffff9240866ffb80 x1863837546401152/t0(4294969485) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.602752:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240866ffb80 x1863837546401152/t0(4294969485) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1777497800.602781:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x369:0x0] 00000001:00000040:1.0:1777497800.602958:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 5 00000020:00000040:1.0:1777497800.602961:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=10 00010000:00000040:1.0:1777497800.602996:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969485, xid 1863837546401152 00000100:00000040:1.0:1777497800.603007:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.603012:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.603137:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.603146:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.603151:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.603161:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 9 00010000:00080000:1.0:1777497800.603164:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00010000:00080000:1.0:1777497800.603168:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969486 00000100:00000040:0.0:1777497800.617454:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2a680 x1863837546402816 msgsize 440 00000100:00100000:0.0:1777497800.617481:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.617589:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402816 00000100:00100000:3.0:1777497800.617599:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402816 00000020:00000040:3.0:1777497800.617602:0:24910:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.617606:0:24910:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=10 00000100:00000040:3.0:1777497800.617632:0:24910:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.617692:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00000040:3.0:1777497800.617695:0:24910:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.617702:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2a680 x1863837546402816/t0(4294969486) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.617716:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+10:2411:x1863837546402816:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.617740:0:24910:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2a680 x1863837546402816/t0(4294969486) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.617749:0:24910:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969486, current: 4294969486, replaying 00010000:00000040:3.0:1777497800.617752:0:24910:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.617771:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2a680 x1863837546402816/t0(4294969486) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.617780:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+10:2411:x1863837546402816:12345-192.168.202.4@tcp:10:dd.0 Request processed in 67us (328us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.617787:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1053 00000100:00000040:3.0:1777497800.617790:0:24910:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.617869:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969486, next_transno: 4294969486 00010000:00080000:0.0:1777497800.617873:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969486) 00010000:00080000:0.0:1777497800.617882:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546402816 t4294969486 from 192.168.202.4@tcp req@ffff92409bf2a680 x1863837546402816/t0(4294969486) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.617898:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2a680 x1863837546402816/t0(4294969486) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.617928:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x365:0x0] 00000001:00000040:0.0:1777497800.618089:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 6 00000020:00000040:0.0:1777497800.618119:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=11 00010000:00000040:0.0:1777497800.618156:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969486, xid 1863837546402816 00000100:00000040:0.0:1777497800.618165:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.618172:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.618223:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.618232:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.618238:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.618248:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 10 00010000:00080000:0.0:1777497800.618260:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00010000:00080000:0.0:1777497800.618263:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969487 00000100:00000040:0.0:1777497800.622820:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2bb80 x1863837546402944 msgsize 440 00000100:00100000:0.0:1777497800.622835:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.622976:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546402944 00000100:00100000:2.0:1777497800.622986:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546402944 00000020:00000040:2.0:1777497800.622989:0:25314:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.622993:0:25314:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=11 00000100:00000040:2.0:1777497800.623017:0:25314:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.623064:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1054 00000100:00000040:2.0:1777497800.623069:0:25314:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.623076:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2bb80 x1863837546402944/t0(4294969487) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.623089:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+11:2411:x1863837546402944:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:2.0:1777497800.623139:0:25314:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2bb80 x1863837546402944/t0(4294969487) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.623148:0:25314:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969487, current: 4294969487, replaying 00010000:00000040:2.0:1777497800.623152:0:25314:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.623160:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2bb80 x1863837546402944/t0(4294969487) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.623169:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+11:2411:x1863837546402944:12345-192.168.202.4@tcp:10:dd.0 Request processed in 83us (350us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.623176:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1054 00000100:00000040:2.0:1777497800.623194:0:25314:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.623259:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969487, next_transno: 4294969487 00010000:00080000:0.0:1777497800.623263:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969487) 00010000:00080000:0.0:1777497800.623271:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546402944 t4294969487 from 192.168.202.4@tcp req@ffff92409bf2bb80 x1863837546402944/t0(4294969487) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.623286:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2bb80 x1863837546402944/t0(4294969487) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.623316:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x368:0x0] 00000001:00000040:0.0:1777497800.623478:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 7 00000020:00000040:0.0:1777497800.623481:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=12 00010000:00000040:0.0:1777497800.623531:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969487, xid 1863837546402944 00000100:00000040:0.0:1777497800.623541:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.623548:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.623599:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.623608:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.623613:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.623622:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 11 00010000:00080000:0.0:1777497800.623626:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00010000:00080000:0.0:1777497800.623630:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969488 00000100:00000040:1.0:1777497800.653769:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d81f80 x1863837546403200 msgsize 440 00000100:00100000:1.0:1777497800.653782:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.654017:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546403200 00000100:00100000:3.0:1777497800.654028:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546403200 00000020:00000040:3.0:1777497800.654031:0:8401:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.654037:0:8401:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=12 00000100:00000040:3.0:1777497800.654063:0:8401:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.654140:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1055 00000100:00000040:3.0:1777497800.654144:0:8401:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.654152:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d81f80 x1863837546403200/t0(4294969488) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.654167:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+12:2411:x1863837546403200:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.654180:0:8401:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d81f80 x1863837546403200/t0(4294969488) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.654202:0:8401:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969488, current: 4294969488, replaying 00010000:00000040:3.0:1777497800.654205:0:8401:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.654218:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d81f80 x1863837546403200/t0(4294969488) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.654227:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+12:2411:x1863837546403200:12345-192.168.202.4@tcp:10:dd.0 Request processed in 64us (458us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.654234:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1055 00000100:00000040:3.0:1777497800.654237:0:8401:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497800.654254:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969488, next_transno: 4294969488 00010000:00080000:3.0:1777497800.654257:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969488) 00010000:00080000:3.0:1777497800.654265:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546403200 t4294969488 from 192.168.202.4@tcp req@ffff9240a6d81f80 x1863837546403200/t0(4294969488) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.654281:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d81f80 x1863837546403200/t0(4294969488) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1777497800.654308:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x367:0x0] 00000001:00000040:3.0:1777497800.654474:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 8 00000020:00000040:3.0:1777497800.654478:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=13 00010000:00000040:3.0:1777497800.654511:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969488, xid 1863837546403200 00000100:00000040:3.0:1777497800.654521:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.654526:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.654571:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.654580:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497800.654585:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.654595:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 12 00010000:00080000:3.0:1777497800.654599:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00010000:00080000:3.0:1777497800.654603:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969489 00000100:00000040:3.0:1777497800.657361:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff92409c252a00 x1863837546405632 msgsize 440 00000100:00100000:3.0:1777497800.657378:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.657673:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546405632 00000100:00100000:1.0:1777497800.657682:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546405632 00000020:00000040:1.0:1777497800.657686:0:24902:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.657689:0:24902:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=13 00000100:00000040:1.0:1777497800.657717:0:24902:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.657778:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1056 00000100:00000040:1.0:1777497800.657782:0:24902:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.657791:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c252a00 x1863837546405632/t0(4294969489) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.657805:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+13:2411:x1863837546405632:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:1.0:1777497800.657819:0:24902:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c252a00 x1863837546405632/t0(4294969489) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.657828:0:24902:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969489, current: 4294969489, replaying 00010000:00000040:1.0:1777497800.657831:0:24902:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.657845:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c252a00 x1863837546405632/t0(4294969489) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.657853:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+13:2411:x1863837546405632:12345-192.168.202.4@tcp:10:dd.0 Request processed in 51us (493us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.657872:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1056 00000100:00000040:1.0:1777497800.657874:0:24902:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.657890:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969489, next_transno: 4294969489 00010000:00080000:1.0:1777497800.657893:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969489) 00010000:00080000:1.0:1777497800.657901:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546405632 t4294969489 from 192.168.202.4@tcp req@ffff92409c252a00 x1863837546405632/t0(4294969489) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.657931:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c252a00 x1863837546405632/t0(4294969489) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1777497800.657959:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36a:0x0] 00000001:00000040:1.0:1777497800.658165:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 9 00000020:00000040:1.0:1777497800.658169:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=14 00010000:00000040:1.0:1777497800.658207:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969489, xid 1863837546405632 00000100:00000040:1.0:1777497800.658217:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.658223:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.658266:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.658275:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.658280:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.658290:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 13 00010000:00080000:1.0:1777497800.658294:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00010000:00080000:1.0:1777497800.658298:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969490 00000100:00000040:0.0:1777497800.685022:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29180 x1863837546406528 msgsize 440 00000100:00100000:0.0:1777497800.685036:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.685137:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546406528 00000100:00100000:2.0:1777497800.685149:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546406528 00000020:00000040:2.0:1777497800.685154:0:24903:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.685159:0:24903:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=14 00000100:00000040:2.0:1777497800.685190:0:24903:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.685245:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1057 00000100:00000040:2.0:1777497800.685249:0:24903:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.685260:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29180 x1863837546406528/t0(4294969490) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.685274:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+14:2411:x1863837546406528:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:2.0:1777497800.685286:0:24903:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf29180 x1863837546406528/t0(4294969490) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.685294:0:24903:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969490, current: 4294969490, replaying 00010000:00000040:2.0:1777497800.685298:0:24903:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.685312:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29180 x1863837546406528/t0(4294969490) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.685321:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+14:2411:x1863837546406528:12345-192.168.202.4@tcp:10:dd.0 Request processed in 50us (302us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.685327:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1057 00000100:00000040:2.0:1777497800.685331:0:24903:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.685347:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969490, next_transno: 4294969490 00010000:00080000:2.0:1777497800.685351:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969490) 00010000:00080000:2.0:1777497800.685357:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546406528 t4294969490 from 192.168.202.4@tcp req@ffff92409bf29180 x1863837546406528/t0(4294969490) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.685370:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf29180 x1863837546406528/t0(4294969490) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1777497800.685407:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36b:0x0] 00000001:00000040:2.0:1777497800.685830:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 10 00000020:00000040:2.0:1777497800.685835:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=15 00010000:00000040:2.0:1777497800.685886:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969490, xid 1863837546406528 00000100:00000040:2.0:1777497800.685897:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.685903:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.685953:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.685962:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.685967:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.685975:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 14 00010000:00080000:2.0:1777497800.685979:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00010000:00080000:2.0:1777497800.685982:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969491 00000100:00000040:0.0:1777497800.709335:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2b800 x1863837546407680 msgsize 1512 00000100:00100000:0.0:1777497800.709352:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.709407:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407680 00000100:00100000:0.0:1777497800.709424:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407680 00000020:00000040:0.0:1777497800.709428:0:24904:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.709434:0:24904:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=15 00000100:00000040:0.0:1777497800.709459:0:24904:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.709760:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1058 00000100:00000040:0.0:1777497800.709764:0:24904:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.709770:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2b800 x1863837546407680/t0(4294969491) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.709784:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+15:2411:x1863837546407680:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497800.709795:0:24904:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2b800 x1863837546407680/t0(4294969491) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.709804:0:24904:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969491, current: 4294969491, replaying 00010000:00000040:0.0:1777497800.709807:0:24904:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.709817:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2b800 x1863837546407680/t0(4294969491) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.709824:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+15:2411:x1863837546407680:12345-192.168.202.4@tcp:4:dd.0 Request processed in 44us (491us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.709830:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1058 00000100:00000040:0.0:1777497800.709833:0:24904:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.709851:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969491, next_transno: 4294969491 00010000:00080000:0.0:1777497800.709854:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969491) 00010000:00080000:0.0:1777497800.709861:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546407680 t4294969491 from 192.168.202.4@tcp req@ffff92409bf2b800 x1863837546407680/t0(4294969491) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.709874:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2b800 x1863837546407680/t0(4294969491) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.709909:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x0:0x0] 00002000:00080000:0.0:1777497800.710012:0:93031:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00000020:00000040:0.0:1777497800.710074:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1777497800.710218:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:0.0:1777497800.710223:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1777497800.710453:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 11 00000020:00000040:0.0:1777497800.710458:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=16 00010000:00000040:0.0:1777497800.719669:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969491, xid 1863837546407680 00000100:00000040:0.0:1777497800.719700:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.719709:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.719777:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.719790:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.719798:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.719810:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 15 00010000:00080000:0.0:1777497800.719816:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00010000:00080000:0.0:1777497800.719820:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969492 00000100:00000040:0.0:1777497800.729892:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf2b100 x1863837546407552 msgsize 440 00000100:00100000:0.0:1777497800.729909:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.729964:0:8402:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546407552 00000100:00100000:2.0:1777497800.729974:0:8402:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546407552 00000020:00000040:2.0:1777497800.729978:0:8402:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.729982:0:8402:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=16 00000100:00000040:2.0:1777497800.730012:0:8402:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.730061:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1059 00000100:00000040:2.0:1777497800.730066:0:8402:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.730072:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf2b100 x1863837546407552/t0(4294969492) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.730119:0:8402:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+16:2411:x1863837546407552:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:2.0:1777497800.730132:0:8402:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2b100 x1863837546407552/t0(4294969492) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.730141:0:8402:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969492, current: 4294969492, replaying 00010000:00000040:2.0:1777497800.730145:0:8402:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.730169:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf2b100 x1863837546407552/t0(4294969492) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.730175:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969492, next_transno: 4294969492 00000100:00100000:2.0:1777497800.730177:0:8402:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+16:2411:x1863837546407552:12345-192.168.202.4@tcp:10:dd.0 Request processed in 84us (286us total) trans 0 rc 0/-999 00010000:00080000:0.0:1777497800.730179:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969492) 00000100:00100000:2.0:1777497800.730185:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1059 00010000:00080000:0.0:1777497800.730186:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546407552 t4294969492 from 192.168.202.4@tcp req@ffff92409bf2b100 x1863837546407552/t0(4294969492) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00000040:2.0:1777497800.730188:0:8402:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00000020:00000040:0.0:1777497800.730201:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf2b100 x1863837546407552/t0(4294969492) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.730231:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x375:0x0] 00000001:00000040:0.0:1777497800.730405:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 12 00000020:00000040:0.0:1777497800.730409:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=17 00010000:00000040:0.0:1777497800.730445:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969492, xid 1863837546407552 00000100:00000040:0.0:1777497800.730455:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.730467:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.730513:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.730523:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.730528:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.730537:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 16 00010000:00080000:0.0:1777497800.730541:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00010000:00080000:0.0:1777497800.730545:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969493 00000100:00000040:1.0:1777497800.736572:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d83800 x1863837546408960 msgsize 1512 00000100:00100000:1.0:1777497800.736588:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.737527:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546408960 00000100:00100000:0.0:1777497800.737541:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546408960 00000020:00000040:0.0:1777497800.737544:0:24168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.737548:0:24168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=17 00000100:00000040:0.0:1777497800.737575:0:24168:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.737634:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1060 00000100:00000040:0.0:1777497800.737639:0:24168:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.737647:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d83800 x1863837546408960/t0(4294969493) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.737662:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+17:2411:x1863837546408960:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497800.737674:0:24168:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d83800 x1863837546408960/t0(4294969493) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.737684:0:24168:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969493, current: 4294969493, replaying 00010000:00000040:0.0:1777497800.737688:0:24168:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.737697:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d83800 x1863837546408960/t0(4294969493) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.737706:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+17:2411:x1863837546408960:12345-192.168.202.4@tcp:4:dd.0 Request processed in 47us (1134us total) trans 0 rc 0/-999 00010000:00080000:1.0:1777497800.737711:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969493, next_transno: 4294969493 00000100:00100000:0.0:1777497800.737712:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1060 00000100:00000040:0.0:1777497800.737715:0:24168:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.737716:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969493) 00010000:00080000:1.0:1777497800.737731:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546408960 t4294969493 from 192.168.202.4@tcp req@ffff9240a6d83800 x1863837546408960/t0(4294969493) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.737746:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d83800 x1863837546408960/t0(4294969493) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.737842:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1777497800.737871:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:1.0:1777497800.737874:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1777497800.738123:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 13 00000020:00000040:1.0:1777497800.738964:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=18 00010000:00000040:1.0:1777497800.739353:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969493, xid 1863837546408960 00000100:00000040:1.0:1777497800.739368:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.739375:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.739429:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.739441:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.739448:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.739460:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 17 00010000:00080000:1.0:1777497800.739476:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00010000:00080000:1.0:1777497800.739481:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969494 00000100:00000040:1.0:1777497800.746418:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d83100 x1863837546409216 msgsize 440 00000100:00100000:1.0:1777497800.746435:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.746490:0:24914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546409216 00000100:00100000:1.0:1777497800.746502:0:24914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546409216 00000020:00000040:1.0:1777497800.746505:0:24914:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.746509:0:24914:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=18 00000100:00000040:1.0:1777497800.746537:0:24914:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.746577:0:24914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1061 00000100:00000040:1.0:1777497800.746581:0:24914:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.746590:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d83100 x1863837546409216/t0(4294969494) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.746603:0:24914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+18:2411:x1863837546409216:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:1.0:1777497800.746614:0:24914:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d83100 x1863837546409216/t0(4294969494) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.746623:0:24914:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969494, current: 4294969494, replaying 00010000:00000040:1.0:1777497800.746626:0:24914:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.746635:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d83100 x1863837546409216/t0(4294969494) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.746655:0:24914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+18:2411:x1863837546409216:12345-192.168.202.4@tcp:10:dd.0 Request processed in 53us (241us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.746662:0:24914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1061 00000100:00000040:1.0:1777497800.746666:0:24914:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.746688:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969494, next_transno: 4294969494 00010000:00080000:1.0:1777497800.746691:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969494) 00010000:00080000:1.0:1777497800.746698:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546409216 t4294969494 from 192.168.202.4@tcp req@ffff9240a6d83100 x1863837546409216/t0(4294969494) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.746713:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d83100 x1863837546409216/t0(4294969494) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1777497800.746752:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36c:0x0] 00000001:00000040:1.0:1777497800.746895:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 14 00000020:00000040:1.0:1777497800.746898:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=19 00010000:00000040:1.0:1777497800.746929:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969494, xid 1863837546409216 00000100:00000040:1.0:1777497800.746939:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.746944:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.746989:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.746997:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.747001:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.747009:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 18 00010000:00080000:1.0:1777497800.747013:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00010000:00080000:1.0:1777497800.747017:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969495 00000100:00000040:0.0:1777497800.768222:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf29500 x1863837546410368 msgsize 1512 00000100:00100000:0.0:1777497800.768240:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.768408:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410368 00000100:00100000:3.0:1777497800.768420:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410368 00000020:00000040:3.0:1777497800.768423:0:24658:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.768427:0:24658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=19 00000100:00000040:3.0:1777497800.768452:0:24658:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.768501:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1062 00000100:00000040:3.0:1777497800.768505:0:24658:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.768514:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf29500 x1863837546410368/t0(4294969495) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.768539:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:2411:x1863837546410368:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:3.0:1777497800.768551:0:24658:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf29500 x1863837546410368/t0(4294969495) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.768559:0:24658:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969495, current: 4294969495, replaying 00010000:00000040:3.0:1777497800.768562:0:24658:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.768579:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf29500 x1863837546410368/t0(4294969495) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.768587:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+19:2411:x1863837546410368:12345-192.168.202.4@tcp:4:dd.0 Request processed in 51us (366us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.768593:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1062 00000100:00000040:3.0:1777497800.768596:0:24658:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.770303:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969495, next_transno: 4294969495 00010000:00080000:1.0:1777497800.770311:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969495) 00010000:00080000:1.0:1777497800.770327:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546410368 t4294969495 from 192.168.202.4@tcp req@ffff92409bf29500 x1863837546410368/t0(4294969495) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.770378:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf29500 x1863837546410368/t0(4294969495) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.771681:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1777497800.771713:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:1.0:1777497800.771716:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000020:00000040:1.0:1777497800.771743:0:93031:0:(tgt_handler.c:2937:tgt_brw_write()) Checksum 1024 from 12345-192.168.202.4@tcp OK: 94cf3aac 00000001:00000040:1.0:1777497800.772759:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 15 00000020:00000040:1.0:1777497800.772766:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=20 00010000:00000040:1.0:1777497800.772814:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969495, xid 1863837546410368 00000100:00000040:1.0:1777497800.772829:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.772836:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.772952:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.772967:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.772976:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.772989:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 19 00010000:00080000:1.0:1777497800.772995:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00010000:00080000:1.0:1777497800.772999:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969496 00000100:00000040:3.0:1777497800.778330:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff92409c251c00 x1863837546410624 msgsize 440 00000100:00100000:3.0:1777497800.778345:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.778578:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546410624 00000100:00100000:0.0:1777497800.778589:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546410624 00000020:00000040:0.0:1777497800.778592:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.778596:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=20 00000100:00000040:0.0:1777497800.778626:0:8403:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.778681:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1063 00000100:00000040:0.0:1777497800.778685:0:8403:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.778692:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c251c00 x1863837546410624/t0(4294969496) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.778705:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+20:2411:x1863837546410624:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:0.0:1777497800.778716:0:8403:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c251c00 x1863837546410624/t0(4294969496) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.778734:0:8403:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969496, current: 4294969496, replaying 00010000:00000040:0.0:1777497800.778737:0:8403:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.778750:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c251c00 x1863837546410624/t0(4294969496) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.778759:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c251c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+20:2411:x1863837546410624:12345-192.168.202.4@tcp:10:dd.0 Request processed in 57us (430us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.778765:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1063 00000100:00000040:0.0:1777497800.778768:0:8403:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.778785:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969496, next_transno: 4294969496 00010000:00080000:0.0:1777497800.778789:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969496) 00010000:00080000:0.0:1777497800.778796:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546410624 t4294969496 from 192.168.202.4@tcp req@ffff92409c251c00 x1863837546410624/t0(4294969496) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.778831:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c251c00 x1863837546410624/t0(4294969496) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.778858:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36d:0x0] 00000001:00000040:0.0:1777497800.779014:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 16 00000020:00000040:0.0:1777497800.779018:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=21 00010000:00000040:0.0:1777497800.779052:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969496, xid 1863837546410624 00000100:00000040:0.0:1777497800.779061:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.779067:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.779141:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.779150:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.779155:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.779165:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 20 00010000:00080000:0.0:1777497800.779168:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00010000:00080000:0.0:1777497800.779172:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969497 00000100:00000040:3.0:1777497800.782369:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409c250700 x1863837546411392 msgsize 1512 00000100:00100000:3.0:1777497800.782385:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.782652:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546411392 00000100:00100000:0.0:1777497800.782662:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546411392 00000020:00000040:0.0:1777497800.782665:0:24910:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.782669:0:24910:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=21 00000100:00000040:0.0:1777497800.782694:0:24910:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.782750:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1064 00000100:00000040:0.0:1777497800.782756:0:24910:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.782762:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409c250700 x1863837546411392/t0(4294969497) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.782775:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+21:2411:x1863837546411392:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497800.782786:0:24910:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c250700 x1863837546411392/t0(4294969497) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.782806:0:24910:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969497, current: 4294969497, replaying 00010000:00000040:0.0:1777497800.782809:0:24910:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.782821:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409c250700 x1863837546411392/t0(4294969497) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.782830:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409c250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+21:2411:x1863837546411392:12345-192.168.202.4@tcp:4:dd.0 Request processed in 58us (461us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.782837:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1064 00000100:00000040:0.0:1777497800.782840:0:24910:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.782858:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969497, next_transno: 4294969497 00010000:00080000:0.0:1777497800.782862:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969497) 00010000:00080000:0.0:1777497800.782868:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546411392 t4294969497 from 192.168.202.4@tcp req@ffff92409c250700 x1863837546411392/t0(4294969497) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.782884:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409c250700 x1863837546411392/t0(4294969497) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.782964:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1777497800.782994:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:0.0:1777497800.782997:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1777497800.783330:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 17 00000020:00000040:0.0:1777497800.783335:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=22 00010000:00000040:0.0:1777497800.788408:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969497, xid 1863837546411392 00000100:00000040:0.0:1777497800.788429:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.788437:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.788504:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.788519:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.788529:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.788542:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 21 00010000:00080000:0.0:1777497800.788556:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00010000:00080000:0.0:1777497800.788560:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969498 00000100:00000040:3.0:1777497800.794809:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b3100 x1863837546412288 msgsize 440 00000100:00100000:3.0:1777497800.794830:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.795511:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412288 00000100:00100000:1.0:1777497800.795522:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412288 00000020:00000040:1.0:1777497800.795525:0:25314:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.795529:0:25314:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=22 00000100:00000040:1.0:1777497800.795555:0:25314:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.795594:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1065 00000100:00000040:1.0:1777497800.795598:0:25314:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.795604:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b3100 x1863837546412288/t0(4294969498) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.795616:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+22:2411:x1863837546412288:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:1.0:1777497800.795634:0:25314:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b50b3100 x1863837546412288/t0(4294969498) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.795643:0:25314:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969498, current: 4294969498, replaying 00010000:00000040:1.0:1777497800.795646:0:25314:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.795656:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b3100 x1863837546412288/t0(4294969498) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.795665:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+22:2411:x1863837546412288:12345-192.168.202.4@tcp:10:dd.0 Request processed in 50us (856us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.795672:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1065 00000100:00000040:1.0:1777497800.795675:0:25314:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.797296:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969498, next_transno: 4294969498 00010000:00080000:0.0:1777497800.797303:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969498) 00010000:00080000:0.0:1777497800.797316:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546412288 t4294969498 from 192.168.202.4@tcp req@ffff9240b50b3100 x1863837546412288/t0(4294969498) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.797339:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b50b3100 x1863837546412288/t0(4294969498) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.797370:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36e:0x0] 00000001:00000040:0.0:1777497800.797524:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 18 00000020:00000040:0.0:1777497800.797529:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=23 00010000:00000040:0.0:1777497800.797562:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969498, xid 1863837546412288 00000100:00000040:0.0:1777497800.797572:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.797578:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.797639:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.797650:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.797656:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.797667:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 22 00010000:00080000:0.0:1777497800.797671:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00010000:00080000:0.0:1777497800.797674:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969499 00000100:00000040:1.0:1777497800.812939:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d81180 x1863837546412416 msgsize 1512 00000100:00100000:1.0:1777497800.812954:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.813280:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546412416 00000100:00100000:2.0:1777497800.813290:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546412416 00000020:00000040:2.0:1777497800.813293:0:24168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.813297:0:24168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=23 00000100:00000040:2.0:1777497800.813320:0:24168:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.813373:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1066 00000100:00000040:2.0:1777497800.813377:0:24168:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.813384:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d81180 x1863837546412416/t0(4294969499) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.813397:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+23:2411:x1863837546412416:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497800.813409:0:24168:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d81180 x1863837546412416/t0(4294969499) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.813418:0:24168:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969499, current: 4294969499, replaying 00010000:00000040:2.0:1777497800.813421:0:24168:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.813439:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d81180 x1863837546412416/t0(4294969499) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.813448:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+23:2411:x1863837546412416:12345-192.168.202.4@tcp:4:dd.0 Request processed in 53us (509us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.813454:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1066 00000100:00000040:2.0:1777497800.813457:0:24168:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.813603:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969499, next_transno: 4294969499 00010000:00080000:0.0:1777497800.813608:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969499) 00010000:00080000:0.0:1777497800.813616:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546412416 t4294969499 from 192.168.202.4@tcp req@ffff9240a6d81180 x1863837546412416/t0(4294969499) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.813632:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d81180 x1863837546412416/t0(4294969499) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.813739:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1777497800.813768:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:0.0:1777497800.813771:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1777497800.813992:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 19 00000020:00000040:0.0:1777497800.813997:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=24 00010000:00000040:2.0:1777497800.818086:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969499, xid 1863837546412416 00000100:00000040:2.0:1777497800.818139:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.818149:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.818206:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.818220:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.818229:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.818241:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 23 00010000:00080000:2.0:1777497800.818247:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00010000:00080000:2.0:1777497800.818251:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969500 00000100:00000040:0.0:1777497800.837297:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff92409bf28700 x1863837546413952 msgsize 1512 00000100:00100000:0.0:1777497800.837314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.838986:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546413952 00000100:00100000:1.0:1777497800.839000:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546413952 00000020:00000040:1.0:1777497800.839003:0:24902:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.839007:0:24902:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=24 00000100:00000040:1.0:1777497800.839036:0:24902:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.839107:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1067 00000100:00000040:1.0:1777497800.839112:0:24902:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.839120:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff92409bf28700 x1863837546413952/t0(4294969500) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.839145:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff92409bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+24:2411:x1863837546413952:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:1.0:1777497800.839157:0:24902:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf28700 x1863837546413952/t0(4294969500) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.839168:0:24902:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969500, current: 4294969500, replaying 00010000:00000040:1.0:1777497800.839177:0:24902:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.839193:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff92409bf28700 x1863837546413952/t0(4294969500) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.839202:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff92409bf28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+24:2411:x1863837546413952:12345-192.168.202.4@tcp:4:dd.0 Request processed in 61us (1906us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.839209:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1067 00000100:00000040:1.0:1777497800.839212:0:24902:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.839230:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969500, next_transno: 4294969500 00010000:00080000:1.0:1777497800.839233:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969500) 00010000:00080000:1.0:1777497800.839241:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546413952 t4294969500 from 192.168.202.4@tcp req@ffff92409bf28700 x1863837546413952/t0(4294969500) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.839255:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff92409bf28700 x1863837546413952/t0(4294969500) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.839343:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1777497800.839376:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:1.0:1777497800.839379:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1777497800.839629:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 20 00000020:00000040:1.0:1777497800.839633:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=25 00010000:00000040:1.0:1777497800.840198:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969500, xid 1863837546413952 00000100:00000040:1.0:1777497800.840212:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.840218:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.840276:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.840287:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.840294:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.840305:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 24 00010000:00080000:1.0:1777497800.840309:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00010000:00080000:1.0:1777497800.840313:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969501 00000100:00000040:0.0:1777497800.848288:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e3480 x1863837546414208 msgsize 440 00000100:00100000:0.0:1777497800.848304:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.848355:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414208 00000100:00100000:3.0:1777497800.848366:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414208 00000020:00000040:3.0:1777497800.848369:0:24903:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.848373:0:24903:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=25 00000100:00000040:3.0:1777497800.848398:0:24903:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.848448:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1068 00000100:00000040:3.0:1777497800.848452:0:24903:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.848459:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e3480 x1863837546414208/t0(4294969501) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.848473:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+25:2411:x1863837546414208:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.848484:0:24903:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3480 x1863837546414208/t0(4294969501) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.848493:0:24903:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969501, current: 4294969501, replaying 00010000:00000040:3.0:1777497800.848496:0:24903:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.848525:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e3480 x1863837546414208/t0(4294969501) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.848535:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+25:2411:x1863837546414208:12345-192.168.202.4@tcp:10:dd.0 Request processed in 64us (248us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.848542:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1068 00000100:00000040:3.0:1777497800.848545:0:24903:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.848569:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969501, next_transno: 4294969501 00010000:00080000:2.0:1777497800.848574:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969501) 00010000:00080000:2.0:1777497800.848582:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546414208 t4294969501 from 192.168.202.4@tcp req@ffff923f861e3480 x1863837546414208/t0(4294969501) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.848598:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3480 x1863837546414208/t0(4294969501) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1777497800.848628:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x36f:0x0] 00000001:00000040:2.0:1777497800.848801:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 21 00000020:00000040:2.0:1777497800.848806:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=26 00010000:00000040:2.0:1777497800.848841:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969501, xid 1863837546414208 00000100:00000040:2.0:1777497800.848853:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.849259:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.849322:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.849333:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.849339:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.849350:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 25 00010000:00080000:2.0:1777497800.849355:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00010000:00080000:2.0:1777497800.849359:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969502 00000100:00000040:3.0:1777497800.857541:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b50b1880 x1863837546415872 msgsize 440 00000100:00100000:3.0:1777497800.857558:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.857675:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546415872 00000100:00100000:0.0:1777497800.857686:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546415872 00000020:00000040:0.0:1777497800.857689:0:24904:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.857693:0:24904:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=26 00000100:00000040:0.0:1777497800.857715:0:24904:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.857770:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1069 00000100:00000040:0.0:1777497800.857774:0:24904:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.857782:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b50b1880 x1863837546415872/t0(4294969502) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.857797:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+26:2411:x1863837546415872:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:0.0:1777497800.857808:0:24904:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b50b1880 x1863837546415872/t0(4294969502) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.857817:0:24904:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969502, current: 4294969502, replaying 00010000:00000040:0.0:1777497800.857820:0:24904:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.857835:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b50b1880 x1863837546415872/t0(4294969502) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.857843:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b50b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+26:2411:x1863837546415872:12345-192.168.202.4@tcp:10:dd.0 Request processed in 48us (303us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.857862:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1069 00000100:00000040:0.0:1777497800.857865:0:24904:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.857921:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969502, next_transno: 4294969502 00010000:00080000:2.0:1777497800.857930:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969502) 00010000:00080000:2.0:1777497800.857937:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546415872 t4294969502 from 192.168.202.4@tcp req@ffff9240b50b1880 x1863837546415872/t0(4294969502) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.857952:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b50b1880 x1863837546415872/t0(4294969502) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1777497800.857979:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x370:0x0] 00000001:00000040:2.0:1777497800.858275:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 22 00000020:00000040:2.0:1777497800.858279:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=27 00010000:00000040:2.0:1777497800.858314:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969502, xid 1863837546415872 00000100:00000040:2.0:1777497800.858323:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.858329:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.858627:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.858640:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.858645:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.858654:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 26 00010000:00080000:2.0:1777497800.858658:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 00010000:00080000:2.0:1777497800.858661:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969503 40000000:00000040:1.0:1777497800.863083:0:93131:0:(lproc_fid.c:544:ldebugfs_client_fid_width_seq_write()) cli-lustre-OST0000-super: Sequence size: 65536 00000100:00000040:3.0:1777497800.863147:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f8606a680 x1863837546414848 msgsize 1512 00000100:00100000:3.0:1777497800.863159:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.863349:0:8402:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546414848 00000100:00100000:0.0:1777497800.863358:0:8402:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546414848 00000020:00000040:0.0:1777497800.863362:0:8402:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.863366:0:8402:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=27 00000100:00000040:0.0:1777497800.863390:0:8402:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.863438:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1070 00000100:00000040:0.0:1777497800.863442:0:8402:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.863449:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f8606a680 x1863837546414848/t0(4294969503) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.864234:0:8402:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+27:2411:x1863837546414848:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497800.864254:0:8402:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f8606a680 x1863837546414848/t0(4294969503) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.864263:0:8402:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969503, current: 4294969503, replaying 00010000:00000040:0.0:1777497800.864266:0:8402:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.864274:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f8606a680 x1863837546414848/t0(4294969503) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.864283:0:8402:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+27:2411:x1863837546414848:12345-192.168.202.4@tcp:4:dd.0 Request processed in 824us (1135us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.864291:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1070 00000100:00000040:0.0:1777497800.864294:0:8402:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.864426:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969503, next_transno: 4294969503 00010000:00080000:2.0:1777497800.864431:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969503) 00010000:00080000:2.0:1777497800.864439:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546414848 t4294969503 from 192.168.202.4@tcp req@ffff923f8606a680 x1863837546414848/t0(4294969503) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.864456:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f8606a680 x1863837546414848/t0(4294969503) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.864559:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497800.864586:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497800.864589:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497800.864818:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 23 00000020:00000040:2.0:1777497800.864826:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=28 00010000:00010000:0.0:1777497800.866340:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00000040:2.0:1777497800.869077:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969503, xid 1863837546414848 00000100:00000040:2.0:1777497800.869131:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.869142:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.869195:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.869209:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.869218:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.869229:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 27 00010000:00080000:2.0:1777497800.869235:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00010000:00080000:2.0:1777497800.869239:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969504 00000100:00000040:0.0:1777497800.872479:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e1880 x1863837546416384 msgsize 1512 00000100:00100000:0.0:1777497800.872494:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.872587:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416384 00000100:00100000:1.0:1777497800.872598:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416384 00000020:00000040:1.0:1777497800.872601:0:8401:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.872606:0:8401:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=28 00000100:00000040:1.0:1777497800.872637:0:8401:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.872691:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1071 00000100:00000040:1.0:1777497800.872695:0:8401:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.872703:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e1880 x1863837546416384/t0(4294969504) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.872969:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+28:2411:x1863837546416384:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:1.0:1777497800.872985:0:8401:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1880 x1863837546416384/t0(4294969504) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.872992:0:8401:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969504, current: 4294969504, replaying 00010000:00000040:1.0:1777497800.872996:0:8401:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.873019:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e1880 x1863837546416384/t0(4294969504) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.873027:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+28:2411:x1863837546416384:12345-192.168.202.4@tcp:4:dd.0 Request processed in 313us (549us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.873033:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1071 00000100:00000040:1.0:1777497800.873036:0:8401:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497800.873122:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969504, next_transno: 4294969504 00010000:00080000:3.0:1777497800.873127:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969504) 00010000:00080000:3.0:1777497800.873148:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546416384 t4294969504 from 192.168.202.4@tcp req@ffff923f861e1880 x1863837546416384/t0(4294969504) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.873165:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1880 x1863837546416384/t0(4294969504) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.873265:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1777497800.873297:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:3.0:1777497800.873301:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1777497800.873777:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 24 00000020:00000040:3.0:1777497800.873782:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=29 00010000:00000040:3.0:1777497800.873974:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969504, xid 1863837546416384 00000100:00000040:3.0:1777497800.873988:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.873996:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.874056:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.874066:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497800.874073:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.874202:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 28 00010000:00080000:3.0:1777497800.874209:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00010000:00080000:3.0:1777497800.874213:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969505 00000100:00000040:0.0:1777497800.879384:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e3800 x1863837546416256 msgsize 440 00000100:00100000:0.0:1777497800.879408:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.879445:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546416256 00000100:00100000:0.0:1777497800.879454:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546416256 00000020:00000040:0.0:1777497800.879456:0:24168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.879460:0:24168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=29 00000100:00000040:0.0:1777497800.879485:0:24168:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.879542:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1072 00000100:00000040:0.0:1777497800.879546:0:24168:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.879554:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e3800 x1863837546416256/t0(4294969505) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.879567:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+29:2411:x1863837546416256:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:0.0:1777497800.879578:0:24168:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3800 x1863837546416256/t0(4294969505) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.879585:0:24168:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969505, current: 4294969505, replaying 00010000:00000040:0.0:1777497800.879588:0:24168:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.879612:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e3800 x1863837546416256/t0(4294969505) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.879620:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+29:2411:x1863837546416256:12345-192.168.202.4@tcp:10:dd.0 Request processed in 56us (237us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.879628:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1072 00000100:00000040:0.0:1777497800.879631:0:24168:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.879651:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969505, next_transno: 4294969505 00010000:00080000:0.0:1777497800.879655:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969505) 00010000:00080000:0.0:1777497800.879662:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546416256 t4294969505 from 192.168.202.4@tcp req@ffff923f861e3800 x1863837546416256/t0(4294969505) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.879686:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3800 x1863837546416256/t0(4294969505) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:0.0:1777497800.879735:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x371:0x0] 00000001:00000040:0.0:1777497800.879892:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 25 00000020:00000040:0.0:1777497800.879895:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=30 00010000:00000040:0.0:1777497800.879926:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969505, xid 1863837546416256 00000100:00000040:0.0:1777497800.879935:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.879941:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.879983:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.879992:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.879997:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.880006:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 29 00010000:00080000:0.0:1777497800.880009:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00010000:00080000:0.0:1777497800.880013:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969506 00000100:00000040:1.0:1777497800.894145:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d80e00 x1863837546417024 msgsize 1512 00000100:00100000:1.0:1777497800.894160:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.894750:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417024 00000100:00100000:3.0:1777497800.894763:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417024 00000020:00000040:3.0:1777497800.894767:0:24902:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.894772:0:24902:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=30 00000100:00000040:3.0:1777497800.894797:0:24902:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.894852:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1073 00000100:00000040:3.0:1777497800.894857:0:24902:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.894865:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d80e00 x1863837546417024/t0(4294969506) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.894879:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+30:2411:x1863837546417024:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:3.0:1777497800.894901:0:24902:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d80e00 x1863837546417024/t0(4294969506) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.894910:0:24902:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969506, current: 4294969506, replaying 00010000:00000040:3.0:1777497800.894914:0:24902:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.894927:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80e00 x1863837546417024/t0(4294969506) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.894936:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+30:2411:x1863837546417024:12345-192.168.202.4@tcp:4:dd.0 Request processed in 60us (792us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.894943:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1073 00000100:00000040:3.0:1777497800.894946:0:24902:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497800.894963:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969506, next_transno: 4294969506 00010000:00080000:3.0:1777497800.894966:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969506) 00010000:00080000:3.0:1777497800.894973:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546417024 t4294969506 from 192.168.202.4@tcp req@ffff9240a6d80e00 x1863837546417024/t0(4294969506) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.894986:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d80e00 x1863837546417024/t0(4294969506) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.895091:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1777497800.895137:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:3.0:1777497800.895141:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1777497800.895344:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 26 00000020:00000040:3.0:1777497800.895348:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=31 00010000:00000040:3.0:1777497800.895889:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969506, xid 1863837546417024 00000100:00000040:3.0:1777497800.895903:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.895909:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.895959:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.895970:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497800.895984:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.895994:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 30 00010000:00080000:3.0:1777497800.895998:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00010000:00080000:3.0:1777497800.896002:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969507 00000100:00000040:0.0:1777497800.903141:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e2d80 x1863837546417664 msgsize 440 00000100:00100000:0.0:1777497800.903157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497800.905860:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546417664 00000100:00100000:3.0:1777497800.905875:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546417664 00000020:00000040:3.0:1777497800.905878:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497800.905883:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=31 00000100:00000040:3.0:1777497800.905916:0:8403:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497800.905977:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1074 00000100:00000040:3.0:1777497800.905982:0:8403:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497800.905989:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e2d80 x1863837546417664/t0(4294969507) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.906004:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+31:2411:x1863837546417664:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:3.0:1777497800.906014:0:8403:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2d80 x1863837546417664/t0(4294969507) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497800.906022:0:8403:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969507, current: 4294969507, replaying 00010000:00000040:3.0:1777497800.906025:0:8403:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497800.906039:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e2d80 x1863837546417664/t0(4294969507) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497800.906048:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+31:2411:x1863837546417664:12345-192.168.202.4@tcp:10:dd.0 Request processed in 47us (2907us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497800.906054:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1074 00000100:00000040:3.0:1777497800.906058:0:8403:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497800.906076:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969507, next_transno: 4294969507 00010000:00080000:3.0:1777497800.906079:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969507) 00010000:00080000:3.0:1777497800.906122:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546417664 t4294969507 from 192.168.202.4@tcp req@ffff923f861e2d80 x1863837546417664/t0(4294969507) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497800.906138:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2d80 x1863837546417664/t0(4294969507) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:3.0:1777497800.906165:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x372:0x0] 00000001:00000040:3.0:1777497800.906328:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 27 00000020:00000040:3.0:1777497800.906332:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=32 00010000:00000040:3.0:1777497800.906369:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969507, xid 1863837546417664 00000100:00000040:3.0:1777497800.906379:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497800.906385:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497800.906440:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497800.906449:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497800.906454:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497800.906464:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 31 00010000:00080000:3.0:1777497800.906468:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00010000:00080000:3.0:1777497800.906471:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969508 00000100:00000040:2.0:1777497800.921820:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba4000 x1863837546418816 msgsize 1512 00000100:00100000:2.0:1777497800.921834:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.921868:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418816 00000100:00100000:2.0:1777497800.921878:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418816 00000020:00000040:2.0:1777497800.921881:0:24910:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.921885:0:24910:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=32 00000100:00000040:2.0:1777497800.921908:0:24910:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.921951:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1075 00000100:00000040:2.0:1777497800.921955:0:24910:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.921963:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba4000 x1863837546418816/t0(4294969508) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.921976:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+32:2411:x1863837546418816:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497800.921986:0:24910:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba4000 x1863837546418816/t0(4294969508) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.921996:0:24910:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969508, current: 4294969508, replaying 00010000:00000040:2.0:1777497800.921999:0:24910:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.922010:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4000 x1863837546418816/t0(4294969508) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.922033:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+32:2411:x1863837546418816:12345-192.168.202.4@tcp:4:dd.0 Request processed in 59us (212us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.922039:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1075 00000100:00000040:2.0:1777497800.922042:0:24910:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.922064:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969508, next_transno: 4294969508 00010000:00080000:2.0:1777497800.922067:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969508) 00010000:00080000:2.0:1777497800.922074:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546418816 t4294969508 from 192.168.202.4@tcp req@ffff9240b5ba4000 x1863837546418816/t0(4294969508) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.922090:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba4000 x1863837546418816/t0(4294969508) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.922197:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497800.922224:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497800.922227:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497800.922453:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 28 00000020:00000040:2.0:1777497800.922458:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=33 00010000:00000040:2.0:1777497800.927291:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969508, xid 1863837546418816 00000100:00000040:2.0:1777497800.927310:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.927319:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.927366:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.927380:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.927389:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.927402:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 32 00010000:00080000:2.0:1777497800.927408:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00010000:00080000:2.0:1777497800.927411:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969509 00000100:00000040:3.0:1777497800.953233:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f86069180 x1863837546418688 msgsize 440 00000100:00100000:3.0:1777497800.953249:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497800.953507:0:8402:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546418688 00000100:00100000:1.0:1777497800.953517:0:8402:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546418688 00000020:00000040:1.0:1777497800.953521:0:8402:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497800.953526:0:8402:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=33 00000100:00000040:1.0:1777497800.953564:0:8402:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497800.953606:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1076 00000100:00000040:1.0:1777497800.953610:0:8402:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497800.953618:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f86069180 x1863837546418688/t0(4294969509) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.953631:0:8402:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+33:2411:x1863837546418688:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:1.0:1777497800.953643:0:8402:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86069180 x1863837546418688/t0(4294969509) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497800.953652:0:8402:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969509, current: 4294969509, replaying 00010000:00000040:1.0:1777497800.953656:0:8402:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497800.953669:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f86069180 x1863837546418688/t0(4294969509) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497800.953678:0:8402:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+33:2411:x1863837546418688:12345-192.168.202.4@tcp:10:dd.0 Request processed in 49us (445us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497800.953684:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1076 00000100:00000040:1.0:1777497800.953688:0:8402:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497800.953709:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969509, next_transno: 4294969509 00010000:00080000:1.0:1777497800.953713:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969509) 00010000:00080000:1.0:1777497800.953732:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546418688 t4294969509 from 192.168.202.4@tcp req@ffff923f86069180 x1863837546418688/t0(4294969509) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497800.953747:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86069180 x1863837546418688/t0(4294969509) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:1.0:1777497800.953773:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x373:0x0] 00000001:00000040:1.0:1777497800.953930:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 29 00000020:00000040:1.0:1777497800.953934:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=34 00010000:00000040:1.0:1777497800.953975:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969509, xid 1863837546418688 00000100:00000040:1.0:1777497800.953986:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497800.953992:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497800.954037:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497800.954046:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497800.954050:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497800.954058:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 33 00010000:00080000:1.0:1777497800.954062:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00010000:00080000:1.0:1777497800.954065:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969510 00000100:00000040:3.0:1777497800.958613:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f86068000 x1863837546419456 msgsize 1512 00000100:00100000:3.0:1777497800.958630:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.959604:0:24914:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419456 00000100:00100000:2.0:1777497800.959616:0:24914:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419456 00000020:00000040:2.0:1777497800.959628:0:24914:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.959632:0:24914:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=34 00000100:00000040:2.0:1777497800.959657:0:24914:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.959911:0:24914:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00000040:2.0:1777497800.959916:0:24914:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.959924:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f86068000 x1863837546419456/t0(4294969510) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.959938:0:24914:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+34:2411:x1863837546419456:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497800.959950:0:24914:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86068000 x1863837546419456/t0(4294969510) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.959958:0:24914:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969510, current: 4294969510, replaying 00010000:00000040:2.0:1777497800.959962:0:24914:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.959974:0:24914:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f86068000 x1863837546419456/t0(4294969510) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.959982:0:24914:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:d146155b-4321-4b14-9284-f644ed9631fb+34:2411:x1863837546419456:12345-192.168.202.4@tcp:4:dd.0 Request processed in 48us (1371us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.959988:0:24914:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1077 00000100:00000040:2.0:1777497800.959991:0:24914:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.968783:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969510, next_transno: 4294969510 00010000:00080000:2.0:1777497800.968791:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969510) 00010000:00080000:2.0:1777497800.968808:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546419456 t4294969510 from 192.168.202.4@tcp req@ffff923f86068000 x1863837546419456/t0(4294969510) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.968835:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86068000 x1863837546419456/t0(4294969510) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.968940:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497800.968977:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497800.968981:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497800.969247:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 30 00000020:00000040:2.0:1777497800.969251:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=35 00010000:00000040:2.0:1777497800.969860:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969510, xid 1863837546419456 00000100:00000040:2.0:1777497800.969874:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.969881:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.969938:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.969950:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.969958:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.969968:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 34 00010000:00080000:2.0:1777497800.969973:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00010000:00080000:2.0:1777497800.969977:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969511 00000100:00000040:3.0:1777497800.973935:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff923f8606b480 x1863837546419712 msgsize 440 00000100:00100000:3.0:1777497800.973950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497800.974040:0:24658:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419712 00000100:00100000:2.0:1777497800.974051:0:24658:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419712 00000020:00000040:2.0:1777497800.974054:0:24658:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497800.974058:0:24658:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=35 00000100:00000040:2.0:1777497800.974084:0:24658:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497800.974154:0:24658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1078 00000100:00000040:2.0:1777497800.974158:0:24658:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497800.974165:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f8606b480 x1863837546419712/t0(4294969511) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.974178:0:24658:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+35:2411:x1863837546419712:12345-192.168.202.4@tcp:10:dd.0 00000020:00000040:2.0:1777497800.974190:0:24658:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f8606b480 x1863837546419712/t0(4294969511) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497800.974199:0:24658:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969511, current: 4294969511, replaying 00010000:00000040:2.0:1777497800.974203:0:24658:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497800.974214:0:24658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f8606b480 x1863837546419712/t0(4294969511) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497800.974236:0:24658:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8606b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d146155b-4321-4b14-9284-f644ed9631fb+35:2411:x1863837546419712:12345-192.168.202.4@tcp:10:dd.0 Request processed in 60us (301us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497800.974242:0:24658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1078 00000100:00000040:2.0:1777497800.974246:0:24658:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497800.974264:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969511, next_transno: 4294969511 00010000:00080000:2.0:1777497800.974267:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969511) 00010000:00080000:2.0:1777497800.974274:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546419712 t4294969511 from 192.168.202.4@tcp req@ffff923f8606b480 x1863837546419712/t0(4294969511) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497800.974289:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f8606b480 x1863837546419712/t0(4294969511) o10->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 440/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00000040:2.0:1777497800.974317:0:93031:0:(ofd_dev.c:427:ofd_object_init()) object init, fid = [0x280000401:0x374:0x0] 00000001:00000040:2.0:1777497800.974472:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 31 00000020:00000040:2.0:1777497800.974476:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=36 00010000:00000040:2.0:1777497800.974509:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969511, xid 1863837546419712 00000100:00000040:2.0:1777497800.974535:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497800.974542:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497800.974586:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497800.974595:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497800.974600:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497800.974609:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 35 00010000:00080000:2.0:1777497800.974613:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00010000:00080000:2.0:1777497800.974617:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969512 00000100:00000040:1.0:1777497800.994222:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6d80000 x1863837546419840 msgsize 1512 00000100:00100000:1.0:1777497800.994238:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497800.994334:0:24903:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546419840 00000100:00100000:0.0:1777497800.994345:0:24903:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546419840 00000020:00000040:0.0:1777497800.994348:0:24903:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497800.994352:0:24903:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=36 00000100:00000040:0.0:1777497800.994377:0:24903:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:0.0:1777497800.994428:0:24903:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1079 00000100:00000040:0.0:1777497800.994433:0:24903:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497800.994440:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6d80000 x1863837546419840/t0(4294969512) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.994454:0:24903:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+36:2411:x1863837546419840:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497800.994466:0:24903:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d80000 x1863837546419840/t0(4294969512) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497800.994475:0:24903:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969512, current: 4294969512, replaying 00010000:00000040:0.0:1777497800.994488:0:24903:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497800.994502:0:24903:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6d80000 x1863837546419840/t0(4294969512) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497800.994522:0:24903:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6d80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:d146155b-4321-4b14-9284-f644ed9631fb+36:2411:x1863837546419840:12345-192.168.202.4@tcp:4:dd.0 Request processed in 60us (289us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497800.994529:0:24903:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1079 00000100:00000040:0.0:1777497800.994532:0:24903:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497800.994550:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969512, next_transno: 4294969512 00010000:00080000:0.0:1777497800.994553:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969512) 00010000:00080000:0.0:1777497800.994560:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546419840 t4294969512 from 192.168.202.4@tcp req@ffff9240a6d80000 x1863837546419840/t0(4294969512) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.994574:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240a6d80000 x1863837546419840/t0(4294969512) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:556/0 lens 1512/0 e 0 to 0 dl 1777497811 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497800.994668:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1777497800.994868:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:0.0:1777497800.994872:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1777497800.995582:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 32 00000020:00000040:0.0:1777497800.995588:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=37 00010000:00000040:0.0:1777497800.998148:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969512, xid 1863837546419840 00000100:00000040:0.0:1777497800.998171:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497800.998180:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497800.998242:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497800.998257:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497800.998266:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497800.998278:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 36 00010000:00080000:0.0:1777497800.998284:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00010000:00080000:0.0:1777497800.998288:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969513 00000100:00000040:2.0:1777497801.001638:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba6d80 x1863837546420096 msgsize 1512 00000100:00100000:2.0:1777497801.001655:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497801.001828:0:24904:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420096 00000100:00100000:0.0:1777497801.001839:0:24904:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420096 00000020:00000040:0.0:1777497801.001842:0:24904:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497801.001846:0:24904:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=37 00000100:00000040:0.0:1777497801.001871:0:24904:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +7s 00000100:00100000:0.0:1777497801.001922:0:24904:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00000040:0.0:1777497801.001926:0:24904:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:0.0:1777497801.001934:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba6d80 x1863837546420096/t0(4294969513) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497801.001948:0:24904:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+37:2411:x1863837546420096:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:0.0:1777497801.001960:0:24904:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba6d80 x1863837546420096/t0(4294969513) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:0.0:1777497801.001968:0:24904:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969513, current: 4294969513, replaying 00010000:00000040:0.0:1777497801.001972:0:24904:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497801.001992:0:24904:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba6d80 x1863837546420096/t0(4294969513) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:0.0:1777497801.002000:0:24904:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:d146155b-4321-4b14-9284-f644ed9631fb+37:2411:x1863837546420096:12345-192.168.202.4@tcp:4:dd.0 Request processed in 55us (362us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497801.002006:0:24904:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1080 00000100:00000040:0.0:1777497801.002009:0:24904:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:3.0:1777497801.002090:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969513, next_transno: 4294969513 00010000:00080000:3.0:1777497801.002119:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969513) 00010000:00080000:3.0:1777497801.002128:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546420096 t4294969513 from 192.168.202.4@tcp req@ffff9240b5ba6d80 x1863837546420096/t0(4294969513) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497801.002143:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba6d80 x1863837546420096/t0(4294969513) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:3.0:1777497801.002241:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:3.0:1777497801.002269:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:3.0:1777497801.002272:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:3.0:1777497801.002501:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 33 00000020:00000040:3.0:1777497801.002505:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=38 00010000:00000040:0.0:1777497801.009877:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969513, xid 1863837546420096 00000100:00000040:0.0:1777497801.009899:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:0.0:1777497801.009909:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:0.0:1777497801.009973:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:0.0:1777497801.009987:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:0.0:1777497801.009998:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:0.0:1777497801.010014:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 37 00010000:00080000:0.0:1777497801.010035:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00010000:00080000:0.0:1777497801.010040:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969514 00000100:00000040:3.0:1777497801.017155:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff923f86069500 x1863837546420352 msgsize 1512 00000100:00100000:3.0:1777497801.017170:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497801.018073:0:25314:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420352 00000100:00100000:2.0:1777497801.018086:0:25314:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420352 00000020:00000040:2.0:1777497801.018128:0:25314:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497801.018134:0:25314:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=38 00000100:00000040:2.0:1777497801.018162:0:25314:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497801.018216:0:25314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1081 00000100:00000040:2.0:1777497801.018220:0:25314:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497801.018227:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f86069500 x1863837546420352/t0(4294969514) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.018240:0:25314:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+38:2411:x1863837546420352:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497801.018252:0:25314:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86069500 x1863837546420352/t0(4294969514) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497801.018261:0:25314:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969514, current: 4294969514, replaying 00010000:00000040:2.0:1777497801.018265:0:25314:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497801.018279:0:25314:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f86069500 x1863837546420352/t0(4294969514) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.018288:0:25314:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86069500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:d146155b-4321-4b14-9284-f644ed9631fb+38:2411:x1863837546420352:12345-192.168.202.4@tcp:4:dd.0 Request processed in 50us (1134us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497801.018294:0:25314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1081 00000100:00000040:2.0:1777497801.018297:0:25314:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497801.018313:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969514, next_transno: 4294969514 00010000:00080000:2.0:1777497801.018317:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969514) 00010000:00080000:2.0:1777497801.018325:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546420352 t4294969514 from 192.168.202.4@tcp req@ffff923f86069500 x1863837546420352/t0(4294969514) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.018339:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86069500 x1863837546420352/t0(4294969514) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.018432:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497801.018468:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497801.018472:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497801.020165:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 34 00000020:00000040:2.0:1777497801.020173:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=39 00010000:00000040:2.0:1777497801.020222:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969514, xid 1863837546420352 00000100:00000040:2.0:1777497801.020237:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497801.020245:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497801.020292:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497801.020305:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497801.020313:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497801.020325:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 38 00010000:00080000:2.0:1777497801.020330:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00010000:00080000:2.0:1777497801.020334:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969515 00000100:00000040:0.0:1777497801.026585:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e3100 x1863837546420864 msgsize 1512 00000100:00100000:0.0:1777497801.026601:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497801.026804:0:8401:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546420864 00000100:00100000:3.0:1777497801.026815:0:8401:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546420864 00000020:00000040:3.0:1777497801.026818:0:8401:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.026823:0:8401:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=39 00000100:00000040:3.0:1777497801.026847:0:8401:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:3.0:1777497801.026896:0:8401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1082 00000100:00000040:3.0:1777497801.026901:0:8401:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:3.0:1777497801.026907:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e3100 x1863837546420864/t0(4294969515) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497801.026922:0:8401:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+39:2411:x1863837546420864:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:3.0:1777497801.026933:0:8401:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3100 x1863837546420864/t0(4294969515) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:3.0:1777497801.026942:0:8401:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969515, current: 4294969515, replaying 00010000:00000040:3.0:1777497801.026944:0:8401:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:3.0:1777497801.026964:0:8401:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e3100 x1863837546420864/t0(4294969515) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:3.0:1777497801.026974:0:8401:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d146155b-4321-4b14-9284-f644ed9631fb+39:2411:x1863837546420864:12345-192.168.202.4@tcp:4:dd.0 Request processed in 54us (388us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.026980:0:8401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1082 00000100:00000040:3.0:1777497801.026993:0:8401:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497801.029957:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969515, next_transno: 4294969515 00010000:00080000:2.0:1777497801.029968:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969515) 00010000:00080000:2.0:1777497801.029985:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546420864 t4294969515 from 192.168.202.4@tcp req@ffff923f861e3100 x1863837546420864/t0(4294969515) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.030013:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e3100 x1863837546420864/t0(4294969515) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.030153:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497801.030182:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497801.030186:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497801.030415:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 35 00000020:00000040:2.0:1777497801.030419:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=40 00010000:00000040:3.0:1777497801.031728:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969515, xid 1863837546420864 00000100:00000040:3.0:1777497801.031745:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497801.031753:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497801.031801:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:3.0:1777497801.031812:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:3.0:1777497801.031821:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:3.0:1777497801.031836:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 39 00010000:00080000:3.0:1777497801.031842:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00010000:00080000:3.0:1777497801.031846:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969516 00000100:00000040:3.0:1777497801.048433:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f86068700 x1863837546421120 msgsize 1512 00000100:00100000:3.0:1777497801.048448:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497801.048654:0:24168:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421120 00000100:00100000:0.0:1777497801.048665:0:24168:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421120 00000020:00000040:0.0:1777497801.049963:0:24168:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497801.049971:0:24168:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=40 00000100:00000040:1.0:1777497801.051386:0:24168:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497801.051457:0:24168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00000040:1.0:1777497801.051462:0:24168:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497801.051471:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f86068700 x1863837546421120/t0(4294969516) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.051487:0:24168:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+40:2411:x1863837546421120:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:1.0:1777497801.051500:0:24168:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86068700 x1863837546421120/t0(4294969516) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497801.051510:0:24168:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969516, current: 4294969516, replaying 00010000:00000040:1.0:1777497801.051513:0:24168:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497801.051537:0:24168:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f86068700 x1863837546421120/t0(4294969516) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.051544:0:24168:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f86068700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d146155b-4321-4b14-9284-f644ed9631fb+40:2411:x1863837546421120:12345-192.168.202.4@tcp:4:dd.0 Request processed in 62us (3113us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497801.051550:0:24168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1083 00000100:00000040:1.0:1777497801.051566:0:24168:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:0.0:1777497801.051652:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969516, next_transno: 4294969516 00010000:00080000:0.0:1777497801.051657:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969516) 00010000:00080000:0.0:1777497801.051666:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546421120 t4294969516 from 192.168.202.4@tcp req@ffff923f86068700 x1863837546421120/t0(4294969516) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497801.051683:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f86068700 x1863837546421120/t0(4294969516) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:0.0:1777497801.051790:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:0.0:1777497801.051826:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:0.0:1777497801.051830:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:0.0:1777497801.052076:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 36 00000020:00000040:0.0:1777497801.052081:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=41 00010000:00000040:1.0:1777497801.058383:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969516, xid 1863837546421120 00000100:00000040:1.0:1777497801.058407:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497801.058417:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497801.058474:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497801.058487:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497801.058607:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497801.058621:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 40 00010000:00080000:1.0:1777497801.058628:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00010000:00080000:1.0:1777497801.058632:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969517 00000100:00000040:0.0:1777497801.078277:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e2300 x1863837546421376 msgsize 1512 00000100:00100000:0.0:1777497801.078293:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497801.078374:0:24902:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421376 00000100:00100000:1.0:1777497801.078384:0:24902:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421376 00000020:00000040:1.0:1777497801.078387:0:24902:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497801.078391:0:24902:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=41 00000100:00000040:1.0:1777497801.078415:0:24902:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497801.078494:0:24902:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1084 00000100:00000040:1.0:1777497801.078498:0:24902:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497801.078505:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e2300 x1863837546421376/t0(4294969517) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.078520:0:24902:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+41:2411:x1863837546421376:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:1.0:1777497801.078530:0:24902:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2300 x1863837546421376/t0(4294969517) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497801.078539:0:24902:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969517, current: 4294969517, replaying 00010000:00000040:1.0:1777497801.078543:0:24902:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497801.078562:0:24902:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e2300 x1863837546421376/t0(4294969517) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.078571:0:24902:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d146155b-4321-4b14-9284-f644ed9631fb+41:2411:x1863837546421376:12345-192.168.202.4@tcp:4:dd.0 Request processed in 54us (295us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497801.078588:0:24902:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1084 00000100:00000040:1.0:1777497801.078591:0:24902:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497801.078631:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969517, next_transno: 4294969517 00010000:00080000:2.0:1777497801.078636:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969517) 00010000:00080000:2.0:1777497801.078644:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546421376 t4294969517 from 192.168.202.4@tcp req@ffff923f861e2300 x1863837546421376/t0(4294969517) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.079185:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2300 x1863837546421376/t0(4294969517) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.079289:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497801.079321:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497801.079324:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497801.080237:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 37 00000020:00000040:2.0:1777497801.080242:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=42 00010000:00000040:2.0:1777497801.080282:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969517, xid 1863837546421376 00000100:00000040:2.0:1777497801.080294:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497801.080300:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497801.080357:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497801.080367:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497801.080375:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497801.080386:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 41 00010000:00080000:2.0:1777497801.080391:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00010000:00080000:2.0:1777497801.080395:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969518 00000100:00000040:0.0:1777497801.084507:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e2680 x1863837546421632 msgsize 1512 00000100:00100000:0.0:1777497801.084523:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497801.084817:0:8403:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421632 00000100:00100000:2.0:1777497801.084827:0:8403:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421632 00000020:00000040:2.0:1777497801.084830:0:8403:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497801.084834:0:8403:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=42 00000100:00000040:2.0:1777497801.084870:0:8403:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497801.084918:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1085 00000100:00000040:2.0:1777497801.084922:0:8403:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497801.084929:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e2680 x1863837546421632/t0(4294969518) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.084943:0:8403:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+42:2411:x1863837546421632:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497801.084953:0:8403:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2680 x1863837546421632/t0(4294969518) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497801.084975:0:8403:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969518, current: 4294969518, replaying 00010000:00000040:2.0:1777497801.084978:0:8403:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497801.084991:0:8403:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e2680 x1863837546421632/t0(4294969518) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.085000:0:8403:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d146155b-4321-4b14-9284-f644ed9631fb+42:2411:x1863837546421632:12345-192.168.202.4@tcp:4:dd.0 Request processed in 60us (493us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497801.085007:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1085 00000100:00000040:2.0:1777497801.085011:0:8403:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497801.085026:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969518, next_transno: 4294969518 00010000:00080000:2.0:1777497801.085030:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969518) 00010000:00080000:2.0:1777497801.085036:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546421632 t4294969518 from 192.168.202.4@tcp req@ffff923f861e2680 x1863837546421632/t0(4294969518) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.085051:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2680 x1863837546421632/t0(4294969518) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.085167:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497801.085199:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497801.085202:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497801.085443:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 38 00000020:00000040:2.0:1777497801.085446:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=43 00010000:00000040:2.0:1777497801.087332:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969518, xid 1863837546421632 00000100:00000040:2.0:1777497801.087351:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497801.087360:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497801.087410:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497801.087422:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497801.087432:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497801.087443:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 42 00010000:00080000:2.0:1777497801.087456:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969519 00010000:00080000:2.0:1777497801.087460:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969519 00000100:00000040:0.0:1777497801.093559:0:3650:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e1180 x1863837546421888 msgsize 1512 00000100:00100000:0.0:1777497801.093576:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497801.093731:0:24910:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546421888 00000100:00100000:2.0:1777497801.093743:0:24910:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546421888 00000020:00000040:2.0:1777497801.093745:0:24910:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497801.093751:0:24910:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=43 00000100:00000040:2.0:1777497801.093778:0:24910:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:2.0:1777497801.093833:0:24910:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00000040:2.0:1777497801.093837:0:24910:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:2.0:1777497801.093845:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e1180 x1863837546421888/t0(4294969519) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.093869:0:24910:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+43:2411:x1863837546421888:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:2.0:1777497801.093880:0:24910:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1180 x1863837546421888/t0(4294969519) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:2.0:1777497801.093889:0:24910:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969519, current: 4294969519, replaying 00010000:00000040:2.0:1777497801.093892:0:24910:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:2.0:1777497801.093913:0:24910:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e1180 x1863837546421888/t0(4294969519) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1777497801.093922:0:24910:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:d146155b-4321-4b14-9284-f644ed9631fb+43:2411:x1863837546421888:12345-192.168.202.4@tcp:4:dd.0 Request processed in 57us (366us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497801.093929:0:24910:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1086 00000100:00000040:2.0:1777497801.093932:0:24910:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:1.0:1777497801.094268:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969519, next_transno: 4294969519 00010000:00080000:1.0:1777497801.094273:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969519) 00010000:00080000:1.0:1777497801.094281:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546421888 t4294969519 from 192.168.202.4@tcp req@ffff923f861e1180 x1863837546421888/t0(4294969519) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497801.094297:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1180 x1863837546421888/t0(4294969519) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:1.0:1777497801.094391:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:1.0:1777497801.094417:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:1.0:1777497801.094420:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:1.0:1777497801.094649:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 39 00000020:00000040:1.0:1777497801.094653:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=44 00010000:00000040:1.0:1777497801.098396:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969519, xid 1863837546421888 00000100:00000040:1.0:1777497801.098415:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497801.098423:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497801.098477:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:1.0:1777497801.098491:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:1.0:1777497801.098499:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:1.0:1777497801.098511:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 43 00010000:00080000:1.0:1777497801.098517:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969520 00010000:00080000:1.0:1777497801.098522:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969520 00000100:00000040:2.0:1777497801.107023:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba4700 x1863837546422144 msgsize 1512 00000100:00100000:2.0:1777497801.107038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497801.107308:0:8402:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546422144 00000100:00100000:1.0:1777497801.107318:0:8402:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546422144 00000020:00000040:1.0:1777497801.107321:0:8402:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497801.107326:0:8402:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=44 00000100:00000040:1.0:1777497801.107354:0:8402:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_io at +6s 00000100:00100000:1.0:1777497801.107416:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1087 00000100:00000040:1.0:1777497801.107420:0:8402:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00000040:1.0:1777497801.107428:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba4700 x1863837546422144/t0(4294969520) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl New:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.107443:0:8402:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+44:2411:x1863837546422144:12345-192.168.202.4@tcp:4:dd.0 00000020:00000040:1.0:1777497801.107455:0:8402:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba4700 x1863837546422144/t0(4294969520) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00010000:00080000:1.0:1777497801.107471:0:8402:0:(ldlm_lib.c:3211:target_queue_recovery_request()) Next recovery transno: 4294969520, current: 4294969520, replaying 00010000:00000040:1.0:1777497801.107475:0:8402:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:1.0:1777497801.107492:0:8402:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4700 x1863837546422144/t0(4294969520) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000100:00100000:1.0:1777497801.107500:0:8402:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d146155b-4321-4b14-9284-f644ed9631fb+44:2411:x1863837546422144:12345-192.168.202.4@tcp:4:dd.0 Request processed in 61us (480us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497801.107507:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1087 00000100:00000040:1.0:1777497801.107511:0:8402:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00010000:00080000:2.0:1777497801.107525:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 1, req_transno: 4294969520, next_transno: 4294969520 00010000:00080000:2.0:1777497801.107529:0:93031:0:(ldlm_lib.c:2232:check_for_next_transno()) waking for next (4294969520) 00010000:00080000:2.0:1777497801.107543:0:93031:0:(ldlm_lib.c:2733:replay_request_or_update()) @@@ processing x1863837546422144 t4294969520 from 192.168.202.4@tcp req@ffff9240b5ba4700 x1863837546422144/t0(4294969520) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.107559:0:93031:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff9240b5ba4700 x1863837546422144/t0(4294969520) o4->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 1512/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/604/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00000020:00000040:2.0:1777497801.107652:0:93031:0:(tgt_handler.c:2876:tgt_brw_write()) Client use short io for data transfer, size = 1024 00000001:00000040:2.0:1777497801.107681:0:93031:0:(lnet-crypto.c:95:cfs_crypto_hash_alloc()) Using crypto hash: crc32c (crc32c-intel) speed 3972 MB/s 00000020:00000040:2.0:1777497801.107684:0:93031:0:(tgt_handler.c:1898:tgt_checksum_niobuf()) Checksum for algo crc32c 00000001:00000040:2.0:1777497801.108006:0:93031:0:(tgt_lastrcvd.c:1011:tgt_last_commit_cb_add()) callback GETting export ffff9240865c6800 : new cb_count 40 00000020:00000040:2.0:1777497801.108010:0:93031:0:(genops.c:889:class_export_get()) GET export ffff9240865c6800 refcount=45 00010000:00000040:2.0:1777497801.109221:0:93031:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969480, transno 4294969520, xid 1863837546422144 00000100:00000040:2.0:1777497801.109241:0:93031:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497801.109249:0:93031:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497801.109339:0:93031:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00010000:00080000:2.0:1777497801.109353:0:93031:0:(ldlm_lib.c:2086:extend_recovery_timer()) lustre-OST0000: recovery timer will expire in 100 seconds 00010000:00000040:2.0:1777497801.109361:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497801.109373:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 44 00010000:00080000:2.0:1777497801.109378:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969521 00010000:00080000:2.0:1777497801.109382:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 2, queue_len: 0, req_transno: 0, next_transno: 4294969521 00000100:00000040:0.0:1777497801.117339:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e0a80 x1863837546426112 msgsize 328 00000100:00100000:0.0:1777497801.117355:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497801.117389:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e2a00 x1863837546426240 msgsize 328 00000100:00100000:3.0:1777497801.117406:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426112 00000100:00100000:0.0:1777497801.117407:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497801.117416:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426112 00000020:00000040:3.0:1777497801.117419:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.117423:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=45 00000100:00000040:0.0:1777497801.117440:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e0e00 x1863837546426368 msgsize 328 00000100:00100000:0.0:1777497801.117444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497801.117468:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e1500 x1863837546426496 msgsize 328 00000100:00100000:0.0:1777497801.117473:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497801.126468:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426240 00000100:00100000:3.0:1777497801.126485:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426240 00000020:00000040:3.0:1777497801.126488:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.126494:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=46 00000100:00100000:3.0:1777497801.126554:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426368 00000100:00100000:3.0:1777497801.126557:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426368 00000020:00000040:3.0:1777497801.126559:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.126560:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=47 00000100:00100000:3.0:1777497801.126576:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426496 00000100:00100000:3.0:1777497801.126579:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426496 00000020:00000040:3.0:1777497801.126581:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.126582:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=48 00000100:00000040:0.0:1777497801.126604:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e1f80 x1863837546426624 msgsize 328 00000100:00100000:3.0:1777497801.126605:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5986 00000100:00000040:3.0:1777497801.126609:0:25487:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 1 00000100:00100000:0.0:1777497801.126610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:3.0:1777497801.126617:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e0a80 x1863837546426112/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497801.126628:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e0000 x1863837546426752 msgsize 328 00000100:00100000:0.0:1777497801.126633:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497801.126644:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+48:2411:x1863837546426112:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000100:00000040:0.0:1777497801.126648:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff923f861e0700 x1863837546426880 msgsize 328 00000100:00100000:0.0:1777497801.126651:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000020:00000040:3.0:1777497801.126661:0:25487:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e0a80 x1863837546426112/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497801.126686:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff924089387800 x1863837546427008 msgsize 328 00000100:00100000:0.0:1777497801.126690:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:0.0:1777497801.126728:0:25497:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426624 00000100:00100000:0.0:1777497801.126733:0:25497:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426624 00000020:00000040:0.0:1777497801.126735:0:25497:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:0.0:1777497801.126737:0:25497:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=49 00010000:00000040:3.0:1777497801.126784:0:25487:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00010000:00080000:3.0:1777497801.126789:0:25487:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e0a80 x1863837546426112/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.126804:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e0a80 x1863837546426112/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.126813:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+49:2411:x1863837546426112:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 172us (9474us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.126821:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5986 00000100:00000040:3.0:1777497801.126824:0:25487:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00000100:00100000:3.0:1777497801.126833:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426752 00000100:00100000:3.0:1777497801.126836:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426752 00000020:00000040:3.0:1777497801.126838:0:25487:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:3.0:1777497801.126840:0:25487:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=50 00000100:00100000:2.0:1777497801.126936:0:25493:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546426880 00000100:00100000:2.0:1777497801.126940:0:25493:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546426880 00000020:00000040:2.0:1777497801.126942:0:25493:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:2.0:1777497801.126944:0:25493:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=51 00000100:00100000:1.0:1777497801.126958:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427008 00000100:00100000:1.0:1777497801.126962:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427008 00000020:00000040:1.0:1777497801.126964:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ecea 00000020:00000040:1.0:1777497801.126965:0:25495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240865c6800 refcount=52 00000100:00100000:0.0:1777497801.131820:0:25497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5987 00000100:00000040:0.0:1777497801.131826:0:25497:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 2 00000100:00000040:0.0:1777497801.131836:0:25497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e2a00 x1863837546426240/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497801.131852:0:25497:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426240:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:0.0:1777497801.131866:0:25497:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e2a00 x1863837546426240/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:0.0:1777497801.131876:0:25497:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 3 00010000:00080000:0.0:1777497801.131880:0:25497:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e2a00 x1863837546426240/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497801.131909:0:25497:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e2a00 x1863837546426240/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497801.131917:0:25497:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426240:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 69us (14526us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.133356:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5988 00000100:00000040:3.0:1777497801.133363:0:25487:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 4 00000100:00000040:3.0:1777497801.133371:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e0e00 x1863837546426368/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133406:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5989 00000100:00000040:3.0:1777497801.133409:0:25492:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 5 00000100:00000040:3.0:1777497801.133413:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e1500 x1863837546426496/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133447:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426496:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1777497801.133460:0:25492:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1500 x1863837546426496/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497801.133468:0:25492:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 6 00010000:00080000:3.0:1777497801.133471:0:25492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e1500 x1863837546426496/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.133480:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e1500 x1863837546426496/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133488:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426496:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 47us (16017us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.133495:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5989 00000100:00000040:3.0:1777497801.133498:0:25492:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 5 00000100:00100000:3.0:1777497801.133512:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5990 00000100:00000040:3.0:1777497801.133515:0:25492:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 6 00000100:00000040:3.0:1777497801.133519:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e1f80 x1863837546426624/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133530:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426624:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1777497801.133537:0:25492:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e1f80 x1863837546426624/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497801.133794:0:25492:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 7 00010000:00080000:3.0:1777497801.133798:0:25492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e1f80 x1863837546426624/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.133818:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e1f80 x1863837546426624/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133826:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426624:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 298us (7221us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.133832:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5990 00000100:00000040:3.0:1777497801.133834:0:25492:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 6 00000100:00100000:3.0:1777497801.133845:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5991 00000100:00000040:3.0:1777497801.133847:0:25492:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 7 00000100:00000040:3.0:1777497801.133941:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e0000 x1863837546426752/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133955:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426752:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1777497801.133963:0:25492:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e0000 x1863837546426752/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497801.133971:0:25492:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 8 00010000:00080000:3.0:1777497801.133974:0:25492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e0000 x1863837546426752/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.133982:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e0000 x1863837546426752/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.133989:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426752:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 38us (7358us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.133994:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5991 00000100:00000040:3.0:1777497801.133996:0:25492:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 7 00000100:00100000:3.0:1777497801.134014:0:25492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5992 00000100:00000040:3.0:1777497801.134017:0:25492:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 8 00000100:00000040:3.0:1777497801.134021:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f861e0700 x1863837546426880/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.134032:0:25492:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426880:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1777497801.134040:0:25492:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e0700 x1863837546426880/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497801.134047:0:25492:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 9 00010000:00080000:3.0:1777497801.134050:0:25492:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e0700 x1863837546426880/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.134058:0:25492:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e0700 x1863837546426880/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.134066:0:25492:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_012:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426880:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 37us (7416us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.134072:0:25492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5992 00000100:00000040:3.0:1777497801.134074:0:25492:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 8 00000100:00100000:3.0:1777497801.134171:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f861e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426368:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:3.0:1777497801.134180:0:25487:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff923f861e0e00 x1863837546426368/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497801.134187:0:25487:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 9 00010000:00080000:3.0:1777497801.134190:0:25487:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff923f861e0e00 x1863837546426368/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.134197:0:25487:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f861e0e00 x1863837546426368/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.134211:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f861e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546426368:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 829us (16769us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497801.134217:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5988 00000100:00000040:3.0:1777497801.134219:0:25487:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 8 00000100:00100000:1.0:1777497801.134322:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5993 00000100:00000040:1.0:1777497801.134326:0:25495:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240865c6800 : new rpc_count 9 00000100:00000040:1.0:1777497801.134331:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924089387800 x1863837546427008/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl New:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497801.134345:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546427008:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00000020:00000040:1.0:1777497801.134353:0:25495:0:(tgt_handler.c:586:tgt_handle_recovery()) @@@ Got new replay req@ffff924089387800 x1863837546427008/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:00000040:1.0:1777497801.134365:0:25495:0:(ldlm_lib.c:1760:target_request_copy_get()) RPC GETting export ffff9240865c6800 : new rpc_count 10 00010000:00080000:1.0:1777497801.134369:0:25495:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff924089387800 x1863837546427008/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497801.134377:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924089387800 x1863837546427008/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497801.134385:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+52:2411:x1863837546427008:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 44us (7697us total) trans 0 rc 0/-999 00000100:00100000:1.0:1777497801.134391:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5993 00000100:00000040:1.0:1777497801.134394:0:25495:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 9 00010000:00080000:3.0:1777497801.137996:0:93031:0:(ldlm_lib.c:2214:check_for_next_transno()) max: 3, connected: 3, completed: 3, queue_len: 0, req_transno: 0, next_transno: 4294969521 00010000:00080000:3.0:1777497801.138003:0:93031:0:(ldlm_lib.c:2248:check_for_next_transno()) waking for completed recovery 00010000:00000040:3.0:1777497801.138011:0:93031:0:(ldlm_lib.c:2867:target_recovery_thread()) 2: lock replay stage - 1 clients 00010000:00080000:3.0:1777497801.138013:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:3.0:1777497801.138015:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:3.0:1777497801.138030:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e0a80 x1863837546426112/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:3.0:1777497801.138041:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00000100:00100000:0.0:1777497801.141647:0:25497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5987 00000100:00000040:0.0:1777497801.141655:0:25497:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240865c6800 : new rpc_count 8 00010000:00000040:3.0:1777497801.146367:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 7 00000020:00000040:3.0:1777497801.146395:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 51 00010000:00080000:3.0:1777497801.146399:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.152062:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.152087:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e2a00 x1863837546426240/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.152794:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.152798:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 6 00000020:00000040:2.0:1777497801.152815:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 50 00010000:00080000:2.0:1777497801.152818:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.152828:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.152836:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e1500 x1863837546426496/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.152843:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.152846:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 5 00000020:00000040:2.0:1777497801.152946:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 49 00010000:00080000:2.0:1777497801.152949:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.152951:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.152957:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e1f80 x1863837546426624/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.152964:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.152966:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 4 00000020:00000040:2.0:1777497801.152974:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 48 00010000:00080000:2.0:1777497801.152976:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.152977:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.152981:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e0000 x1863837546426752/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.152987:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.152988:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 3 00000020:00000040:2.0:1777497801.152992:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 47 00010000:00080000:2.0:1777497801.152994:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.152995:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.152999:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e0700 x1863837546426880/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.153004:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.153006:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 2 00000020:00000040:2.0:1777497801.153011:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 46 00010000:00080000:2.0:1777497801.153012:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.153013:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.153018:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff923f861e0e00 x1863837546426368/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.153029:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.153031:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 1 00000020:00000040:2.0:1777497801.153036:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 45 00010000:00080000:2.0:1777497801.153038:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497801.153039:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497801.153044:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff924089387800 x1863837546427008/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:557/0 lens 328/0 e 0 to 0 dl 1777497812 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497801.153050:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00000040:2.0:1777497801.153052:0:93031:0:(ldlm_lib.c:1776:target_request_copy_put()) RPC PUTting export ffff9240865c6800 : new rpc_count 0 00000020:00000040:2.0:1777497801.153057:0:93031:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 44 00010000:00080000:2.0:1777497801.153059:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000020:00000040:2.0:1777497801.742457:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osd (ffff9240a62ecd40) now 12 - health_check_show 00000020:00000040:2.0:1777497801.742469:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osd (ffff9240a62ecd40) now 12 - health_check_show 00000020:00000040:2.0:1777497801.742473:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osd (ffff9240990619c0) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742476:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osd (ffff9240990619c0) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742478:0:93179:0:(obd_config.c:994:class_incref()) incref MGC192.168.202.104@tcp (ffff9240911f99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742481:0:93179:0:(obd_config.c:1022:class_decref()) Decref MGC192.168.202.104@tcp (ffff9240911f99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742483:0:93179:0:(obd_config.c:994:class_incref()) incref MGS (ffff9240a62eb380) now 8 - health_check_show 00000020:00000040:2.0:1777497801.742488:0:93179:0:(obd_config.c:1022:class_decref()) Decref MGS (ffff9240a62eb380) now 8 - health_check_show 00000020:00000040:2.0:1777497801.742490:0:93179:0:(obd_config.c:994:class_incref()) incref MDS (ffff9240a6bf4d40) now 4 - health_check_show 00000020:00000040:2.0:1777497801.742499:0:93179:0:(obd_config.c:1022:class_decref()) Decref MDS (ffff9240a6bf4d40) now 4 - health_check_show 00000020:00000040:2.0:1777497801.742501:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-mdtlov (ffff9240911fb380) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742504:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-mdtlov (ffff9240911fb380) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742506:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - health_check_show 00000020:00000040:2.0:1777497801.742508:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - health_check_show 00000020:00000040:2.0:1777497801.742510:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDD0000 (ffff9240911fcd40) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742513:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0000 (ffff9240911fcd40) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742515:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-QMT0000 (ffff9240aecd99c0) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742524:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-QMT0000 (ffff9240aecd99c0) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742527:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-osp-MDT0000 (ffff9240831699c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742529:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-osp-MDT0000 (ffff9240831699c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742531:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0000 (ffff9240a62e99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742533:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0000 (ffff9240a62e99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742535:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0000 (ffff923f82aacd40) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742537:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0000 (ffff923f82aacd40) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742540:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0000 (ffff923f82aa8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742542:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0000 (ffff923f82aa8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742544:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-mdtlov (ffff9240bcd799c0) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742546:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-mdtlov (ffff9240bcd799c0) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742548:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 12 - health_check_show 00000020:00000040:2.0:1777497801.742550:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 12 - health_check_show 00000020:00000040:2.0:1777497801.742552:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDD0001 (ffff9240bcd7cd40) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742554:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDD0001 (ffff9240bcd7cd40) now 5 - health_check_show 00000020:00000040:2.0:1777497801.742556:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osd (ffff9240a62e8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742559:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osd (ffff9240a62e8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742561:0:93179:0:(obd_config.c:994:class_incref()) incref OSS (ffff9240bcfdcd40) now 4 - health_check_show 00000020:00000040:2.0:1777497801.742627:0:93179:0:(obd_config.c:1022:class_decref()) Decref OSS (ffff9240bcfdcd40) now 4 - health_check_show 00000020:00000040:2.0:1777497801.742631:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0000 (ffff9240bb69cd40) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742695:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000 (ffff9240bb69cd40) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742698:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742700:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0000 (ffff92408316cd40) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742702:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742704:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0000 (ffff9240bb69b380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742706:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-osp-MDT0001 (ffff92409c5a8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742708:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-osp-MDT0001 (ffff92409c5a8000) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742725:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0000-osc-MDT0001 (ffff92409c5ab380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742727:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0000-osc-MDT0001 (ffff92409c5ab380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742730:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osd (ffff9240bcfd99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742733:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osd (ffff9240bcfd99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742735:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742760:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - health_check_show 00000020:00000040:2.0:1777497801.742763:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-OST0001 (ffff9240bcfdb380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742765:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-OST0001 (ffff9240bcfdb380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742767:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001-lwp-OST0001 (ffff923f82aa99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742769:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001-lwp-OST0001 (ffff923f82aa99c0) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742772:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-OST0001-osc-MDT0001 (ffff923f84b0b380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742774:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001-osc-MDT0001 (ffff923f84b0b380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742776:0:93179:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000-lwp-MDT0001 (ffff924099063380) now 6 - health_check_show 00000020:00000040:2.0:1777497801.742779:0:93179:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000-lwp-MDT0001 (ffff924099063380) now 6 - health_check_show 00000020:00000040:3.0:1777497801.762264:0:72710:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1777497801.762305:0:72710:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002cb45756] to pc [ptlrpcd_00_01+1] req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.762353:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:3.0:1777497801.762367:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.762381:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565089152:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1777497801.762408:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.762416:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497801.762459:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff924086d41880 x1863837565089152 msgsize 224 00000100:00100000:3.0:1777497801.762474:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497801.762502:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497801.762515:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4948 usecs (5 jiffies) 00000100:00100000:1.0:1777497801.762720:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089152 00000100:00100000:1.0:1777497801.762728:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089152 00000020:00000040:1.0:1777497801.762731:0:8400:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:1.0:1777497801.762735:0:8400:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:1.0:1777497801.762751:0:8400:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:1.0:1777497801.762778:0:8400:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00080000:3.0:1777497801.762788:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:3.0:1777497801.762792:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00100000:1.0:1777497801.762803:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2215 00000100:00000040:1.0:1777497801.762806:0:8400:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:1.0:1777497801.762811:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086d41880 x1863837565089152/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:557/0 lens 224/0 e 0 to 0 dl 1777497812 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497801.762825:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565089152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1777497801.762853:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:1.0:1777497801.762863:0:8400:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565089152 00000100:00000040:1.0:1777497801.762872:0:8400:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:1.0:1777497801.762877:0:8400:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:1.0:1777497801.762896:0:8400:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1777497801.762938:0:8400:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:1.0:1777497801.762943:0:8400:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d41880 x1863837565089152/t0(0) o13->lustre-MDT0001-mdtlov_UUID@0@lo:557/0 lens 224/368 e 0 to 0 dl 1777497812 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497801.762950:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565089152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 129us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497801.762956:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2215 00000100:00000040:1.0:1777497801.762959:0:8400:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:1.0:1777497801.762968:0:8400:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00000040:3.0:1777497801.763042:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:3.0:1777497801.763048:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:3.0:1777497801.763058:0:3657:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0001: Updating status = 0 00000004:00000040:3.0:1777497801.763061:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0001: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:3.0:1777497801.763068:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497801.763086:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565089152:0@lo:13:osp-pre-1-1.0 00000100:00000040:3.0:1777497801.763129:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f86069c00 x1863837565089152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497817 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497801.763140:0:3657:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00010000:00010000:2.0:1777497801.901256:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497802.918535:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:0.0:1777497803.819410:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819425:0:8:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497803.819451:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819470:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000002b7e878] to pc [ptlrpcd_00_02+2] req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819493:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819500:0:8:0:(genops.c:1231:class_import_get()) import ffff923f8275c800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1777497803.819506:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819515:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000000a3154e5] to pc [ptlrpcd_00_03+3] req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819529:0:8:0:(genops.c:1231:class_import_get()) import ffff923f82ab3800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1777497803.819535:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819543:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ca3baf47] to pc [ptlrpcd_00_00+0] req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819579:0:8:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1777497803.819585:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819606:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c9568350] to pc [ptlrpcd_00_01+1] req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497803.819614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497803.819617:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1777497803.819620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819625:0:8:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1777497803.819631:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819638:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000019dea267] to pc [ptlrpcd_00_02+2] req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819649:0:8:0:(genops.c:1231:class_import_get()) import ffff92409c5dd800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1777497803.819655:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819662:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000003f832be5] to pc [ptlrpcd_00_03+3] req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819673:0:8:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1777497803.819687:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819706:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000daa7317e] to pc [ptlrpcd_00_00+0] req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1777497803.819713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 1 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1777497803.819716:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:0.0:1777497803.819719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819724:0:8:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1777497803.819730:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819739:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005690f91f] to pc [ptlrpcd_00_01+1] req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819750:0:8:0:(genops.c:1231:class_import_get()) import ffff9240bb6f5800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1777497803.819757:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819764:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000c0fb860c] to pc [ptlrpcd_00_02+2] req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819770:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819775:0:8:0:(genops.c:1231:class_import_get()) import ffff924086e27000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1777497803.819780:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819788:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000008a064b80] to pc [ptlrpcd_00_03+3] req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:0.0:1777497803.819810:0:8:0:(genops.c:1231:class_import_get()) import ffff92409fb63000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1777497803.819817:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:0.0:1777497803.819825:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000001c646139] to pc [ptlrpcd_00_00+0] req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819835:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 1 (3938) 00000100:00000040:0.0:1777497803.819855:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.819867:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924089385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565089280:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.819894:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819902:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.819941:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a2d15450 x1863837565089280 msgsize 224 00000100:00100000:0.0:1777497803.819945:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.819948:0:3659:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497803.819966:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.819994:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820002:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565089792:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820016:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820024:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820036:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff923f84702680 x1863837565089792 msgsize 224 00000100:00100000:0.0:1777497803.820044:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820057:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820066:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4936 usecs (5 jiffies) 00000100:00000040:0.0:1777497803.820071:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820079:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565090304:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820091:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820122:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820136:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff923f84700700 x1863837565090304 msgsize 224 00000100:00100000:0.0:1777497803.820140:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820159:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820168:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6547 usecs (7 jiffies) 00000100:00100000:0.0:1777497803.820181:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:0.0:1777497803.820186:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820193:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565089408:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820205:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820211:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820221:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff923f84703800 x1863837565089408 msgsize 224 00000100:00100000:0.0:1777497803.820225:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820235:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820243:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8977 usecs (9 jiffies) 00000100:00000040:0.0:1777497803.820247:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820261:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565089920:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820273:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820279:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820290:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff923f84702a00 x1863837565089920 msgsize 224 00000100:00100000:0.0:1777497803.820293:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820306:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820313:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 77941 usecs (78 jiffies) 00000100:00000040:0.0:1777497803.820317:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820325:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565090432:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820339:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820346:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820356:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff924086e9ca80 x1863837565090432 msgsize 224 00000100:00100000:0.0:1777497803.820360:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820371:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820379:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 6085 usecs (7 jiffies) 00000100:00000040:0.0:1777497803.820400:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820408:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565089664:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820420:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820437:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820452:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086e9c000 x1863837565089664 msgsize 224 00000100:00100000:0.0:1777497803.820455:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820469:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820477:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1835590 usecs (1836 jiffies) 00000100:00000040:0.0:1777497803.820482:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820489:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565090176:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820499:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820505:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820514:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086e9dc00 x1863837565090176 msgsize 224 00000100:00100000:0.0:1777497803.820517:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820528:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820535:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5643 usecs (6 jiffies) 00000100:00100000:0.0:1777497803.820553:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00000040:0.0:1777497803.820557:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820564:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565089536:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820575:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820580:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820591:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086e9ed80 x1863837565089536 msgsize 224 00000100:00100000:0.0:1777497803.820595:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820607:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820623:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8565 usecs (9 jiffies) 00000100:00000040:0.0:1777497803.820629:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820637:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565090048:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820650:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820656:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820667:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de1180 x1863837565090048 msgsize 224 00000100:00100000:0.0:1777497803.820670:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820683:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820705:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3967 usecs (4 jiffies) 00000100:00000040:0.0:1777497803.820711:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820719:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f84703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565090560:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.820731:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820736:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820747:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de2680 x1863837565090560 msgsize 224 00000100:00100000:0.0:1777497803.820750:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497803.820761:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820769:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 5981 usecs (6 jiffies) 00000100:00100000:0.0:1777497803.820789:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089280 00000100:00100000:0.0:1777497803.820799:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089280 00000020:00000040:0.0:1777497803.820803:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497803.820816:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:0.0:1777497803.820836:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497803.820862:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00000040:0.0:1777497803.820866:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497803.820871:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a2d15450 x1863837565089280/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820881:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565089280:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.820906:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565089280 00000100:00000040:0.0:1777497803.820916:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.820920:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.820936:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.820953:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.820957:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a2d15450 x1863837565089280/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.820965:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565089280:12345-0@lo:400:kworker.0 Request processed in 85us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.820971:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00000040:0.0:1777497803.820973:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497803.820983:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00100000:0.0:1777497803.821008:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089792 00000100:00100000:0.0:1777497803.821012:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089792 00000020:00000040:0.0:1777497803.821014:0:25485:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:0.0:1777497803.821016:0:25485:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000020:00000040:0.0:1777497803.821029:0:25485:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00100000:0.0:1777497803.821055:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090176 00000100:00100000:0.0:1777497803.821058:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090176 00000020:00000040:0.0:1777497803.821059:0:25485:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:0.0:1777497803.821062:0:25485:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00100000:0.0:1777497803.821090:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2725 00000100:00000040:0.0:1777497803.821117:0:25485:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821121:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f84702680 x1863837565089792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821131:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565089792:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821142:0:25485:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565089792 00000100:00000040:0.0:1777497803.821147:0:25485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821150:0:25485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821165:0:25485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821177:0:25485:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821181:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84702680 x1863837565089792/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821188:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84702680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565089792:12345-0@lo:400:kworker.0 Request processed in 59us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821193:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2725 00000100:00000040:0.0:1777497803.821195:0:25485:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821201:0:25485:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00100000:0.0:1777497803.821208:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2726 00000100:00000040:0.0:1777497803.821211:0:25485:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821213:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086e9dc00 x1863837565090176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821223:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565090176:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821233:0:25485:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565090176 00000100:00000040:0.0:1777497803.821238:0:25485:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821240:0:25485:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821260:0:25485:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821276:0:25485:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821281:0:25485:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086e9dc00 x1863837565090176/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821288:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565090176:12345-0@lo:400:kworker.0 Request processed in 68us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821294:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2726 00000100:00000040:0.0:1777497803.821296:0:25485:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821302:0:25485:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00100000:0.0:1777497803.821318:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090304 00000100:00100000:0.0:1777497803.821322:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090304 00000020:00000040:0.0:1777497803.821323:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df0d 00000020:00000040:0.0:1777497803.821326:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409f6c2800 refcount=5 00000100:00000040:0.0:1777497803.821335:0:63727:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:0.0:1777497803.821346:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089408 00000100:00100000:0.0:1777497803.821348:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089408 00000020:00000040:0.0:1777497803.821349:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691deff 00000020:00000040:0.0:1777497803.821351:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1e800 refcount=5 00000020:00000040:0.0:1777497803.821358:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00100000:0.0:1777497803.821367:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089920 00000100:00100000:0.0:1777497803.821369:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089920 00000020:00000040:0.0:1777497803.821371:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df06 00000020:00000040:0.0:1777497803.821372:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1f000 refcount=5 00000100:00100000:0.0:1777497803.821382:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090432 00000100:00100000:0.0:1777497803.821384:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090432 00000020:00000040:0.0:1777497803.821385:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed1b 00000020:00000040:0.0:1777497803.821387:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e21800 refcount=5 00000100:00100000:0.0:1777497803.821399:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089536 00000100:00100000:0.0:1777497803.821400:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089536 00000020:00000040:0.0:1777497803.821402:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917c5e 00000020:00000040:0.0:1777497803.821404:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb61800 refcount=5 00000020:00000040:0.0:1777497803.821416:0:63727:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00100000:0.0:1777497803.821429:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090560 00000100:00100000:0.0:1777497803.821431:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090560 00000020:00000040:0.0:1777497803.821433:0:63727:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed30 00000020:00000040:0.0:1777497803.821434:0:63727:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f81b73000 refcount=5 00000100:00100000:0.0:1777497803.821448:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00000040:0.0:1777497803.821450:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409f6c2800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821453:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f84700700 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821462:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565090304:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821471:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090304 00000100:00000040:0.0:1777497803.821475:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821478:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821494:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821506:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821509:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84700700 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821516:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84700700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1863837565090304:12345-0@lo:400:kworker.0 Request processed in 55us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821521:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00000040:0.0:1777497803.821523:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409f6c2800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821527:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409f6c2800 : new refcount 4 00000100:00100000:0.0:1777497803.821535:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00000040:0.0:1777497803.821537:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1e800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821540:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f84703800 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821549:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565089408:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821563:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565089408 00000100:00000040:0.0:1777497803.821567:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821570:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821583:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821594:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821598:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84703800 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821604:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84703800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565089408:12345-0@lo:400:kworker.0 Request processed in 57us (1381us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821610:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00000040:0.0:1777497803.821612:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1e800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821617:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1e800 : new refcount 4 00000100:00100000:0.0:1777497803.821625:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00000040:0.0:1777497803.821627:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1f000 : new rpc_count 1 00000100:00000040:0.0:1777497803.821630:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff923f84702a00 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821638:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565089920:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821646:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565089920 00000100:00000040:0.0:1777497803.821650:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821653:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821665:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821675:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821678:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84702a00 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821711:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84702a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565089920:12345-0@lo:400:kworker.0 Request processed in 73us (1418us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821716:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00000040:0.0:1777497803.821718:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1f000 : new rpc_count 0 00000020:00000040:0.0:1777497803.821724:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1f000 : new refcount 4 00000100:00100000:0.0:1777497803.821733:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00000040:0.0:1777497803.821735:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e21800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821739:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086e9ca80 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821748:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565090432:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821757:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090432 00000100:00000040:0.0:1777497803.821761:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821764:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821779:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821791:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821795:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086e9ca80 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821802:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565090432:12345-0@lo:400:kworker.0 Request processed in 56us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821807:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00000040:0.0:1777497803.821809:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e21800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821814:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff924086e21800 : new refcount 4 00000100:00100000:0.0:1777497803.821822:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00000040:0.0:1777497803.821824:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb61800 : new rpc_count 1 00000100:00000040:0.0:1777497803.821827:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086e9ed80 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821842:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565089536:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821851:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565089536 00000100:00000040:0.0:1777497803.821855:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821857:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821871:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821882:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821886:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086e9ed80 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821894:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565089536:12345-0@lo:400:kworker.0 Request processed in 54us (1301us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821899:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00000040:0.0:1777497803.821901:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb61800 : new rpc_count 0 00000020:00000040:0.0:1777497803.821907:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb61800 : new refcount 4 00000100:00100000:0.0:1777497803.821916:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00000040:0.0:1777497803.821919:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f81b73000 : new rpc_count 1 00000100:00000040:0.0:1777497803.821922:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de2680 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821930:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565090560:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.821938:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090560 00000100:00000040:0.0:1777497803.821941:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.821944:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.821955:0:63727:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.821965:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.821975:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de2680 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.821982:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1863837565090560:12345-0@lo:400:kworker.0 Request processed in 53us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.821987:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00000040:0.0:1777497803.821989:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f81b73000 : new rpc_count 0 00000020:00000040:0.0:1777497803.821994:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f81b73000 : new refcount 4 00000100:00100000:0.0:1777497803.822017:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565089664 00000100:00100000:0.0:1777497803.822021:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565089664 00000020:00000040:0.0:1777497803.822023:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:0.0:1777497803.822025:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:0.0:1777497803.822035:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:0.0:1777497803.822053:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090048 00000100:00100000:0.0:1777497803.822056:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090048 00000020:00000040:0.0:1777497803.822057:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:0.0:1777497803.822059:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00100000:0.0:1777497803.822077:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4117 00000100:00000040:0.0:1777497803.822080:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:0.0:1777497803.822083:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086e9c000 x1863837565089664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822111:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565089664:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.822123:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565089664 00000100:00000040:0.0:1777497803.822128:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.822131:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.822150:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822163:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.822165:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086e9c000 x1863837565089664/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822183:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3658:x1863837565089664:12345-0@lo:400:kworker.0 Request processed in 92us (1729us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.822188:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4117 00000100:00000040:0.0:1777497803.822190:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:0.0:1777497803.822196:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00100000:0.0:1777497803.822204:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4118 00000100:00000040:0.0:1777497803.822206:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:0.0:1777497803.822210:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de1180 x1863837565090048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/0 e 0 to 0 dl 1777497814 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822219:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565090048:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497803.822228:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090048 00000100:00000040:0.0:1777497803.822232:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497803.822235:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497803.822250:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822261:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497803.822265:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de1180 x1863837565090048/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:559/0 lens 224/224 e 0 to 0 dl 1777497814 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822272:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565090048:12345-0@lo:400:kworker.0 Request processed in 55us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497803.822277:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4118 00000100:00000040:0.0:1777497803.822278:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:0.0:1777497803.822283:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00080000:0.0:1777497803.822312:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:0.0:1777497803.822316:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00080000:0.0:1777497803.822319:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:0.0:1777497803.822327:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00080000:0.0:1777497803.822330:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:0.0:1777497803.822331:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:0.0:1777497803.822444:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.822450:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822459:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822465:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565089536:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.822475:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.822479:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822485:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822490:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84703b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565090048:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.822498:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.822501:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822508:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822513:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84703100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3658:1863837565090560:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.822521:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:0.0:1777497803.822524:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822531:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822546:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565089664:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.822558:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:0.0:1777497803.822562:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822569:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822574:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84700380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565090176:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.822581:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84701180 x1863837565089536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.822591:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f82ab3800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:0.0:1777497803.822598:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84703b80 x1863837565090048/t0(0) o400->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.822606:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:0.0:1777497803.822615:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84703100 x1863837565090560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.822620:0:3658:0:(genops.c:1244:class_import_put()) import ffff92409fb63000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1777497803.822625:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84700000 x1863837565089664/t0(0) o400->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.822631:0:3658:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:0.0:1777497803.822635:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84700380 x1863837565090176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.822640:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1777497803.822662:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.822666:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.822680:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.822686:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84702300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565089408:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.824949:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.824962:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.824975:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.824982:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84702d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565089920:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.825000:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.825007:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.825014:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.825020:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565090432:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.825030:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.825038:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.825044:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924089385880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565089280:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.825054:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:0.0:1777497803.825057:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.825073:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.825080:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84700a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565089792:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.829891:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497803.829907:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497803.829920:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497803.829927:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f84701c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3659:1863837565090304:0@lo:400:kworker.0 00000100:00000040:0.0:1777497803.829939:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84702300 x1863837565089408/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.829956:0:3659:0:(genops.c:1244:class_import_put()) import ffff923f8275c800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:0.0:1777497803.829965:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84702d80 x1863837565089920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.829972:0:3659:0:(genops.c:1244:class_import_put()) import ffff92409c5dd800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1777497803.829981:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84703480 x1863837565090432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.829986:0:3659:0:(genops.c:1244:class_import_put()) import ffff924086e27000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:0.0:1777497803.829993:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924089385880 x1863837565089280/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.829999:0:3659:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000100:00000040:0.0:1777497803.830005:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84700a80 x1863837565089792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.830011:0:3659:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1777497803.830024:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff923f84701c00 x1863837565090304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497819 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497803.830030:0:3659:0:(genops.c:1244:class_import_put()) import ffff9240bb6f5800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00010000:00010000:3.0:1777497803.948653:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000040:2.0:1777497804.557838:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba7800 x1863837546427264 msgsize 224 00000100:00100000:2.0:1777497804.557855:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497804.557899:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba6300 x1863837546427520 msgsize 224 00000100:00100000:2.0:1777497804.557904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497804.557937:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240a2d17450 x1863837546427136 msgsize 224 00000100:00100000:2.0:1777497804.557942:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497804.557943:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:2.0:1777497804.557973:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba5f80 x1863837546427392 msgsize 224 00000100:00100000:2.0:1777497804.557979:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497804.558009:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427264 00000100:00100000:2.0:1777497804.558018:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427264 00000020:00000040:2.0:1777497804.558021:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd77 00000020:00000040:2.0:1777497804.558026:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af7800 refcount=51 00000100:00100000:3.0:1777497804.558043:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427520 00000100:00100000:3.0:1777497804.558049:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427520 00000020:00000040:3.0:1777497804.558050:0:8397:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e113 00000020:00000040:3.0:1777497804.558054:0:8397:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e23000 refcount=7 00000020:00000040:2.0:1777497804.558057:0:65418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000020:00000040:3.0:1777497804.558065:0:8397:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:2.0:1777497804.558088:0:65418:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497804.558144:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2727 00000100:00100000:2.0:1777497804.558145:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427392 00000100:00000040:3.0:1777497804.558150:0:8397:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e23000 : new rpc_count 1 00000100:00100000:2.0:1777497804.558150:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427392 00000020:00000040:2.0:1777497804.558153:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691d36e 00000020:00000040:2.0:1777497804.558156:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f818b2800 refcount=11 00000100:00000040:3.0:1777497804.558161:0:8397:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba6300 x1863837546427520/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497804.558164:0:65418:0:(obd_config.c:994:class_incref()) incref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00100000:2.0:1777497804.558189:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1482 00000100:00000040:2.0:1777497804.558193:0:65418:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af7800 : new rpc_count 1 00000100:00100000:3.0:1777497804.558201:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546427520:12345-192.168.202.4@tcp:400:kworker.0 00000100:00000040:2.0:1777497804.558217:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba7800 x1863837546427264/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00000040:3.0:1777497804.558229:0:8397:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546427520 00000100:00100000:2.0:1777497804.558234:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2413:x1863837546427264:12345-192.168.202.4@tcp:400:kworker.0 00000100:00000040:3.0:1777497804.558243:0:8397:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00010000:00000040:2.0:1777497804.558249:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1863837546427264 00000100:00000040:3.0:1777497804.558250:0:8397:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497804.558258:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 12 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497804.558263:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497804.558294:0:8397:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497804.558301:0:8397:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba6300 x1863837546427520/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.558312:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546427520:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 119us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.558320:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2727 00000100:00000040:3.0:1777497804.558323:0:8397:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e23000 : new rpc_count 0 00000100:00100000:1.0:1777497804.558332:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1483 00000020:00000040:3.0:1777497804.558334:0:8397:0:(genops.c:900:class_export_put()) PUTting export ffff924086e23000 : new refcount 6 00000100:00000040:1.0:1777497804.558337:0:63727:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f818b2800 : new rpc_count 1 00000100:00000040:1.0:1777497804.558354:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba5f80 x1863837546427392/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.558356:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427136 00000100:00100000:3.0:1777497804.558362:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427136 00000020:00000040:3.0:1777497804.558366:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:3.0:1777497804.558369:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00100000:1.0:1777497804.558374:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546427392:12345-192.168.202.4@tcp:400:kworker.0 00000100:00000040:3.0:1777497804.558385:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00010000:00000040:1.0:1777497804.558387:0:63727:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1863837546427392 00000100:00000040:1.0:1777497804.558393:0:63727:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 12 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497804.558398:0:63727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00100000:3.0:1777497804.558409:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00000040:3.0:1777497804.558412:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:3.0:1777497804.558417:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a2d17450 x1863837546427136/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.558429:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546427136:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:3.0:1777497804.558439:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546427136 00000100:00000040:3.0:1777497804.558444:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 13 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497804.558448:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:2.0:1777497804.562347:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 12 to 192.168.202.4@tcp 00000100:00000040:2.0:1777497804.562360:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba7800 x1863837546427264/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.562372:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2413:x1863837546427264:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 4143us (4535us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497804.562382:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1482 00000100:00000040:2.0:1777497804.562386:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af7800 : new rpc_count 0 00000020:00000040:2.0:1777497804.562402:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af7800 : new refcount 50 00000100:00080000:2.0:1777497804.562431:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000040:2.0:1777497804.562436:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0001 (ffff9240bcd78000) now 12 - evictor 00000100:00080000:2.0:1777497804.562440:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:2.0:1777497804.562442:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00080000:2.0:1777497804.562444:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000040:2.0:1777497804.562453:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-MDT0000 (ffff9240911f8000) now 16 - evictor 00000100:00000040:3.0:1777497804.563536:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497804.563536:0:63727:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497804.563551:0:63727:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba5f80 x1863837546427392/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.563553:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a2d17450 x1863837546427136/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497804.563576:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546427392:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 5205us (5598us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.563579:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546427136:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 5149us (5637us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497804.563591:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1483 00000100:00100000:3.0:1777497804.563594:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 216 00000100:00000040:1.0:1777497804.563596:0:63727:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f818b2800 : new rpc_count 0 00000100:00000040:3.0:1777497804.563598:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:1.0:1777497804.563609:0:63727:0:(genops.c:900:class_export_put()) PUTting export ffff923f818b2800 : new refcount 10 00000020:00000040:3.0:1777497804.563783:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000020:00000040:2.0:1777497804.834805:0:90586:0:(genops.c:1231:class_import_get()) import ffff9240a3af8000 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000100:00000040:2.0:1777497804.834845:0:90586:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ede464f1] to pc [ptlrpcd_00_01+1] req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.834884:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00000040:2.0:1777497804.834897:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.834911:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565090688:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1777497804.834937:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.834945:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497804.834981:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba6a00 x1863837565090688 msgsize 224 00000100:00100000:2.0:1777497804.834986:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497804.835008:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.835019:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 3948 usecs (4 jiffies) 00000100:00100000:2.0:1777497804.835040:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090688 00000100:00100000:2.0:1777497804.835046:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090688 00000020:00000040:2.0:1777497804.835048:0:23359:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ddb6 00000020:00000040:2.0:1777497804.835051:0:23359:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb65000 refcount=5 00000100:00000040:2.0:1777497804.835072:0:23359:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1777497804.835123:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4119 00000100:00000040:2.0:1777497804.835127:0:23359:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb65000 : new rpc_count 1 00000100:00000040:2.0:1777497804.835132:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba6a00 x1863837565090688/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.835142:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565090688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1777497804.835173:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00010000:00000040:2.0:1777497804.835183:0:23359:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090688 00000100:00000040:2.0:1777497804.835214:0:23359:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:2.0:1777497804.835219:0:23359:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497804.835236:0:23359:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.835252:0:23359:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:2.0:1777497804.835256:0:23359:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba6a00 x1863837565090688/t0(0) o41->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.835264:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565090688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497804.835271:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4119 00000100:00000040:2.0:1777497804.835274:0:23359:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb65000 : new rpc_count 0 00000020:00000040:2.0:1777497804.835283:0:23359:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb65000 : new refcount 4 00000100:00000040:2.0:1777497804.835314:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: skip recheck: last_committed 0 00000100:00000040:2.0:1777497804.835320:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497804.835329:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0001-osp-MDT0000: blocks=353529 free=352888 avail=317185 avail_mb=1239 hwm_mb=3 files=1024000 ffree=1023683 state=0: rc = 0 00000100:00000040:2.0:1777497804.835337:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.835344:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565090688:0@lo:41:osp-pre-1-0.0 00000100:00000040:2.0:1777497804.835350:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5ba4a80 x1863837565090688/t0(0) o41->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497804.835358:0:3657:0:(genops.c:1244:class_import_put()) import ffff9240a3af8000 refcount=2 obd=lustre-MDT0001-osp-MDT0000 00000020:00000040:2.0:1777497804.839001:0:72706:0:(genops.c:1231:class_import_get()) import ffff92408395d800 refcount=3 obd=lustre-MDT0000-osp-MDT0001 00000100:00000040:2.0:1777497804.839049:0:72706:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ede464f1] to pc [ptlrpcd_00_02+2] req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.839450:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.839471:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565090816:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1777497804.839500:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.839507:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497804.839546:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba5c00 x1863837565090816 msgsize 224 00000100:00100000:2.0:1777497804.839550:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497804.840186:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.840202:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-osp-MDT0001: using a timeout of 1830003 usecs (1831 jiffies) 00000100:00100000:2.0:1777497804.840243:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090816 00000100:00100000:2.0:1777497804.840251:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090816 00000020:00000040:2.0:1777497804.840254:0:80394:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd70 00000020:00000040:2.0:1777497804.840258:0:80394:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af2000 refcount=7 00000100:00000040:2.0:1777497804.840279:0:80394:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_out at +6s 00000100:00100000:2.0:1777497804.840308:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4120 00000100:00000040:2.0:1777497804.840312:0:80394:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af2000 : new rpc_count 1 00000100:00000040:2.0:1777497804.840317:0:80394:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba5c00 x1863837565090816/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.840329:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565090816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1777497804.840368:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00010000:00000040:2.0:1777497804.840380:0:80394:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084290, transno 0, xid 1863837565090816 00000100:00000040:2.0:1777497804.840389:0:80394:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:2.0:1777497804.840393:0:80394:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497804.840418:0:80394:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497804.840436:0:80394:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:2.0:1777497804.840441:0:80394:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba5c00 x1863837565090816/t0(0) o41->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/368 e 0 to 0 dl 1777497815 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.840456:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565090816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497804.840463:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4120 00000100:00000040:2.0:1777497804.840466:0:80394:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af2000 : new rpc_count 0 00000020:00000040:2.0:1777497804.840476:0:80394:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af2000 : new refcount 6 00000100:00000040:2.0:1777497804.840512:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: skip recheck: last_committed 120259084290 00000100:00000040:2.0:1777497804.840517:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497804.840528:0:3659:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-MDT0000-osp-MDT0001: blocks=353529 free=352833 avail=317130 avail_mb=1238 hwm_mb=3 files=1024000 ffree=1023574 state=0: rc = 0 00000100:00000040:2.0:1777497804.840536:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497804.840543:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565090816:0@lo:41:osp-pre-0-1.0 00000100:00000040:2.0:1777497804.840551:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff9240b5ba4a80 x1863837565090816/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 1777497820 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497804.841897:0:3659:0:(genops.c:1244:class_import_put()) import ffff92408395d800 refcount=2 obd=lustre-MDT0000-osp-MDT0001 00000001:00080000:2.0:1777497804.842241:0:93015:0:(tgt_lastrcvd.c:988:tgt_cb_last_committed()) lustre-OST0000: transno 4294969520 is committed 00000001:00000040:2.0:1777497804.842246:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 39 00000020:00000040:2.0:1777497804.842249:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 43 00000001:00000040:2.0:1777497804.842257:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 38 00000020:00000040:2.0:1777497804.842259:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 42 00000001:00000040:2.0:1777497804.842264:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 37 00000020:00000040:2.0:1777497804.842266:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 41 00000001:00000040:2.0:1777497804.842269:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 36 00000020:00000040:2.0:1777497804.842270:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 40 00000001:00000040:2.0:1777497804.842274:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 35 00000020:00000040:2.0:1777497804.842289:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 39 00000001:00000040:2.0:1777497804.842295:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 34 00000020:00000040:2.0:1777497804.842297:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 38 00000001:00000040:2.0:1777497804.842302:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 33 00000020:00000040:2.0:1777497804.842304:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 37 00000001:00000040:2.0:1777497804.842308:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 32 00000020:00000040:2.0:1777497804.842310:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 36 00000001:00000040:2.0:1777497804.842315:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 31 00000020:00000040:2.0:1777497804.842316:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 35 00000001:00000040:2.0:1777497804.842320:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 30 00000020:00000040:2.0:1777497804.842321:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 34 00000001:00000040:2.0:1777497804.842324:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 29 00000020:00000040:2.0:1777497804.842325:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 33 00000001:00000040:2.0:1777497804.842328:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 28 00000020:00000040:2.0:1777497804.842330:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 32 00000001:00000040:2.0:1777497804.842332:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 27 00000020:00000040:2.0:1777497804.842333:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 31 00000001:00000040:2.0:1777497804.842337:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 26 00000020:00000040:2.0:1777497804.842339:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 30 00000001:00000040:2.0:1777497804.842342:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 25 00000020:00000040:2.0:1777497804.842344:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 29 00000001:00000040:2.0:1777497804.842348:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 24 00000020:00000040:2.0:1777497804.842349:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 28 00000001:00000040:2.0:1777497804.842353:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 23 00000020:00000040:2.0:1777497804.842354:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 27 00000001:00000040:2.0:1777497804.842358:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 22 00000020:00000040:2.0:1777497804.842359:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 26 00000001:00000040:2.0:1777497804.842362:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 21 00000020:00000040:2.0:1777497804.842364:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 25 00000001:00000040:2.0:1777497804.842366:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 20 00000020:00000040:2.0:1777497804.842373:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 24 00000001:00000040:2.0:1777497804.842377:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 19 00000020:00000040:2.0:1777497804.842378:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 23 00000001:00000040:2.0:1777497804.842382:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 18 00000020:00000040:2.0:1777497804.842383:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 22 00000001:00000040:2.0:1777497804.842387:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 17 00000020:00000040:2.0:1777497804.842389:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 21 00000001:00000040:2.0:1777497804.842391:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 16 00000020:00000040:2.0:1777497804.842393:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 20 00000001:00000040:2.0:1777497804.842396:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 15 00000020:00000040:2.0:1777497804.842397:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 19 00000001:00000040:2.0:1777497804.842400:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 14 00000020:00000040:2.0:1777497804.842401:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 18 00000001:00000040:2.0:1777497804.842405:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 13 00000020:00000040:2.0:1777497804.842406:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 17 00000001:00000040:2.0:1777497804.842409:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 12 00000020:00000040:2.0:1777497804.842410:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 16 00000001:00000040:2.0:1777497804.842413:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 11 00000020:00000040:2.0:1777497804.842415:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 15 00000001:00000040:2.0:1777497804.842417:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 10 00000020:00000040:2.0:1777497804.842419:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 14 00000001:00000040:2.0:1777497804.842423:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 9 00000020:00000040:2.0:1777497804.842424:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 13 00000001:00000040:2.0:1777497804.842426:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 8 00000020:00000040:2.0:1777497804.842428:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 12 00000001:00000040:2.0:1777497804.842431:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 7 00000020:00000040:2.0:1777497804.842432:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 11 00000001:00000040:2.0:1777497804.842434:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 6 00000020:00000040:2.0:1777497804.842436:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 10 00000001:00000040:2.0:1777497804.842438:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 5 00000020:00000040:2.0:1777497804.842445:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 9 00000001:00000040:2.0:1777497804.842448:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 4 00000020:00000040:2.0:1777497804.842450:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 8 00000001:00000040:2.0:1777497804.842453:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 3 00000020:00000040:2.0:1777497804.842455:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 7 00000001:00000040:2.0:1777497804.842458:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 2 00000020:00000040:2.0:1777497804.842459:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 6 00000001:00000040:2.0:1777497804.842463:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 1 00000020:00000040:2.0:1777497804.842464:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 5 00000001:00000040:2.0:1777497804.842466:0:93015:0:(tgt_lastrcvd.c:991:tgt_cb_last_committed()) callback PUTting export ffff9240865c6800 : new cb_count 0 00000020:00000040:2.0:1777497804.842468:0:93015:0:(genops.c:900:class_export_put()) PUTting export ffff9240865c6800 : new refcount 4 00000100:00000040:3.0:1777497804.845413:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845434:0:8:0:(genops.c:1231:class_import_get()) import ffff92408395a800 refcount=4 obd=MGC192.168.202.104@tcp 00000100:00000040:3.0:1777497804.845463:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging 9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6->MGS req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845481:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002b767a4e] to pc [ptlrpcd_00_03+3] req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845522:0:8:0:(genops.c:1231:class_import_get()) import ffff923f8275c800 refcount=3 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1777497804.845530:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845538:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000ef806070] to pc [ptlrpcd_00_00+0] req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845555:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845559:0:8:0:(genops.c:1231:class_import_get()) import ffff923f82ab3800 refcount=3 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1777497804.845566:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845574:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000020b8a812] to pc [ptlrpcd_00_01+1] req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497804.845589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497804.845594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1777497804.845596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845601:0:8:0:(genops.c:1231:class_import_get()) import ffff9240bcc68000 refcount=3 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:3.0:1777497804.845609:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845618:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000007e2552cc] to pc [ptlrpcd_00_02+2] req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845632:0:8:0:(genops.c:1231:class_import_get()) import ffff92409c5dd800 refcount=3 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:3.0:1777497804.845639:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845647:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000014ff6883] to pc [ptlrpcd_00_03+3] req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1777497804.845655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497804.845658:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00000040:3.0:1777497804.845661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845666:0:8:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497804.845672:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845691:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000f5afb28c] to pc [ptlrpcd_00_00+0] req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845719:0:8:0:(genops.c:1231:class_import_get()) import ffff9240bb6f5800 refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:3.0:1777497804.845727:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845736:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005288ab6b] to pc [ptlrpcd_00_01+1] req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845748:0:8:0:(genops.c:1231:class_import_get()) import ffff924086e27000 refcount=3 obd=lustre-MDT0000-lwp-OST0000 00000100:00000040:3.0:1777497804.845754:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845762:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005665b29e] to pc [ptlrpcd_00_02+2] req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845769:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000020:00000040:3.0:1777497804.845780:0:8:0:(genops.c:1231:class_import_get()) import ffff92409fb63000 refcount=3 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:3.0:1777497804.845787:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000040:3.0:1777497804.845795:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000012b4281e] to pc [ptlrpcd_00_03+3] req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845804:0:8:0:(pinger.c:302:ptlrpc_pinger_main()) next wakeup in 5 (3939) 00000100:00000040:3.0:1777497804.845830:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.845842:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565091200:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.845872:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845887:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.845925:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086d41f80 x1863837565091200 msgsize 224 00000100:00100000:3.0:1777497804.845929:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497804.845953:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845964:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0001: using a timeout of 8557 usecs (9 jiffies) 00000100:00000040:3.0:1777497804.845972:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.845979:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565091712:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.845990:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.845996:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846007:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086d43100 x1863837565091712 msgsize 224 00000100:00100000:3.0:1777497804.846010:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497804.846022:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846030:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 6553 usecs (7 jiffies) 00000100:00100000:3.0:1777497804.846047:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00000040:3.0:1777497804.846052:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846061:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565091072:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846080:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846087:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846117:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086d41500 x1863837565091072 msgsize 224 00000100:00100000:3.0:1777497804.846122:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497804.846133:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846150:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0001: using a timeout of 8970 usecs (9 jiffies) 00000100:00000040:3.0:1777497804.846156:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846165:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565091584:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846179:0:3658:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846186:0:3658:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846202:0:3658:0:(events.c:337:request_in_callback()) incoming req@ffff924086d43b80 x1863837565091584 msgsize 224 00000100:00100000:3.0:1777497804.846206:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1777497804.846220:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846229:0:3658:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5573 usecs (6 jiffies) 00000100:00100000:3.0:1777497804.846251:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091200 00000100:00100000:3.0:1777497804.846258:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091200 00000020:00000040:3.0:1777497804.846261:0:64885:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917c5e 00000020:00000040:3.0:1777497804.846265:0:64885:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409fb61800 refcount=5 00000100:00000040:3.0:1777497804.846293:0:64885:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497804.846314:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091712 00000100:00100000:3.0:1777497804.846316:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091712 00000020:00000040:3.0:1777497804.846318:0:64885:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df0d 00000020:00000040:3.0:1777497804.846320:0:64885:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409f6c2800 refcount=5 00000100:00100000:3.0:1777497804.846334:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091072 00000100:00100000:3.0:1777497804.846337:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091072 00000020:00000040:3.0:1777497804.846338:0:64885:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691deff 00000020:00000040:3.0:1777497804.846340:0:64885:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1e800 refcount=5 00000100:00100000:3.0:1777497804.846360:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00000040:3.0:1777497804.846364:0:64885:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409fb61800 : new rpc_count 1 00000100:00000040:3.0:1777497804.846368:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086d41f80 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846389:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565091200:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.846411:0:64885:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091200 00000100:00000040:3.0:1777497804.846420:0:64885:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.846425:0:64885:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846440:0:64885:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846458:0:64885:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.846463:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d41f80 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846471:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1863837565091200:12345-0@lo:400:kworker.0 Request processed in 84us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.846478:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00000040:3.0:1777497804.846482:0:64885:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409fb61800 : new rpc_count 0 00000020:00000040:3.0:1777497804.846491:0:64885:0:(genops.c:900:class_export_put()) PUTting export ffff92409fb61800 : new refcount 4 00000100:00100000:3.0:1777497804.846500:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00000040:3.0:1777497804.846502:0:64885:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409f6c2800 : new rpc_count 1 00000100:00000040:3.0:1777497804.846506:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086d43100 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846514:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565091712:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.846523:0:64885:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091712 00000100:00000040:3.0:1777497804.846526:0:64885:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.846529:0:64885:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846541:0:64885:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846552:0:64885:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.846562:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d43100 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846570:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1863837565091712:12345-0@lo:400:kworker.0 Request processed in 57us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.846576:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00000040:3.0:1777497804.846578:0:64885:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409f6c2800 : new rpc_count 0 00000020:00000040:3.0:1777497804.846583:0:64885:0:(genops.c:900:class_export_put()) PUTting export ffff92409f6c2800 : new refcount 4 00000100:00100000:3.0:1777497804.846591:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00000040:3.0:1777497804.846593:0:64885:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1e800 : new rpc_count 1 00000100:00000040:3.0:1777497804.846597:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086d41500 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846606:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565091072:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.846615:0:64885:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091072 00000100:00000040:3.0:1777497804.846619:0:64885:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.846622:0:64885:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846634:0:64885:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846645:0:64885:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.846649:0:64885:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d41500 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846656:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1863837565091072:12345-0@lo:400:kworker.0 Request processed in 51us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.846661:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00000040:3.0:1777497804.846663:0:64885:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1e800 : new rpc_count 0 00000020:00000040:3.0:1777497804.846668:0:64885:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1e800 : new refcount 4 00000100:00100000:3.0:1777497804.846699:0:23437:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091584 00000100:00100000:3.0:1777497804.846702:0:23437:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091584 00000020:00000040:3.0:1777497804.846709:0:23437:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:3.0:1777497804.846711:0:23437:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000100:00100000:3.0:1777497804.846736:0:23437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2728 00000100:00000040:3.0:1777497804.846738:0:23437:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:3.0:1777497804.846742:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff924086d43b80 x1863837565091584/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846751:0:23437:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565091584:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.846760:0:23437:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565091584 00000100:00000040:3.0:1777497804.846764:0:23437:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.846768:0:23437:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.846782:0:23437:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846793:0:23437:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.846797:0:23437:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d43b80 x1863837565091584/t0(0) o400->lustre-MDT0000-mdtlov_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846804:0:23437:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3658:x1863837565091584:12345-0@lo:400:kworker.0 Request processed in 55us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.846809:0:23437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2728 00000100:00000040:3.0:1777497804.846811:0:23437:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:3.0:1777497804.846815:0:23437:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00000040:3.0:1777497804.846858:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497804.846863:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846872:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846879:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3658:1863837565091072:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846896:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:3.0:1777497804.846899:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846907:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846912:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3658:1863837565091584:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846919:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: skip recheck: last_committed 0 00000100:00000040:3.0:1777497804.846922:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846928:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846934:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3658:1863837565091200:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846942:0:3658:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000040:3.0:1777497804.846946:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.846953:0:3658:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.846959:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3658:1863837565091712:0@lo:400:kworker.0 00000100:00000040:3.0:1777497804.846965:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d40a80 x1863837565091072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497804.846972:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f8275c800 refcount=2 obd=lustre-MDT0000-lwp-OST0001 00000100:00000040:3.0:1777497804.846983:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d41180 x1863837565091584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497804.846989:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497804.847000:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d40700 x1863837565091200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497804.847005:0:3658:0:(genops.c:1244:class_import_put()) import ffff923f82ab3800 refcount=2 obd=lustre-MDT0001-lwp-OST0001 00000100:00000040:3.0:1777497804.847009:0:3658:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d42680 x1863837565091712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1777497804.847014:0:3658:0:(genops.c:1244:class_import_put()) import ffff9240bb6f5800 refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000040:0.0:1777497804.847648:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.847661:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565091328:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.847703:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847711:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.847733:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de1500 x1863837565091328 msgsize 224 00000100:00100000:0.0:1777497804.847737:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497804.847752:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847763:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0001: using a timeout of 4941 usecs (5 jiffies) 00000100:00000040:0.0:1777497804.847770:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.847779:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565091840:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.847791:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847798:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.847809:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de1f80 x1863837565091840 msgsize 224 00000100:00100000:0.0:1777497804.847812:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497804.847821:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847829:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-OST0000: using a timeout of 6285 usecs (7 jiffies) 00000100:00100000:0.0:1777497804.847840:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00000040:0.0:1777497804.847845:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.847861:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565090944:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.847874:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847881:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.847897:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a2d16850 x1863837565090944 msgsize 224 00000100:00100000:0.0:1777497804.847901:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497804.847903:0:3659:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497804.847917:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847939:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.847948:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565091456:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.847960:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.847966:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.847977:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de0e00 x1863837565091456 msgsize 224 00000100:00100000:0.0:1777497804.847981:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497804.847992:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.848001:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0001: using a timeout of 77592 usecs (78 jiffies) 00000100:00000040:0.0:1777497804.848006:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.848015:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565091968:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.848026:0:3659:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.848033:0:3659:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.848050:0:3659:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de3b80 x1863837565091968 msgsize 224 00000100:00100000:0.0:1777497804.848054:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:0.0:1777497804.848064:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.848073:0:3659:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-lwp-OST0000: using a timeout of 4655 usecs (5 jiffies) 00000100:00100000:0.0:1777497804.848090:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565090944 00000100:00100000:0.0:1777497804.848124:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565090944 00000020:00000040:0.0:1777497804.848127:0:90575:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd0e 00000020:00000040:0.0:1777497804.848130:0:90575:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a6374800 refcount=23 00000100:00000040:0.0:1777497804.848145:0:90575:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:0.0:1777497804.848165:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00000040:0.0:1777497804.848167:0:90575:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a6374800 : new rpc_count 1 00000100:00000040:0.0:1777497804.848172:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a2d16850 x1863837565090944/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.848183:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565090944:12345-0@lo:400:kworker.0 00010000:00000040:0.0:1777497804.848195:0:90575:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565090944 00000100:00000040:0.0:1777497804.848201:0:90575:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497804.848205:0:90575:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497804.848221:0:90575:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.848238:0:90575:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497804.848243:0:90575:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a2d16850 x1863837565090944/t0(0) o400->9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.848250:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565090944:12345-0@lo:400:kworker.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497804.848255:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00000040:0.0:1777497804.848258:0:90575:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a6374800 : new rpc_count 0 00000020:00000040:0.0:1777497804.848266:0:90575:0:(genops.c:900:class_export_put()) PUTting export ffff9240a6374800 : new refcount 22 00000100:00000040:0.0:1777497804.848309:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.848318:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.848324:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565090944:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.848329:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d42a00 x1863837565090944/t0(0) o400->MGC192.168.202.104@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497804.848337:0:3659:0:(genops.c:1244:class_import_put()) import ffff92408395a800 refcount=3 obd=MGC192.168.202.104@tcp 00000100:00100000:3.0:1777497804.850878:0:25491:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091328 00000100:00100000:3.0:1777497804.850892:0:25491:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091328 00000020:00000040:3.0:1777497804.850894:0:25491:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e3572656917bd9 00000020:00000040:3.0:1777497804.850899:0:25491:0:(lustre_handles.c:131:class_handle2object()) GET export ffff92409c12b800 refcount=5 00000100:00100000:3.0:1777497804.850963:0:25491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2729 00000100:00000040:3.0:1777497804.850967:0:25491:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff92409c12b800 : new rpc_count 1 00000100:00000040:3.0:1777497804.850973:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de1500 x1863837565091328/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.850987:0:25491:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565091328:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.851008:0:25491:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969442, transno 0, xid 1863837565091328 00000100:00000040:3.0:1777497804.851017:0:25491:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.851022:0:25491:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.851062:0:25491:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.851117:0:25491:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.851123:0:25491:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de1500 x1863837565091328/t0(0) o400->lustre-MDT0001-mdtlov_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851130:0:25491:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_011:lustre-MDT0001-mdtlov_UUID+5:3659:x1863837565091328:12345-0@lo:400:kworker.0 Request processed in 147us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.851136:0:25491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2729 00000100:00000040:3.0:1777497804.851139:0:25491:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff92409c12b800 : new rpc_count 0 00000020:00000040:3.0:1777497804.851157:0:25491:0:(genops.c:900:class_export_put()) PUTting export ffff92409c12b800 : new refcount 4 00000100:00100000:3.0:1777497804.851174:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091840 00000100:00100000:3.0:1777497804.851178:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091840 00000020:00000040:3.0:1777497804.851180:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed1b 00000020:00000040:3.0:1777497804.851183:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e21800 refcount=5 00000100:00000040:3.0:1777497804.851193:0:65418:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497804.851224:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091456 00000100:00100000:3.0:1777497804.851227:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091456 00000020:00000040:3.0:1777497804.851229:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691df06 00000020:00000040:3.0:1777497804.851231:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1f000 refcount=5 00000100:00100000:3.0:1777497804.851249:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565091968 00000100:00100000:3.0:1777497804.851252:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565091968 00000020:00000040:3.0:1777497804.851253:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691ed30 00000020:00000040:3.0:1777497804.851255:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f81b73000 refcount=5 00000100:00100000:3.0:1777497804.851271:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00000040:3.0:1777497804.851274:0:65418:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e21800 : new rpc_count 1 00000100:00000040:3.0:1777497804.851277:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de1f80 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851287:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565091840:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.851300:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091840 00000100:00000040:3.0:1777497804.851305:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.851308:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.851326:0:65418:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.851339:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.851343:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de1f80 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851351:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565091840:12345-0@lo:400:kworker.0 Request processed in 65us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.851357:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00000040:3.0:1777497804.851365:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e21800 : new rpc_count 0 00000020:00000040:3.0:1777497804.851370:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff924086e21800 : new refcount 4 00000100:00100000:3.0:1777497804.851379:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00000040:3.0:1777497804.851382:0:65418:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1f000 : new rpc_count 1 00000100:00000040:3.0:1777497804.851385:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de0e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851394:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565091456:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.851403:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091456 00000100:00000040:3.0:1777497804.851407:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.851411:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.851426:0:65418:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.851439:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.851443:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de0e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851451:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565091456:12345-0@lo:400:kworker.0 Request processed in 58us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.851457:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00000040:3.0:1777497804.851459:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1f000 : new rpc_count 0 00000020:00000040:3.0:1777497804.851464:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1f000 : new refcount 4 00000100:00100000:3.0:1777497804.851472:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00000040:3.0:1777497804.851474:0:65418:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f81b73000 : new rpc_count 1 00000100:00000040:3.0:1777497804.851478:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de3b80 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:560/0 lens 224/0 e 0 to 0 dl 1777497815 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851489:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565091968:12345-0@lo:400:kworker.0 00010000:00000040:3.0:1777497804.851497:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837565091968 00000100:00000040:3.0:1777497804.851508:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:3.0:1777497804.851511:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:3.0:1777497804.851527:0:65418:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1777497804.851538:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:3.0:1777497804.851541:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de3b80 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000_UUID@0@lo:560/0 lens 224/224 e 0 to 0 dl 1777497815 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497804.851549:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565091968:12345-0@lo:400:kworker.0 Request processed in 62us (3497us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497804.851554:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00000040:3.0:1777497804.851556:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f81b73000 : new rpc_count 0 00000020:00000040:3.0:1777497804.851562:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff923f81b73000 : new refcount 4 00000100:00000040:0.0:1777497804.855612:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: skip recheck: last_committed 0 00000100:00000040:0.0:1777497804.855631:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.855646:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.855654:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565091456:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.855667:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497804.855677:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.855699:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.855705:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565091968:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.855720:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: skip recheck: last_committed 4294969442 00000100:00000040:0.0:1777497804.855724:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.855731:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.855753:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565091328:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.855768:0:3659:0:(client.c:3097:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: skip recheck: last_committed 0 00000100:00000040:0.0:1777497804.855772:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1777497804.855780:0:3659:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497804.855787:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565091840:0@lo:400:kworker.0 00000100:00000040:0.0:1777497804.855793:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d40e00 x1863837565091456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497804.855805:0:3659:0:(genops.c:1244:class_import_put()) import ffff92409c5dd800 refcount=2 obd=lustre-MDT0000-lwp-MDT0001 00000100:00000040:0.0:1777497804.855817:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d41c00 x1863837565091968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497804.855824:0:3659:0:(genops.c:1244:class_import_put()) import ffff92409fb63000 refcount=2 obd=lustre-MDT0001-lwp-OST0000 00000100:00000040:0.0:1777497804.855829:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d42300 x1863837565091328/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497804.855834:0:3659:0:(genops.c:1244:class_import_put()) import ffff9240bcc68000 refcount=2 obd=lustre-OST0001-osc-MDT0001 00000100:00000040:0.0:1777497804.855839:0:3659:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d43800 x1863837565091840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1777497820 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000040:0.0:1777497804.855844:0:3659:0:(genops.c:1244:class_import_put()) import ffff924086e27000 refcount=2 obd=lustre-MDT0000-lwp-OST0000 00010000:00010000:3.0:1777497804.966903:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000040:3.0:1777497805.349967:0:90590:0:(genops.c:1231:class_import_get()) import ffff923f839d2800 refcount=3 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:3.0:1777497805.350008:0:90590:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000005288ab6b] to pc [ptlrpcd_00_00+0] req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497805.350064:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497805.350079:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565092096:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1777497805.350138:0:3657:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 2 fl Rpc:r/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497805.350147:0:3657:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:2.0:1777497805.350185:0:3657:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba4a80 x1863837565092096 msgsize 224 00000100:00100000:2.0:1777497805.350190:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:2.0:1777497805.350211:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 1 req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1777497805.350223:0:3657:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0001-osc-MDT0000: using a timeout of 5446 usecs (6 jiffies) 00000100:00100000:0.0:1777497805.350323:0:8399:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092096 00000100:00100000:0.0:1777497805.350331:0:8399:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092096 00000020:00000040:0.0:1777497805.350334:0:8399:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dde0 00000020:00000040:0.0:1777497805.350338:0:8399:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f88a1d800 refcount=5 00000020:00000040:0.0:1777497805.350350:0:8399:0:(obd_config.c:994:class_incref()) incref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:0.0:1777497805.350380:0:8399:0:(service.c:1430:ptlrpc_at_set_timer()) armed ost_create at +6s 00000100:00100000:0.0:1777497805.350420:0:8399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2216 00000100:00000040:0.0:1777497805.350424:0:8399:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f88a1d800 : new rpc_count 1 00000100:00000040:0.0:1777497805.350429:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba4a80 x1863837565092096/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/0 e 0 to 0 dl 1777497816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497805.350440:0:8399:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565092096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1777497805.350470:0:8399:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00010000:00000040:0.0:1777497805.350481:0:8399:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 4294969455, transno 0, xid 1863837565092096 00000100:00000040:0.0:1777497805.350491:0:8399:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff924089288a00 refcount 66 to 0@lo 00000100:00000040:0.0:1777497805.350498:0:8399:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000040:0.0:1777497805.350517:0:8399:0:(events.c:149:reply_in_callback()) @@@ reply in flags=200 mlen=368 offset=224 replen=368 req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1777497805.350575:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000040:1.0:1777497805.350579:0:6510:0:(obd_config.c:1022:class_decref()) Decref lustre-OST0001 (ffff9240bcfd8000) now 10 - evictor 00000100:00000040:0.0:1777497805.358901:0:8399:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff924089288a00 refcount 65 to 0@lo 00000100:00000040:0.0:1777497805.358917:0:8399:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4a80 x1863837565092096/t0(0) o13->lustre-MDT0000-mdtlov_UUID@0@lo:561/0 lens 224/368 e 0 to 0 dl 1777497816 ref 1 fl Interpret:/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497805.358929:0:8399:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565092096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8490us (8742us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497805.358940:0:8399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2216 00000100:00000040:0.0:1777497805.358944:0:8399:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f88a1d800 : new rpc_count 0 00000020:00000040:0.0:1777497805.358959:0:8399:0:(genops.c:900:class_export_put()) PUTting export ffff923f88a1d800 : new refcount 4 00000100:00000040:2.0:1777497805.359203:0:3657:0:(client.c:3097:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: skip recheck: last_committed 4294969455 00000100:00000040:2.0:1777497805.359211:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00000040:2.0:1777497805.359225:0:3657:0:(osp_precreate.c:87:osp_pre_update_status_msfs()) lustre-OST0001-osc-MDT0000: Updating status = 0 00000004:00000040:2.0:1777497805.359229:0:3657:0:(osp_precreate.c:1077:osp_pre_update_msfs()) lustre-OST0001-osc-MDT0000: blocks=958279 free=957893 avail=901318 avail_mb=3520 hwm_mb=7 files=262144 ffree=261732 state=0: rc = 0 00000100:00000040:2.0:1777497805.359237:0:3657:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 1 fl Interpret:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497805.359259:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565092096:0@lo:13:osp-pre-1-0.0 00000100:00000040:2.0:1777497805.359267:0:3657:0:(client.c:2851:__ptlrpc_req_put()) @@@ refcount now 0 req@ffff924086d42680 x1863837565092096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1777497821 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000020:00000040:2.0:1777497805.359277:0:3657:0:(genops.c:1244:class_import_put()) import ffff923f839d2800 refcount=2 obd=lustre-OST0001-osc-MDT0000 00000100:00000040:0.0:1777497805.570160:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240a2d16450 x1863837546427648 msgsize 224 00000100:00100000:0.0:1777497805.570177:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:0.0:1777497805.570180:0:3651:0:(events.c:349:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000040:0.0:1777497805.570219:0:3651:0:(events.c:337:request_in_callback()) incoming req@ffff9240a6de3100 x1863837546427776 msgsize 224 00000100:00100000:0.0:1777497805.570224:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497805.570291:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427648 00000100:00100000:3.0:1777497805.570301:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427648 00000020:00000040:3.0:1777497805.570304:0:90580:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dceb 00000020:00000040:3.0:1777497805.570307:0:90580:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240bb786000 refcount=9 00000100:00000040:3.0:1777497805.570331:0:90580:0:(service.c:1430:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00100000:3.0:1777497805.570362:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00000040:3.0:1777497805.570366:0:90580:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240bb786000 : new rpc_count 1 00000100:00000040:3.0:1777497805.570372:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a2d16450 x1863837546427648/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:561/0 lens 224/0 e 0 to 0 dl 1777497816 ref 1 fl New:/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.570385:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546427648:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:3.0:1777497805.570406:0:90580:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546427648 00000100:00000040:3.0:1777497805.570417:0:90580:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570429:0:90580:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570467:0:90580:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570473:0:90580:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a2d16450 x1863837546427648/t0(0) o400->34a4158d-137e-4629-9769-4a4bd53f7f61@192.168.202.4@tcp:561/0 lens 224/224 e 0 to 0 dl 1777497816 ref 1 fl Interpret:/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.570482:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2412:x1863837546427648:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497805.570489:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 218 00000100:00000040:3.0:1777497805.570492:0:90580:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240bb786000 : new rpc_count 0 00000020:00000040:3.0:1777497805.570501:0:90580:0:(genops.c:900:class_export_put()) PUTting export ffff9240bb786000 : new refcount 8 00000100:00100000:3.0:1777497805.570524:0:65418:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427776 00000100:00100000:3.0:1777497805.570527:0:65418:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427776 00000020:00000040:3.0:1777497805.570529:0:65418:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691dd77 00000020:00000040:3.0:1777497805.570531:0:65418:0:(lustre_handles.c:131:class_handle2object()) GET export ffff9240a3af7800 refcount=51 00000100:00000040:3.0:1777497805.570541:0:65418:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497805.570558:0:65418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1490 00000100:00000040:3.0:1777497805.570561:0:65418:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff9240a3af7800 : new rpc_count 1 00000100:00000040:3.0:1777497805.570564:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240a6de3100 x1863837546427776/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/0 e 0 to 0 dl 1777497816 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.570575:0:65418:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a6de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2412:x1863837546427776:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:3.0:1777497805.570587:0:65418:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 120259084436, transno 0, xid 1863837546427776 00000100:00000040:3.0:1777497805.570592:0:65418:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570595:0:65418:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570606:0:65418:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.570610:0:65418:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240a6de3100 x1863837546427776/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/224 e 0 to 0 dl 1777497816 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.570617:0:65418:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a6de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d146155b-4321-4b14-9284-f644ed9631fb+51:2412:x1863837546427776:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497805.570631:0:65418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1490 00000100:00000040:3.0:1777497805.570633:0:65418:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff9240a3af7800 : new rpc_count 0 00000020:00000040:3.0:1777497805.570639:0:65418:0:(genops.c:900:class_export_put()) PUTting export ffff9240a3af7800 : new refcount 50 00000100:00000040:2.0:1777497805.578433:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba6680 x1863837546428032 msgsize 224 00000100:00100000:2.0:1777497805.578449:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00000040:2.0:1777497805.578483:0:3652:0:(events.c:337:request_in_callback()) incoming req@ffff9240b5ba4e00 x1863837546427904 msgsize 224 00000100:00100000:2.0:1777497805.578488:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:1.0:1777497805.578544:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428032 00000100:00100000:1.0:1777497805.578555:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428032 00000020:00000040:1.0:1777497805.578558:0:25495:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691e113 00000020:00000040:1.0:1777497805.578562:0:25495:0:(lustre_handles.c:131:class_handle2object()) GET export ffff924086e23000 refcount=7 00000100:00100000:1.0:1777497805.578614:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2730 00000100:00000040:1.0:1777497805.578618:0:25495:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff924086e23000 : new rpc_count 1 00000100:00000040:1.0:1777497805.578625:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba6680 x1863837546428032/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/0 e 0 to 0 dl 1777497816 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497805.578637:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546428032:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:1.0:1777497805.578658:0:25495:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 0, transno 0, xid 1863837546428032 00000100:00000040:1.0:1777497805.578667:0:25495:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497805.578682:0:25495:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:1.0:1777497805.578728:0:25495:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:1.0:1777497805.578733:0:25495:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba6680 x1863837546428032/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/224 e 0 to 0 dl 1777497816 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1777497805.578742:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546428032:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 106us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497805.578749:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2730 00000100:00000040:1.0:1777497805.578752:0:25495:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff924086e23000 : new rpc_count 0 00000020:00000040:1.0:1777497805.578760:0:25495:0:(genops.c:900:class_export_put()) PUTting export ffff924086e23000 : new refcount 6 00000100:00100000:3.0:1777497805.579018:0:73210:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546427904 00000100:00100000:3.0:1777497805.579022:0:73210:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546427904 00000020:00000040:3.0:1777497805.579024:0:73210:0:(genops.c:825:class_conn2export()) looking for export cookie 0x3e357265691d36e 00000020:00000040:3.0:1777497805.579027:0:73210:0:(lustre_handles.c:131:class_handle2object()) GET export ffff923f818b2800 refcount=11 00000100:00000040:3.0:1777497805.579041:0:73210:0:(service.c:1430:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00100000:3.0:1777497805.579068:0:73210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1491 00000100:00000040:3.0:1777497805.579071:0:73210:0:(service.c:2236:ptlrpc_server_request_get()) RPC GETting export ffff923f818b2800 : new rpc_count 1 00000100:00000040:3.0:1777497805.579075:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@ffff9240b5ba4e00 x1863837546427904/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/0 e 0 to 0 dl 1777497816 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.579085:0:73210:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546427904:12345-192.168.202.4@tcp:400:kworker.0 00010000:00000040:3.0:1777497805.579123:0:73210:0:(ldlm_lib.c:3288:target_committed_to_req()) last_committed 81604378768, transno 0, xid 1863837546427904 00000100:00000040:3.0:1777497805.579129:0:73210:0:(connection.c:161:ptlrpc_connection_addref()) conn=ffff9240a6a10500 refcount 11 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.579132:0:73210:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-192.168.202.4@tcp 00000100:00000040:3.0:1777497805.579153:0:73210:0:(lustre_net.h:1981:ptlrpc_connection_put()) PUT conn=ffff9240a6a10500 refcount 10 to 192.168.202.4@tcp 00000100:00000040:3.0:1777497805.579157:0:73210:0:(lustre_net.h:2432:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@ffff9240b5ba4e00 x1863837546427904/t0(0) o400->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:561/0 lens 224/224 e 0 to 0 dl 1777497816 ref 1 fl Interpret:H/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497805.579166:0:73210:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546427904:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 82us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497805.579172:0:73210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1491 00000100:00000040:3.0:1777497805.579174:0:73210:0:(service.c:1111:ptlrpc_server_finish_active_request()) RPC PUTting export ffff923f818b2800 : new rpc_count 0 00000020:00000040:3.0:1777497805.579180:0:73210:0:(genops.c:900:class_export_put()) PUTting export ffff923f818b2800 : new refcount 10 00000001:02000400:0.0:1777497805.595668:0:93355:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1777497805.986692:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1777497806.659599:0:93408:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1777497806.659974:0:93408:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1777497806.883356:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565092224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1777497806.883432:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497806.883832:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092224 00000100:00100000:3.0:1777497806.883841:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092224 00000100:00100000:3.0:1777497806.884142:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2217 00000100:00100000:3.0:1777497806.884153:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565092224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497806.884183:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497806.884235:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924089385880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565092224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497806.884242:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2217 00000100:00100000:3.0:1777497806.884285:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565092224:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1777497806.887266:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1777497807.010544:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1777497807.574004:0:93458:0:(tgt_mount.c:2299:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1777497807.574246:0:93458:0:(tgt_mount.c:2314:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1777497808.034583:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1777497809.067768:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497809.954282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497809.954287:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:2.0:1777497809.954294:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565092608:0@lo:400:kworker.0 00000100:00080000:3.0:1777497809.954304:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497809.954307:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1777497809.954353:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b5ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565092480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497809.954377:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.954386:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.954408:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565093120:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.954416:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565092992:0@lo:400:kworker.0 00000100:00100000:3.0:1777497809.954426:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497809.954438:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.954442:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837565093632:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.954453:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565093504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497809.954463:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497809.954480:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092480 00000100:00100000:3.0:1777497809.954482:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777497809.954487:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565092736:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.954488:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092480 00000100:00100000:3.0:1777497809.954504:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.954517:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565093248:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.954530:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4121 00000100:00100000:3.0:1777497809.954532:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497809.954538:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565092480:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1777497809.954544:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565093760:0@lo:400:kworker.0 00000004:00000024:2.0:1777497809.954570:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:3.0:1777497809.954579:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.954603:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092608 00000100:00100000:3.0:1777497809.954607:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092608 00000100:00100000:2.0:1777497809.954608:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565092480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497809.954615:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4121 00000100:00100000:2.0:1777497809.954648:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093248 00000100:00100000:2.0:1777497809.954652:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093248 00000100:00100000:3.0:1777497809.954664:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093120 00000100:00100000:3.0:1777497809.954666:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093120 00000100:00100000:2.0:1777497809.954670:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4122 00000100:00100000:0.0:1777497809.954784:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565092352:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.954818:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497809.954844:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565092864:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.954863:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497809.954873:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565093376:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.954890:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497809.954918:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092352 00000100:00100000:0.0:1777497809.954922:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092352 00000100:00100000:0.0:1777497809.954948:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1777497809.954954:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.954985:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3659:x1863837565092352:12345-0@lo:400:kworker.0 Request processed in 31us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.954991:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1777497809.955031:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3659:1863837565092352:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955060:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565093248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955062:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093632 00000100:00100000:0.0:1777497809.955065:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093632 00000100:00100000:0.0:1777497809.955082:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092736 00000100:00100000:0.0:1777497809.955084:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092736 00000100:00100000:2.0:1777497809.955109:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565093248:12345-0@lo:400:kworker.0 Request processed in 418us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497809.955116:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4122 00000100:00100000:2.0:1777497809.955127:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092864 00000100:00100000:0.0:1777497809.955129:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093760 00000100:00100000:2.0:1777497809.955130:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092864 00000100:00100000:0.0:1777497809.955131:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093760 00000100:00100000:2.0:1777497809.955142:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4123 00000100:00100000:0.0:1777497809.955143:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1777497809.955147:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565092864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955148:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565092608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955173:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1863837565092608:12345-0@lo:400:kworker.0 Request processed in 25us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955179:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:2.0:1777497809.955190:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84701c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3659:x1863837565092864:12345-0@lo:400:kworker.0 Request processed in 43us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497809.955195:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4123 00000100:00100000:0.0:1777497809.955199:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1777497809.955204:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837565093632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955210:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1777497809.955230:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3660:1863837565092608:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955230:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3657:x1863837565093632:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955235:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1777497809.955244:0:63729:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093504 00000100:00100000:0.0:1777497809.955247:0:63729:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093504 00000100:00100000:2.0:1777497809.955252:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3659:1863837565092864:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955259:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1777497809.955264:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565092736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955278:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1777497809.955284:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565093760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955290:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3657:x1863837565092736:12345-0@lo:400:kworker.0 Request processed in 26us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955295:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1777497809.955306:0:63729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1777497809.955308:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3657:x1863837565093760:12345-0@lo:400:kworker.0 Request processed in 25us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955311:0:63729:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565093504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955313:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1777497809.955338:0:63729:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1863837565093504:12345-0@lo:400:kworker.0 Request processed in 27us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955343:0:63729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:0.0:1777497809.955360:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565092992 00000100:00080000:2.0:1777497809.955363:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1777497809.955363:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565092992 00000100:00080000:2.0:1777497809.955366:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1777497809.955392:0:25496:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093376 00000100:00100000:0.0:1777497809.955395:0:25496:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093376 00000100:00080000:2.0:1777497809.955412:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1777497809.955412:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1777497809.955417:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565092992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955446:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3657:1863837565092736:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955446:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565092992:12345-0@lo:400:kworker.0 Request processed in 29us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955452:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2731 00000100:00100000:0.0:1777497809.955462:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1777497809.955466:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565093248:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955472:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565093376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955477:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f86069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3657:1863837565093760:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955489:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b5ba5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565092480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1777497809.955499:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3657:1863837565093632:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955501:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84700a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565093376:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497809.955506:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2732 00000100:00100000:2.0:1777497809.955536:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565092992:0@lo:400:kworker.0 00000100:00100000:0.0:1777497809.955536:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565093376:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.955545:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3660:1863837565093504:0@lo:400:kworker.0 00000100:00100000:3.0:1777497809.956290:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:3.0:1777497809.956301:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b54d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565093120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497809.956360:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b54d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3657:x1863837565093120:12345-0@lo:400:kworker.0 Request processed in 63us (1932us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497809.956367:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1777497809.956965:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086d43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3657:1863837565093120:0@lo:400:kworker.0 00000100:00100000:2.0:1777497809.957876:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1777497809.957890:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565093888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1777497809.957939:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497809.958038:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565093888 00000100:00100000:3.0:1777497809.958044:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565093888 00000100:00100000:3.0:1777497809.958085:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4124 00000100:00100000:3.0:1777497809.958110:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565093888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1777497809.958138:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:3.0:1777497809.958190:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565093888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497809.958196:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4124 00000100:00100000:0.0:1777497809.958795:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565093888:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1777497810.082509:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1777497810.466533:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565094016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1777497810.466607:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497810.470566:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094016 00000100:00100000:1.0:1777497810.470580:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094016 00000100:00100000:1.0:1777497810.470688:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2218 00000100:00100000:1.0:1777497810.470698:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565094016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1777497810.470733:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1777497810.470821:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565094016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (4214us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497810.470829:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2218 00000100:00100000:0.0:1777497810.471294:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565094016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1777497810.749922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497810.749962:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497810.749999:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497810.750024:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497810.750061:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428288 00000100:00100000:2.0:1777497810.750072:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428288 00000100:00100000:2.0:1777497810.750172:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1498 00000100:00100000:2.0:1777497810.750182:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+51:2413:x1863837546428288:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497810.750268:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+51:2413:x1863837546428288:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497810.750275:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1498 00000100:00100000:2.0:1777497810.750290:0:63728:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428416 00000100:00100000:2.0:1777497810.750292:0:63728:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428416 00000100:00100000:2.0:1777497810.750312:0:63728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1499 00000100:00100000:2.0:1777497810.750317:0:63728:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546428416:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:2.0:1777497810.750352:0:63728:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d146155b-4321-4b14-9284-f644ed9631fb+11:2413:x1863837546428416:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 35us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1777497810.750358:0:63728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1499 00000100:00080000:2.0:1777497810.750463:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1777497810.750467:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497810.750638:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428544 00000100:00100000:1.0:1777497810.750643:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428544 00000100:00100000:1.0:1777497810.750676:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2733 00000100:00100000:1.0:1777497810.750683:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546428544:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497810.750714:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f82d43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+7:2413:x1863837546428544:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 32us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497810.750720:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2733 00000100:00080000:1.0:1777497810.750734:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497810.750832:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428160 00000100:00100000:3.0:1777497810.750836:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428160 00000100:00100000:3.0:1777497810.750871:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 220 00000100:00100000:3.0:1777497810.750878:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546428160:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497810.750902:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2413:x1863837546428160:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 25us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497810.750907:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 220 00010000:00010000:0.0:1777497811.106404:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1777497811.874796:0:93555:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg204-client.virtnet: executing wait_import_state_mount REPLAY_LOCKS osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid 00000100:00100000:1.0:1777497812.002306:0:3658:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1777497812.002320:0:3658:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565094144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497812.002381:0:3658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497812.002456:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094144 00000100:00100000:3.0:1777497812.002470:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094144 00000100:00100000:3.0:1777497812.002531:0:8400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2219 00000100:00100000:3.0:1777497812.002540:0:8400:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565094144:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1777497812.002686:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1777497812.003162:0:8400:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497812.003229:0:8400:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3658:x1863837565094144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 690us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497812.003236:0:8400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2219 00000100:00100000:1.0:1777497812.003340:0:3658:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3658:1863837565094144:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497812.132347:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1777497813.154457:0:16604:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1777497813.825363:0:93604:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid in REPLAY_LOCKS state after 0 sec 00010000:00010000:2.0:1777497814.178425:0:6503:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1777497815.074274:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497815.074279:0:82203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00080000:3.0:1777497815.074296:0:82203:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level REPLAY_WAIT/7 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1777497815.074300:0:82203:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: REPLAY_WAIT) 00000100:00100000:3.0:1777497815.074345:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565094656:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074413:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074444:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565095168:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074465:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074486:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1777497815.074491:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565094272:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074516:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074539:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565094784:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074559:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074575:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565095296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074608:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074633:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565094400:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074687:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074707:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565094912:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074728:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074742:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565095424:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074758:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074773:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1777497815.074777:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565094528:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074794:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074809:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240b54d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565095040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074826:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074841:0:3659:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff923f8df29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565095552:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.074857:0:3659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.074885:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094656 00000100:00100000:3.0:1777497815.074893:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094656 00000100:00100000:3.0:1777497815.074932:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095040 00000100:00100000:3.0:1777497815.074935:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095040 00000100:00100000:3.0:1777497815.074969:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1777497815.074978:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565094656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.075026:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565094656:12345-0@lo:400:kworker.0 Request processed in 49us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.075032:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4125 00000100:00100000:3.0:1777497815.075048:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4126 00000100:00100000:3.0:1777497815.075053:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565095040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.075081:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3659:x1863837565095040:12345-0@lo:400:kworker.0 Request processed in 28us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.075121:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4126 00000100:00100000:3.0:1777497815.075140:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095296 00000100:00100000:3.0:1777497815.075144:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095296 00000100:00100000:3.0:1777497815.075161:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094400 00000100:00100000:3.0:1777497815.075163:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094400 00000100:00100000:3.0:1777497815.075181:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094912 00000100:00100000:3.0:1777497815.075183:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094912 00000100:00100000:3.0:1777497815.075191:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095424 00000100:00100000:3.0:1777497815.075193:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095424 00000100:00100000:3.0:1777497815.075202:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094528 00000100:00100000:3.0:1777497815.075203:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094528 00000100:00100000:3.0:1777497815.075212:0:64885:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095552 00000100:00100000:3.0:1777497815.075214:0:64885:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095552 00000100:00100000:3.0:1777497815.075225:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1777497815.075230:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565095296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.075258:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3657:x1863837565095296:12345-0@lo:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.075263:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:3.0:1777497815.075273:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1777497815.075278:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f84f41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565094400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.075296:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f84f41850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1863837565094400:12345-0@lo:400:kworker.0 Request processed in 18us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.075301:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1777497815.076573:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1777497815.076597:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565094912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076654:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1863837565094912:12345-0@lo:400:kworker.0 Request processed in 72us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.076660:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:3.0:1777497815.076686:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1777497815.076693:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565095424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076723:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1863837565095424:12345-0@lo:400:kworker.0 Request processed in 32us (1964us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.076728:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:3.0:1777497815.076740:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1777497815.076747:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565094528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076774:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1863837565094528:12345-0@lo:400:kworker.0 Request processed in 29us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.076779:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1777497815.076788:0:64885:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1777497815.076793:0:64885:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565095552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076816:0:64885:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1863837565095552:12345-0@lo:400:kworker.0 Request processed in 23us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.076821:0:64885:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1777497815.076894:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3659:1863837565094528:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076906:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3659:1863837565095040:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076915:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3659:1863837565095552:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076926:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3659:1863837565094400:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076936:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3659:1863837565094912:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076945:0:3659:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3659:1863837565095424:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.076985:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff923f8df2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3657:1863837565095296:0@lo:400:kworker.0 00000100:00100000:3.0:1777497815.077009:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565094656:0@lo:400:kworker.0 00000100:00080000:1.0:1777497815.078919:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1777497815.078926:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1777497815.078973:0:90575:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094272 00000100:00100000:1.0:1777497815.078982:0:90575:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094272 00000100:00100000:1.0:1777497815.079037:0:90575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1777497815.079046:0:90575:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565094272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.079158:0:90575:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6+23:3657:x1863837565094272:12345-0@lo:400:kworker.0 Request processed in 113us (4640us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497815.079165:0:90575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1777497815.079199:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095168 00000100:00100000:1.0:1777497815.079204:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095168 00000100:00100000:1.0:1777497815.079242:0:25485:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565094784 00000100:00100000:1.0:1777497815.079245:0:25485:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565094784 00000100:00100000:1.0:1777497815.079266:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1777497815.079273:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565095168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.079303:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565095168:12345-0@lo:400:kworker.0 Request processed in 31us (4837us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497815.079309:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2734 00000100:00100000:1.0:1777497815.079320:0:25485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2735 00000100:00100000:1.0:1777497815.079326:0:25485:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565094784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.079349:0:25485:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff923f8df28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3657:x1863837565094784:12345-0@lo:400:kworker.0 Request processed in 24us (4789us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497815.079354:0:25485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2735 00000100:00080000:1.0:1777497815.079377:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1777497815.079398:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9c94c246-2bfd-4cc1-9b33-9f51fe7f62a6:3657:1863837565094272:0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.079410:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565094784:0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.079418:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240b54dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565095168:0@lo:400:kworker.0 00000100:00100000:1.0:1777497815.080961:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565095680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497815.081017:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.081259:0:80394:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095680 00000100:00100000:3.0:1777497815.081266:0:80394:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095680 00000100:00100000:3.0:1777497815.081313:0:80394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4127 00000100:00100000:3.0:1777497815.081322:0:80394:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565095680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1777497815.081354:0:80394:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445203968 avail 1298964480 00000100:00100000:3.0:1777497815.081398:0:80394:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:3657:x1863837565095680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.081405:0:80394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4127 00000100:00100000:1.0:1777497815.081516:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3657:1863837565095680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1777497815.091188:0:3657:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1777497815.091210:0:3657:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff9240bcc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565095808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1777497815.091277:0:3657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1777497815.091327:0:23359:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095808 00000100:00100000:1.0:1777497815.091334:0:23359:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095808 00000100:00100000:1.0:1777497815.091379:0:23359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4128 00000100:00100000:1.0:1777497815.091388:0:23359:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565095808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1777497815.091419:0:23359:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445429248 avail 1299189760 00000100:00100000:1.0:1777497815.091457:0:23359:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:3657:x1863837565095808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497815.091464:0:23359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4128 00000100:00100000:1.0:1777497815.091511:0:3657:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff9240bcc04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3657:1863837565095808:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1777497815.205519:0:83956:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1777497815.590848:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1777497815.590871:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565095936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1777497815.590950:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1777497815.591002:0:10306:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565095936 00000100:00100000:3.0:1777497815.591011:0:10306:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565095936 00000100:00100000:3.0:1777497815.591064:0:10306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1777497815.591074:0:10306:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565095936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1777497815.591136:0:10306:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497815.591182:0:10306:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1863837565095936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.591190:0:10306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2220 00000100:00100000:3.0:1777497815.591247:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3660:1863837565095936:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1777497815.604612:0:93652:0:(debug.c:645:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_135: @@@@@@ FAIL: Unexpected sync success 00000100:00100000:3.0:1777497815.887161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497815.887203:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497815.887229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497815.887251:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:3.0:1777497815.887283:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428928 00000100:00100000:3.0:1777497815.887303:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428928 00000100:00100000:3.0:1777497815.887359:0:63727:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428800 00000100:00100000:3.0:1777497815.887361:0:63727:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428800 00000100:00100000:3.0:1777497815.887380:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1506 00000100:00100000:3.0:1777497815.887388:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546428928:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497815.887449:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+11:2415:x1863837546428928:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 62us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.887456:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1506 00000100:00100000:3.0:1777497815.887469:0:63727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 1507 00000100:00100000:3.0:1777497815.887474:0:63727:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2415:x1863837546428800:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497815.887492:0:63727:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d146155b-4321-4b14-9284-f644ed9631fb+51:2415:x1863837546428800:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 18us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.887498:0:63727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 1507 00000100:00100000:3.0:1777497815.887512:0:8397:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429056 00000100:00100000:3.0:1777497815.887515:0:8397:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429056 00000100:00100000:3.0:1777497815.887548:0:8397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2736 00000100:00100000:3.0:1777497815.887554:0:8397:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546429056:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:3.0:1777497815.887573:0:8397:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff924086433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d146155b-4321-4b14-9284-f644ed9631fb+7:2415:x1863837546429056:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 20us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497815.887588:0:8397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2736 00000100:00080000:3.0:1777497815.887602:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1777497815.887606:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1777497815.887608:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1777497815.887695:0:90580:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546428672 00000100:00100000:1.0:1777497815.887699:0:90580:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546428672 00000100:00100000:1.0:1777497815.887733:0:90580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 222 00000100:00100000:1.0:1777497815.887739:0:90580:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546428672:12345-192.168.202.4@tcp:400:kworker.0 00000100:00100000:1.0:1777497815.887762:0:90580:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240a2d15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:34a4158d-137e-4629-9769-4a4bd53f7f61+9:2415:x1863837546428672:12345-192.168.202.4@tcp:400:kworker.0 Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1777497815.887768:0:90580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 222 00010000:00010000:0.0:1777497816.226478:0:8412:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1777497817.125518:0:3660:0:(client.c:1904:ptlrpc_send_new_req()) Sending RPC req@ffff924086430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565096064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1777497817.125600:0:3660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1777497817.129765:0:8400:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837565096064 00000100:00100000:0.0:1777497817.129865:0:8400:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837565096064 00000100:00080000:3.0:1777497817.129990:0:6510:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1777497817.130010:0:25316:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2221 00000100:00100000:3.0:1777497817.130024:0:25316:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565096064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1777497817.130076:0:25316:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8647872 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1777497817.137619:0:25316:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240bcc04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1863837565096064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7584us (12003us total) trans 0 rc 0/0 00000100:00100000:3.0:1777497817.137633:0:25316:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2221 00000100:00100000:1.0:1777497817.142620:0:3660:0:(client.c:2390:ptlrpc_check_set()) Completed RPC req@ffff924086430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3660:1863837565096064:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1777497817.252396:0:6502:0:(ldlm_lockd.c:2797:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1777497817.477523:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.477575:0:25489:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429184 00000100:00100000:2.0:1777497817.477584:0:25489:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429184 00000100:00100000:2.0:1777497817.477636:0:25489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 2737 00000100:00100000:2.0:1777497817.477647:0:25489:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546429184:12345-192.168.202.4@tcp:8:ptlrpcd_rcv.0 00010000:02000400:2.0:1777497817.477682:0:25489:0:(ldlm_lib.c:964:target_handle_reconnect()) lustre-OST0000: Client d146155b-4321-4b14-9284-f644ed9631fb (at 192.168.202.4@tcp) reconnected, waiting for 3 clients in recovery for 1:23 00010000:00080000:2.0:1777497817.498848:0:25489:0:(ldlm_lib.c:1431:target_handle_connect()) lustre-OST0000: connection from d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp recovering/t4294969481 exp ffff9240865c6800 cur 3946 last 1777497817 00002000:00100000:0.0:1777497817.498958:0:25489:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d146155b-4321-4b14-9284-f644ed9631fb/ffff9240865c6800 ocd_connect_flags: 0xa0465af2e3640038 ocd_version: 211345d ocd_grant: 8388608 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1777497817.498983:0:25489:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli 192.168.202.4@tcp supports cksum type f7, return f7 00000100:00080000:0.0:1777497817.499012:0:25489:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 : changing import state from FULL to RECOVER 00000100:00080000:0.0:1777497817.499022:0:25489:0:(import.c:65:import_set_state_nolock()) ffff923f839d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1777497817.499121:0:25489:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546429184:12345-192.168.202.4@tcp:8:ptlrpcd_rcv.0 Request processed in 21475us (21606us total) trans 0 rc 0/0 00000100:00100000:0.0:1777497817.499132:0:25489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 2737 00000100:00100000:2.0:1777497817.518580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.518620:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.518647:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.518684:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.518715:0:8717:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429440 00000100:00100000:1.0:1777497817.518716:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429312 00000100:00100000:2.0:1777497817.518725:0:8717:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429440 00000100:00100000:1.0:1777497817.518731:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429312 00000100:00100000:1.0:1777497817.518883:0:25495:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429568 00000100:00100000:1.0:1777497817.518887:0:25495:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429568 00000100:00100000:3.0:1777497817.518924:0:25487:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429696 00000100:00100000:3.0:1777497817.518928:0:25487:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429696 00000100:00100000:0.0:1777497817.519327:0:25496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5994 00000100:00100000:0.0:1777497817.519341:0:25496:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429312:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777497817.519378:0:25496:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba5880 x1863837546429312/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497817.519396:0:25496:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_016:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429312:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 60us (836us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497817.519403:0:25496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5994 00000100:00100000:2.0:1777497817.523904:0:8717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5995 00000100:00100000:2.0:1777497817.523943:0:8717:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429440:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777497817.523966:0:8717:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba7480 x1863837546429440/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497817.523982:0:25487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5996 00000100:00100000:2.0:1777497817.523982:0:8717:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429440:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 65us (5359us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497817.523997:0:25487:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429696:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777497817.524010:0:25487:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba7b80 x1863837546429696/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497817.524014:0:8717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5995 00000100:00100000:3.0:1777497817.524025:0:25487:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:d146155b-4321-4b14-9284-f644ed9631fb+8:2411:x1863837546429696:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 34us (5351us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497817.524031:0:25487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5996 00010000:00080000:2.0:1777497817.524040:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.524051:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba5880 x1863837546429312/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.524060:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.524086:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497817.524089:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.526027:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba7480 x1863837546429440/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.526046:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.526062:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497817.527245:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.527259:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba7b80 x1863837546429696/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.527269:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.527285:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:2.0:1777497817.527409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.527446:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.527467:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.527489:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.4@tcp (source: 12345-192.168.202.4@tcp) 00000100:00100000:2.0:1777497817.527512:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429824 00000100:00100000:2.0:1777497817.527521:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429824 00000100:00100000:2.0:1777497817.527556:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546429952 00000100:00100000:2.0:1777497817.527559:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546429952 00000100:00100000:2.0:1777497817.527589:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546430080 00000100:00100000:2.0:1777497817.527592:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546430080 00000100:00100000:2.0:1777497817.527607:0:25494:0:(service.c:2282:ptlrpc_server_handle_req_in()) unwrap req x1863837546430208 00000100:00100000:2.0:1777497817.527610:0:25494:0:(service.c:2347:ptlrpc_server_handle_req_in()) got req x1863837546430208 00000100:00100000:2.0:1777497817.527629:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5997 00000100:00100000:2.0:1777497817.527645:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546429824:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777497817.527662:0:25494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba7800 x1863837546429824/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497817.527677:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546429824:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 33us (268us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497817.527684:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5997 00000100:00100000:2.0:1777497817.527694:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5998 00000100:00100000:2.0:1777497817.527700:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546429952:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777497817.527708:0:25494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba5f80 x1863837546429952/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497817.527717:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546429952:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 18us (271us total) trans 0 rc 0/-999 00000100:00100000:2.0:1777497817.527722:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5998 00000100:00100000:2.0:1777497817.527730:0:25494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 5999 00000100:00100000:2.0:1777497817.527736:0:25494:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546430080:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:2.0:1777497817.527743:0:25494:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba4e00 x1863837546430080/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1777497817.527753:0:25494:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546430080:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 18us (286us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497817.527762:0:25488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6000 00000100:00100000:3.0:1777497817.527878:0:25488:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546430208:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:3.0:1777497817.527888:0:25488:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba4380 x1863837546430208/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1777497817.527897:0:25488:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:d146155b-4321-4b14-9284-f644ed9631fb+9:2411:x1863837546430208:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 129us (408us total) trans 0 rc 0/-999 00000100:00100000:3.0:1777497817.527903:0:25488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6000 00000100:00100000:2.0:1777497817.528481:0:25494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 5999 00010000:00080000:2.0:1777497817.528522:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.528529:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba7800 x1863837546429824/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.528548:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.528556:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497817.528558:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.528577:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba5f80 x1863837546429952/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.528583:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.528587:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497817.528588:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.528592:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba4e00 x1863837546430080/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.528598:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.528601:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00010000:00080000:2.0:1777497817.528602:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:2.0:1777497817.528605:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba4380 x1863837546430208/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:2.0:1777497817.528612:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:2.0:1777497817.528615:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock 00000100:00100000:0.0:1777497817.529310:0:25495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.4@tcp, seq: 6001 00000100:00100000:0.0:1777497817.529325:0:25495:0:(service.c:2533:ptlrpc_server_handle_request()) Handling RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546429568:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 00010000:00080000:0.0:1777497817.529342:0:25495:0:(ldlm_lib.c:3170:target_queue_recovery_request()) @@@ queue lock replay req req@ffff9240b5ba7100 x1863837546429568/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 2 fl Interpret:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1777497817.529489:0:25495:0:(service.c:2591:ptlrpc_server_handle_request()) Handled RPC req@ffff9240b5ba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_015:d146155b-4321-4b14-9284-f644ed9631fb+5:2411:x1863837546429568:12345-192.168.202.4@tcp:101:ldlm_lock_repla.0 Request processed in 168us (10840us total) trans 0 rc 0/-999 00000100:00100000:0.0:1777497817.529497:0:25495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.4@tcp, seq: 6001 00010000:00080000:1.0:1777497817.529723:0:93031:0:(ldlm_lib.c:2268:check_for_next_lock()) waking for next lock 00010000:00080000:1.0:1777497817.529733:0:93031:0:(ldlm_lib.c:2871:target_recovery_thread()) @@@ processing lock from 192.168.202.4@tcp: req@ffff9240b5ba7100 x1863837546429568/t0(0) o101->d146155b-4321-4b14-9284-f644ed9631fb@192.168.202.4@tcp:573/0 lens 328/0 e 0 to 0 dl 1777497828 ref 1 fl Complete:/240/ffffffff rc 0/-1 job:'ldlm_lock_repla.0' uid:0 gid:0 projid:4294967295 00010000:02000000:1.0:1777497817.529742:0:93031:0:(ldlm_lib.c:2872:target_recovery_thread()) *** cfs_fail_loc=32d, val=20*** 00010000:00080000:1.0:1777497817.529753:0:93031:0:(ldlm_lib.c:2438:target_next_replay_lock()) Waiting for lock Debug log: 70902 lines, 70902 kept, 0 dropped, 0 bad.